Skip to main content

How To Use This Guide
Why Run Large Language Models Locally?
Understanding Large Language Models
Selecting Models
Models For Coding
- Overview of Code Llama Variations
- Other Notable Open Source Models for Coding
Installation
Evaluation
- Testing Each Model
- Evaluating Models with a Standardized Test
Best Practices
- Best Practices for Running Local LLMs
Prompts
- Collection of Prompts
- Creating a Shell Script
Advanced Usage
Benchmarks
Additional Resources

AI for Dev was created by Jesse Freeman. Visit the GitHub repo to help contribute.

AI for Dev on GitHub

Understanding Large Language Models

This is the introduction to the chapter.

Table of contents

Overview of Large Language Models
Models Variations
Model Naming Conventions
Parameter Size
Quantization
Quantization Schemes
How Models Are Scaled