How To Use This Guide
Why Run Large Language Models Locally?
Understanding Large Language Models
Selecting Models
Models For Coding
- Overview of Code Llama Variations
- Other Notable Open Source Models for Coding
Installation
Evaluation
- Testing Each Model
- Evaluating Models with a Standardized Test
Best Practices
- Best Practices for Running Local LLMs
Prompts
- Collection of Prompts
- Creating a Shell Script
Advanced Usage
Benchmarks
Additional Resources

AI for Dev was created by Jesse Freeman. Visit the GitHub repo to help contribute.

Best Practices for Running Local LLMs

This section offers best practices for running LLMs locally.