Skip to main content

How To Use This Guide
Why Run Large Language Models Locally?
Understanding Large Language Models
Selecting Models
Models For Coding
- Overview of Code Llama Variations
- Other Notable Open Source Models for Coding
Installation
Evaluation
- Testing Each Model
- Evaluating Models with a Standardized Test
Best Practices
- Best Practices for Running Local LLMs
Prompts
- Collection of Prompts
- Creating a Shell Script
Advanced Usage
Benchmarks
Additional Resources

AI for Dev was created by Jesse Freeman. Visit the GitHub repo to help contribute.

AI for Dev on GitHub

Installation

This is the introduction to the chapter.

Table of contents

Installing LM Studio
Configuring LM Studio on Apple Silicon
Optimizing LM Studio for Apple Silicon
Picking Models in LM Studio