Overview
LM Studio is a desktop application for running local LLMs with a user-friendly interface, supporting GGUF format models.
Key Features
- User-Friendly Interface: Chat interface with model management
- Model Download: Built-in model browser and downloader
- GGUF Support: Optimized for GGUF format models
- Local Server: Built-in server for API access
- Cross-Platform: Windows, macOS, Linux support
Installation
Download from lmstudio.ai
Usage
- Download Models: Use the built-in model browser to download models
- Start Chat: Select a model and start chatting
- API Access: Enable local server for API integration
Supported Models
- Llama models (GGUF format)
- Mistral models
- Phi models
- CodeLlama models
- And many more GGUF models