Getting started with local AI means learning how language models like Llama, Qwen, and Mistral run on your own machine using tools such as Ollama, llama.cpp, LM Studio, or Open WebUI. You’ll also pick up the terminology you’ll encounter everywhere: quantized models, GGUF, context windows, RAG, and embedding models. Think of it as your own ChatGPT, except your data stays yours and there’s no monthly bill.
Why this matters: Without these foundations, you’ll end up buying VRAM for a model your computer can’t even load.
The list below is structured in the order that makes the most sense for learning: understand first, experiment next, then go deeper. Check off what you’ve already read or tried. Your progress saves locally in your browser.
Getting Started & Overview
Local AI Fundamentals
Agent Memory for AI Agents
Local RAG
Local AI Models
Multimodal AI
Model Quantization
Quantization Calculator for AI Models
Local AI Software
Done? Continue with the next category in the free AI learning path.