Buying a Laptop for Local AI
What this article covers
- When a laptop for AI makes sense.
- Which GPUs in laptops have enough performance.
- How much RAM and storage you need.
- Advantages and limitations of mobile AI.
- Typical buying criteria and recommendations.
Introduction: Buying a laptop for local AI
A desktop AI PC delivers maximum performance, but sometimes AI needs to be portable. Developers who want to test models on the road, or users running a small server from anywhere, need a powerful laptop. Modern laptops with a dedicated Nvidia GPU, 32 GB of RAM or more, and fast SSDs can handle surprisingly demanding workloads. Apple Silicon also brings some real advantages for local AI, especially when energy efficiency matters.
This article walks through what to look for when choosing an AI-capable laptop.
Key terms
- Mobile GPU: Laptop variant of a desktop graphics card.
- TDP in notebooks: Limited power output due to cooling and battery constraints.
- dGPU: Dedicated GPU, a separate graphics card.
- iGPU: Integrated GPU built into the CPU or SoC.
- Apple Silicon: ARM-based Apple chips with unified memory.
- MUX Switch: Hardware switch between iGPU and dGPU.
- Thunderbolt: High-speed external interface.
- eGPU: External GPU connected via Thunderbolt or USB4.
When does a laptop make sense?
- Testing or demonstrating models on the go.
- Running small inference jobs away from your desk.
- AI as a secondary task alongside regular work.
- No space for a desktop PC.
- Working across multiple locations.
- Running quiet AI demos in an office or client meeting.
For regular training, fine-tuning, or handling large models, a desktop or server remains the better choice.
GPU in a laptop
Nvidia RTX laptop GPUs
| Model | VRAM | Performance |
|---|---|---|
| RTX 4050 Laptop | 6 GB | Entry-level |
| RTX 4060 Laptop | 8 GB | Mid-range |
| RTX 4070 Laptop | 8 GB | Strong mid-range |
| RTX 4080 Laptop | 12 GB | High performance |
| RTX 4090 Laptop | 16 GB | Top-tier |
Laptop GPUs run significantly slower than their desktop counterparts. Performance varies considerably depending on TDP and cooling capability.
Apple Silicon
- M1/M2/M3 Pro, Max, and Ultra offer unified memory.
- 16 to 128 GB of shared memory.
- Strong energy efficiency and long battery life.
- Good support via llama.cpp and Ollama on macOS.
Intel Arc and AMD
- Intel Arc and some AMD GPUs can run AI workloads, but software support is still lagging.
- For beginners, Nvidia or Apple Silicon are the safer bets.
RAM and storage
- 16 GB works for very small models.
- 32 GB makes more sense for 7B models.
- 64 GB and up for larger models or running multiple workloads.
- At minimum, 1 TB NVMe SSD, ideally 2 TB.
- Thunderbolt SSDs or NAS for additional capacity.
Display
- 15 to 16 inches gives you enough real estate for code and dashboards.
- 4K is nice but drains battery quickly.
- 1440p with good color accuracy is often the sweet spot.
- An external monitor at home is worth considering.
Cooling and battery
- Full load generates significant heat and noise.
- Laptops with larger fans and better air intake cool more effectively.
- Battery life under full load typically drops below an hour.
- A power adapter is necessary for longer AI sessions.
eGPU as an alternative
An external GPU enclosure connected via Thunderbolt 3/4 or USB4 can turn your laptop into an AI workstation when you’re home. Requirements:
- Thunderbolt or USB4 on your laptop.
- Compatible eGPU enclosure.
- External Nvidia or AMD GPU.
Buying recommendations
Entry-level
- Gaming laptop with RTX 4060 and 16 GB RAM.
- Apple MacBook Pro M3 with 18 GB unified memory.
Mid-range
- RTX 4070 Laptop with 32 GB RAM.
- MacBook Pro M3 Pro with 36 GB.
High-end
- RTX 4080/4090 Laptop with 64 GB RAM.
- MacBook Pro M3 Max with 64 to 128 GB.
Typical trade-offs
- Less VRAM than desktop GPUs.
- Thermal throttling under sustained load.
- Fan noise during full-load operation.
- Limited upgrade options.
- High cost per unit of performance.
- Battery drains quickly.
Further reading and resources
- BotServ.de Building an AI PC
- BotServ.de Buying a GPU for local AI
- BotServ.de Apple Silicon for AI
- BotServ.de Energy efficiency
FAQ: Laptop for AI
Can I run Ollama on a laptop? Yes, if you have sufficient RAM and VRAM.
What is the best AI laptop? Depends on your use case. RTX 4090 laptops and M3 Max machines are the high-end options.
Do I need 64 GB of RAM? For larger models or running multiple workflows simultaneously, yes.
Is an eGPU worth it? For expanding a stationary setup around a laptop, yes, if your machine has Thunderbolt.
Are Apple chips good for AI? Yes, especially thanks to unified memory and energy efficiency.
Sources and further reading
- Notebookcheck: https://www.notebookcheck.net/
- Apple Silicon: https://www.apple.com/mac/
- Laptop GPU Guide: https://www.techpowerup.com/gpu-specs/
Summary: Buying a laptop for local AI
An AI laptop is ideal when AI needs to be portable. Nvidia RTX laptops and Apple Silicon devices are your best options. Sufficient VRAM, RAM, and fast storage are essential. Throttling, noise, and battery life are the typical trade-offs. For larger models or regular training work, a desktop or server is still the better choice. But if you want to run local AI on the road occasionally, the right laptop can give you a capable mobile setup.


