local llm.
Everything we've published on local llm across guides, agents, hardware reviews and glossary entries — 14 entries in total.
Guides (2)
- Pocket AI 2026 — the complete guide to running self-hosted AI on portable hardwareAI Agents · 2026-04-29
The reference guide on Pocket AI: running self-hosted AI agents and local LLMs on Raspberry Pi, Mac Mini, mini PCs, Framework laptops and edge devices. Hardware comparison, agent compatibility, real-world benchmarks, and the manifesto.
- Local LLMs in 2026 — the complete benchmark report on portable hardwareAI Agents · 2026-04-30
Real-world benchmarks of Llama 3.3 70B, Qwen 2.5 72B, Mistral 7B, Llama 3 8B and Phi-3 mini across Raspberry Pi 5, Intel mini PCs, Apple Silicon Mac Mini, and Mac Studio. Tokens-per-second, agentic task pass rates, power and cost economics.
Hardware (9)
- Raspberry Pi 5
The default starting point for pocket AI in 2026. 4–8 GB of LPDDR4X, ARM Cortex-A76, sub-€100, runs Hermes Agent (no browser tool) or Nanobot comfortably.
- Intel NUC 13 / Mini PC
Mini PCs at €300–600 with i5/i7 + 16–32 GB RAM. The sweet spot for self-hosted AI agents that need browser automation and decent local model performance.
- Mac Mini M4 / M4 Pro
The single best small-form-factor host for local LLMs in 2026. Apple Silicon unified memory makes 70B-class models tractable on a desk-sized machine.
- Framework Laptop 13 / 16
Repairable, modular laptop with strong Linux support. The right choice if you want a portable agent host that doubles as a daily driver.
- MacBook Air M3 / M4
Fanless laptop with up to 24 GB unified memory. Runs Mistral 7B Q4 silently on the train. €1,299+.
- Lenovo ThinkCentre M75q (used)
€150–250 used Ryzen mini PC. 16 GB RAM, NVMe slot, runs Hermes Agent comfortably. The budget winner.
- Minisforum UM790 Pro
Ryzen 9 7940HS mini PC. 32–64 GB RAM. The best Linux mini PC value at €700-900.
- Dell OptiPlex 3070 / 5070 Micro (used)
€100–180 used Intel mini PC. 8th gen i5, 8–16 GB RAM, NVMe. The cheapest credible mini PC for self-hosted AI.