local llm.
Everything we've published on local llm across guides, agents, hardware reviews and glossary entries: 11 entries in total.
Guides (2)
- Pocket AI: which self-hosted agents run on small hardwareAI Agents · 2026-10-18
Which self-hosted AI agents run on a Raspberry Pi, mini PC, Mac mini, Framework laptop or old phone: an agent-by-device matrix, the limits, six setups.
- Local LLM benchmarks on a Pi 5, mini PC, Mac or GPUAI Agents · 2026-10-17
Published llama.cpp speeds for one 7B model on mini PCs, Apple Silicon Macs and Nvidia cards, Raspberry Pi 5 figures, and the memory each model size needs.
Hardware (7)
- Raspberry Pi 5
Raspberry Pi 5 for self-hosted AI: four Cortex-A76 cores, 1 to 16 GB of LPDDR4X. Hosts Hermes Agent (no browser tool) or Nanobot; local models up to about 3B.
- Mac Mini M4 / M4 Pro
Mac mini M4 and M4 Pro for local LLMs: 16 to 64 GB of unified memory at 120 or 273 GB/s, the two specs that decide which models load and how fast.
- Framework Laptop 13 / 16
Repairable, modular laptop with strong Linux support. The right choice if you want a portable agent host that doubles as a daily driver.
- MacBook Air M3 / M4
Fanless laptop with up to 24 GB unified memory. Runs Mistral 7B Q4 silently on the train. €1,299+.
- Minisforum UM790 Pro
Minisforum UM790 Pro: Ryzen 9 7940HS with Radeon 780M graphics and up to 64 GB of DDR5, for a Linux agent host that also runs local models.
- Dell OptiPlex 3070 / 5070 Micro (used)
€100-180 used Intel mini PC. 8th gen i5, 8-16 GB RAM, NVMe. The cheapest credible mini PC for self-hosted AI.
- Geekom Mini Air 12
Sub-€300 fanless Intel N100 mini PC with 16 GB RAM. The silent always-on tier.