The Raspberry Pi 5 is the default starting hardware for self-hosted AI in 2026. It's also the most over-promised: the Pi can do real things, but not everything you'll read on YouTube.
What works on a Raspberry Pi 5 (8 GB) in 2026: Hermes Agent without the browser tool, Nanobot, OpenClaw 2026.4 with browser disabled, ZeroClaw Lite with Phi-3 mini 3.8B Q4. Power draw stays under 12W typical; the official active cooler keeps thermals in line for sustained workloads. Add the M.2 NVMe HAT (€60) for any deployment that runs longer than a week — microSD lifespan under sustained agent writes is months, not years.
What does not work: Llama 3 8B at any usable speed (forget it on the Pi), browser automation at scale (Chromium is too heavy), multi-user workloads, ZeroClaw with the full feature set including 7B+ models.
The Orange Pi 5 Plus is the credible alternative: 16-32 GB RAM, RK3588 with NPU, M.2 NVMe out of the box. It's meaningfully more capable on paper. The catch is software ecosystem — Pi Foundation has the largest hobbyist community in computing, Orange Pi has Armbian. If you'll value polish over capability, stay on the Pi 5. If you'll value capability and you're comfortable on Armbian, the Orange Pi 5 Plus is genuinely better.
The Pi Zero 2 W (€20) is too small to host a primary agent but excellent as an edge MCP tool host in a distributed setup. Pair a primary Pi 5 with 3-5 Pi Zeros and you have a multi-tool agent network for under €200.
Guides
- Pocket AI 2026 — the complete guide to running self-hosted AI on portable hardware — The reference guide on Pocket AI: running self-hosted AI agents and local LLMs on Raspberry Pi, Mac Mini, mini PCs, Framework laptops and edge devices. Hardware comparison, agent compatibility, real-world benchmarks, and the manifesto.
- Edge AI hardware buyer's guide 2026 — Raspberry Pi 5 vs Mini PC vs Mac Mini vs Framework — Honest hands-on hardware buyer's guide for self-hosted AI agents in 2026. Raspberry Pi 5, Intel NUC and clones, Mac Mini M4, Framework Laptop, Orange Pi 5 Plus — real benchmarks, real bills, concrete recommendations by budget.
Agents on this topic
- Hermes Agent — Post-OpenClaw safe default. Docker-sandboxed by default, multi-LLM, opinionated. The agent we'd hand a colleague today.
- Nanobot — 4,000-line Python agent designed to be auditable in an afternoon. Trust through verification.
- ZeroClaw Lite — Stripped-down ZeroClaw fork for resource-constrained hosts. Phi-3 mini default, runs comfortably on a Pi 5.
- Moltworker — Self-hosted AI agent on Cloudflare Workers. Free at low volume. Workers runtime constraints apply.
Hardware on this topic
- Raspberry Pi 5 — The default starting point for pocket AI in 2026. 4–8 GB of LPDDR4X, ARM Cortex-A76, sub-€100, runs Hermes Agent (no browser tool) or Nanobot comfortably.
- Raspberry Pi Zero 2 W — €20 SBC with 512 MB RAM. Useful as an edge agent endpoint (sensor reader, tool host) but not a primary agent host.
- Khadas Edge2 Pro — Premium SBC with 16 GB RAM and the same RK3588 as Orange Pi 5 Plus. Better build, smaller community.
Terms
Pocket AI · Edge AI · Phi-3 · Ollama · MCP server