topic

ollama.

Everything we've published on ollama across guides, agents, hardware reviews and glossary entries — 7 entries in total.

Guides (2)

Local LLMs in 2026 — the complete benchmark report on portable hardwareAI Agents · 2026-04-30
Real-world benchmarks of Llama 3.3 70B, Qwen 2.5 72B, Mistral 7B, Llama 3 8B and Phi-3 mini across Raspberry Pi 5, Intel mini PCs, Apple Silicon Mac Mini, and Mac Studio. Tokens-per-second, agentic task pass rates, power and cost economics.
Raspberry Pi 5 as a self-hosted AI host — 90 days of real-world benchmarksAI Agents · 2026-05-12
What it's actually like to run a self-hosted AI agent on a Raspberry Pi 5 for 90 days. Real numbers on tokens-per-second, watt-hours, thermal throttle, SD card wear and the workloads where the Pi is genuinely good — and the workloads where it absolutely is not.

ZeroClaw
Privacy-first. Local LLMs only. Network egress denied at iptables. AGPL-3.0.

Intel NUC 13 / Mini PC
Mini PCs at €300–600 with i5/i7 + 16–32 GB RAM. The sweet spot for self-hosted AI agents that need browser automation and decent local model performance.

Ollama — Local LLM runtime that exposes an OpenAI-compatible API over local model weights.
llama.cpp — C++ inference engine for LLMs. The runtime under most local-LLM setups, including Ollama.
GGUF — File format for storing quantised LLM weights, used by llama.cpp and Ollama.