topic

ollama.

Everything we've published on ollama across guides, agents, hardware reviews and glossary entries — 8 entries in total.

Guides (3)

Best local LLMs 2026 — benchmarks on Mac Mini M4, Raspberry Pi 5, mini PCsAI Agents · 2026-04-30
Real-world benchmarks of Llama 3.3 70B, Qwen 2.5 72B, Mistral 7B, Llama 3 8B and Phi-3 mini across Raspberry Pi 5, Intel mini PCs, Apple Silicon Mac Mini, and Mac Studio. Tokens-per-second, agentic task pass rates, power and cost economics.
Raspberry Pi 5 LLM benchmarks — real tokens/sec after 90 days of self-hosted AIAI Agents · 2026-05-12
What it's actually like to run a self-hosted AI agent on a Raspberry Pi 5 for 90 days. Real numbers on tokens-per-second, watt-hours, thermal throttle, SD card wear and the workloads where the Pi is genuinely good — and the workloads where it absolutely is not.
Ollama heap leak (CVE-2026-5757) and inference-server memory safetyAI Agents · 2026-07-06
Ollama CVE-2026-5757 leaks heap memory to unauthenticated callers; Triton's DALI backend (CVE-2026-24213/24214/24264) has integer-overflow and OOB bugs.

ZeroClaw
Privacy-first. Local LLMs only. Network egress denied at iptables. AGPL-3.0.

Intel NUC 13 / Mini PC
Mini PCs at €300–600 with i5/i7 + 16–32 GB RAM. The sweet spot for self-hosted AI agents that need browser automation and decent local model performance.

Ollama — Local LLM runtime that exposes an OpenAI-compatible API over local model weights.
llama.cpp — C++ inference engine for LLMs. The runtime under most local-LLM setups, including Ollama.
GGUF — File format for storing quantised LLM weights, used by llama.cpp and Ollama.