Docs
Setup notes and command logs from building out our local AI infrastructure.
🖥️
2026-07-14
llama.cpp + Open WebUI Setup
GPU-accelerated local inference with llama.cpp and CUDA, fronted by Open WebUI, reachable remotely via Tailscale and SSH.
💻
2026-07-14
HP Laptop: llama.cpp + CUDA Setup
Downloading a Ministral 3B model, rebuilding llama.cpp with CUDA, and tuning GPU layer offload to fit laptop VRAM.
🧩
2026-07-15
HP Workstation Deployment (Part 2)
Adding a second, isolated Open WebUI plus two more models (Gemma 3 4B, Qwen2.5 3B) — with every mistake and lesson learned along the way.