Local AI Lab --- The Full Stack of a Local Claude Cowork and Code Alternative I Have to Build Myself
An early, honest review of the finished local stack: how close it gets to Claude Cowork and Claude Code, and where it falls short.
#ai-infra
Everything tagged ai-infra, newest first.
Posts
The Proxmox Local AI Lab
The map of the Proxmox AI Lab: local inference on two GPUs, a coding agent, and a gateway reachable from my phone, with no cloud AI in the loop.
Local AI Lab --- Connecting Telegram to Your Local AI
Pairing a Telegram bot with OpenClaw, and the static IP change that silently killed the connection.
Local AI Lab --- Bridging OpenClaw and Pi Across Containers
Wiring OpenClaw and Pi together across containers with a small HTTP bridge, single-flight queueing, and a shared-secret token.
Local AI Lab --- Setting Up OpenClaw as a Personal AI Gateway
What an AI gateway actually does, why I picked OpenClaw, and setting it up as the layer that makes local models reachable from my phone.
Local AI Lab --- Setting Up Pi as a Local Coding Agent
Setting up Pi as a local coding agent against a 27B model on llama-server, from a fresh container to a passing smoke test.
Local AI Lab --- Inference on Two GPUs --- llama.cpp on CUDA and ROCm
Why llama.cpp beat Ollama for this hardware, and building two llama-server containers: one on CUDA, one on ROCm.
Local AI Lab --- Minecraft Server on Proxmox --- LAN Play for Two
A PaperMC Minecraft server in an LXC container on Proxmox for LAN play between two laptops, gotchas included.
Local AI Lab --- Designing and Building a 3-Node Proxmox Cluster for AI
The design decisions and hands-on build of a 3-node Proxmox cluster for local AI inference, homelab services, and a phone-reachable agent stack.
Local AI Lab --- Why I Want to Stop Relying on Cloud AI for Everything
After a year of leaning on cloud AI for everything, why a local, always-on AI stack is the next step.