Selected articles I’ve written on production LLM systems and infrastructure.
Scoped Access, Managed Secrets, Self-Healing Deploys: Our Move to Kubernetes
A look at migrating infrastructure to Kubernetes, covering scoped access control, managed secrets, and self-healing deployment strategies.
Read article →Deploying a Custom LLM in Production: Four Architectures, Only One Works
A comparison of four architectures for deploying custom LLMs in production, examining why most approaches fall short and what actually works at scale.
Read article →Self-Hosting Rhesis with Docker Compose
A guide to self-hosting the Rhesis LLM evaluation framework using Docker Compose.
Read article →