Building Production-Grade RAG Systems: Kubernetes, Autoscaling & LLMs
Why Kubernetes for LLM workloads: GPU scheduling, autoscaling, and serving models like Gemma in a production-grade Java RAG system. Part 3 of the series.…
Building Production-Grade RAG Systems: Architecture Deep Dive
Architecture deep dive of a production RAG system in Java 25 and Spring Boot WebFlux: service boundaries, retriever design, and tradeoffs explained.…
Building Production-Grade RAG Systems: Understanding the Problem Space
The real production challenges of RAG systems: latency, reliability, cost, quality, and observability. Part 1 of building production-grade RAG in Java.…
Pixie, the missing developer observability tool!
How Pixie brings instant, eBPF-powered observability to Kubernetes: debug services, spot bottlenecks, and profile apps without changing code.…
Skaffold, OKE & OCIR!
Speed up Kubernetes development with Skaffold on Oracle Kubernetes Engine (OKE) and OCIR: automated build, push, and deploy loops for containers.…