Tag
#Distributed systems
3 posts
- AI Engineering
Production Large Language Model Engineering: Part 2
An LLM application depends on model providers, databases, vector stores, and external APIs — any of which can slow down or fail. Rate limiting, backpressure, retries, timeouts, and circuit breakers are how you keep the system standing anyway.
Aug 21, 2026 10 min read maxwell.kimaiyo - Distributed Systems
Distributed Cache Design: Part 2
CAP theorem isn't 'pick two of three' — partitions happen regardless. The real design decision is consistency vs. availability during a partition, and a separate spectrum of guarantees the rest of the time.
Aug 21, 2026 6 min read maxwell.kimaiyo - Distributed Systems
Distributed Cache Design: Part 1
Why naive hashing breaks distributed caches, how consistent hashing and virtual nodes fix it, and how to choose the right eviction policy and read/write strategy for your workload.
Aug 21, 2026 7 min read maxwell.kimaiyo