TAG
Observability
Everything filed under this tag.
2 entries01Writing
Where the Prefix-Cache Hits Went2026-10-27The hit rate dropped, and the total alone couldn’t say why. Looked at in 128-token blocks, the losses came from one section placed in the wrong spot, and from two providers with completely different caching rules.#LLM#Cost#ObservabilityFully Configured, Silently Ignored2026-10-21A field sits in the config, looks like it’s active, and no code ever reads it. This kind of failure raises no error — it just makes people say “something feels off”.#Engineering#Observability#LLM