TAG

Cost

Everything filed under this tag.

1 entries

01Writing

Where the Prefix-Cache Hits Went2026-10-27The hit rate dropped, and the total alone couldn’t say why. Looked at in 128-token blocks, the losses came from one section placed in the wrong spot, and from two providers with completely different caching rules.#LLM#Cost#Observability

← All tags Search the site