1
We Measured LLM Prompt Caching in Production — Same Prompt, 0% to 91% Hit Rates
实测LLM提示缓存:相同提示从0%到91%命中率,揭示不同提供商缓存策略的巨大差异。
We run an AI companion bot. Every chat turn, the model sees the same ~5K-token prefix — character persona, content-tier rules, formatting guardrails, …