← All tags · All resources · All guides

#caching

2 resources and 2 guides tagged #caching on ChangeGamer.

• Application-Level Response Caching for AI Agents · Guide
  How to implement exact-match and semantic caching in your agent application to eliminate redundant LLM calls, with threshold guidance, invalidation strategies, and a decision matrix for when semantic caching is unsafe.
• Context Window Management: Budgets, Compaction and Caching · Reference
  How to work within finite context windows: budget allocation across instructions, evidence and history; truncation versus summarization versus retrieval offload; prefix stability for prompt caching; and attention-quality caveats of very long contexts.

Guides

• MCP Server Cost Optimization: Toolset Size, Caching Hints, and Fan-Out · guide
  How the token cost of an MCP server's tool list, the 2026-07-28 spec's ttlMs/cacheScope caching hints, fan-out from callers you do not control, and per-tool-name cost visibility each shape what a production MCP server actually costs to run.
• How to Cut RAG Cost and Latency Without Cutting Quality · guide
  RAG cost and latency as engineered budgets: where the money actually goes, caching layers and their hit-rate economics, routing queries to right-sized models, bounding retrieval fan-out, the hidden lines (reindex migrations, eval compute), and p95 discipline.