← All tags · All resources · All guides

#optimization

3 resources and 1 guide tagged #optimization on ChangeGamer.

• Agent Cost and Latency Optimization · Guide
  Practitioner reference for reducing the cost and latency of production AI agents: the compounding model, token-level levers (caching, pruning), request-level levers (Batch API, parallelism), model-level levers (routing, reasoning-effort controls), and architecture-level levers (step reduction, semantic caching, code offloading).
• Prompt Caching for AI Agents · Guide
  Cross-provider prompt caching reference: how to activate it, minimum token thresholds, TTLs, read-vs-write pricing, and when it pays off for agentic workloads.
• Application-Level Response Caching for AI Agents · Guide
  How to implement exact-match and semantic caching in your agent application to eliminate redundant LLM calls, with threshold guidance, invalidation strategies, and a decision matrix for when semantic caching is unsafe.

Guides

• MCP Server Cost Optimization: Toolset Size, Caching Hints, and Fan-Out · guide
  How the token cost of an MCP server's tool list, the 2026-07-28 spec's ttlMs/cacheScope caching hints, fan-out from callers you do not control, and per-tool-name cost visibility each shape what a production MCP server actually costs to run.