#context-window

4 resources tagged #context-window on ChangeGamer.

Agent Memory and Context Management · Guide
Architecture reference for agent memory: types (working, long-term, episodic, semantic, procedural), context-management techniques (summarization, RAG, sliding windows, prompt caching), storage substrates, and memory frameworks — with security notes and cross-links to related guides.
Prompt and Context Engineering for Agents · Guide
From crafting a single prompt to managing everything an agent sees across a trajectory: system-prompt design, context-window management, failure modes, and a high-leverage checklist.
Context Window Management: Budgets, Compaction and Caching · Reference
How to work within finite context windows: budget allocation across instructions, evidence and history; truncation versus summarization versus retrieval offload; prefix stability for prompt caching; and attention-quality caveats of very long contexts.
LLM Tokenization and Token Counting: tiktoken, Provider Counting Endpoints, and Why Counts Differ · Guide
Decision rule for counting LLM tokens: bill from the response usage fields, gate requests with the provider's token-counting endpoint, estimate offline with a tokenizer library such as tiktoken, and never reuse a count across models. Includes pitfalls and budgeting rules.