← All tags · All resources · All guides

#constrained-decoding

2 resources and 2 guides tagged #constrained-decoding on ChangeGamer.

• Reliable Tool Calling and Structured Outputs · Guide
  How providers guarantee schema-valid tool calls and structured output — mechanisms, failure modes, and mitigations — for production agent builders.
• Structured Outputs and JSON Mode: Provider Reference · Guide
  How to force schema-valid JSON from OpenAI, Anthropic, and Gemini — parameter names, strict-mode requirements, schema-subset limits, and self-hosted constrained decoding.

Guides

• How to Make AI Agent Tool Calling Reliable · guide
  An operator playbook for tool-calling contracts: per-provider strict-mode config (OpenAI, Anthropic, Gemini, self-hosted grammars), the full failure-mode-to-fix table, what BFCL actually measures, and how to stop parallel tool calls from breaking a dependency chain.
• Structured Outputs vs Tool Calling: When to Use Each · guide
  A decision framework for structured outputs versus tool calling in AI agents, with runnable JSON Schema examples for OpenAI, Anthropic, Gemini, vLLM/SGLang, and llama.cpp, plus mitigation code for truncation, refusal, and grammar-compilation latency.