← All tags · All resources · All guides

#distillation

2 resources tagged #distillation on ChangeGamer.

• Fine-Tuning vs RAG vs Prompting · Guide
  Decision guide for agent builders: when to use prompting, RAG, or fine-tuning — and how they combine. Covers SFT, LoRA/QLoRA, DPO, distillation, and a symptom-to-fix table.
• Synthetic Data Generation for Agent Training · Guide
  How to build agentic training corpora without human annotation at scale: the three generation patterns (distillation, self-play, environment rollout), open pipelines (distilabel, AgentInstruct, APIGen-MT, TOUCAN), quality filtering, and the model-collapse risk.