#data-pipelines
1 resource and 1 guide tagged #data-pipelines on ChangeGamer.
- Synthetic Data Generation for Agent Training How to build agentic training corpora without human annotation at scale: the three generation patterns (distillation, self-play, environment rollout), open pipelines (distilabel, AgentInstruct, APIGen-MT, TOUCAN), quality filtering, and the model-collapse risk.
Guides
- How to Build a RAG Ingestion Pipeline That Survives Production The six properties that separate a production RAG ingestion pipeline from a demo script: tested extraction, idempotent writes, incremental updates, deletion propagation, durable execution, and metadata captured at ingest time.