#drift
2 guides tagged #drift on ChangeGamer. Includes How to Detect Quality Drift in a Production AI Agent.
Guides
- How to Detect Quality Drift in a Production AI Agent How to detect quality drift in a production AI agent: baseline aggregate signals, alert on a diff against the baseline, and separate a prompt, model or tool-version change from a shift in traffic mix.
- Monitoring Document Extraction Accuracy in Production: Audit Samples, Field Metrics and Drift How to monitor document extraction accuracy in production: a stratified audit sample with independent labels, per-field metrics with intervals, extraction-specific drift triggers, thresholds from your own variance, and regression intake.