The Green Dashboard Paradox

Staff ML Engineer interview at Anthropic, and the interviewer asks:

“Your Corrective-RAG system has an AI evaluator scoring its own retrievals. Six months in, answer quality is degrading, but your dashboards are green. What’s happening, and how would you have prevented it on day one?”

Don’t say: “The evaluator threshold needs retuning.”