The Max-Iteration Trap

Senior ML Engineer interview at Anthropic, and the interviewer asks:

“Your self-correction loop improves output quality on every pass, but p99 latency just tripled in prod. Your teammate says ‘just cap the max iterations.’ Why is that a band-aid, and what’s actually broken?”

Don’t say: “We’ll set max_iterations = 3 and ship it.”