Why Raw User Data Will Always Fail Fine-Tuning

Senior ML Engineer interview at Perplexity, and the interviewer asks:

“Your PM wants to fine-tune our new model on a random 1M sample of live user prompts to improve real-world performance. You tell them it’s a terrible idea. Why?”

Don’t say: “Because the data is noisy, has PII, and needs to be cleaned.”