The Uncertainty Loop Paradox

Senior AI Engineer interview at Meta, and the interviewer asks:

“We have a 10-million sample unlabelled dataset and want to fine-tune a Llama-3 70B model while minimizing manual annotation costs. How do you design an Active Learning loop to selectively label the most uncertain points?”