The Adversarial Objective Trap

Senior Generative AI Engineer interview at Google DeepMind, and the interviewer asks:

“Your tech lead insists on using a heavily optimized GAN for a new pipeline because of its blazing fast inference and crisp quality. But the enterprise client requires capturing the absolute full, long-tail diversity of the training dataset. Why is your tech lead about to ruin the project?”

Don’t say: “GANs are prone to mode collapse, so we just need to implement Mini-batch Discrimination, switch to a Wasserstein loss with gradient penalty (WGAN-GP), or unroll the discriminator to force diversity.”