Issue 22, Dec 6, 2025

The Softmax Trap

Senior Machine Learning Engineer interview at OpenAI, and the interviewer asks:

Why writing “clean code” for softmax regression silently destroys your training run, and how LogSumExp saves you.

Share this trapShare on LinkedIn

The full answer, with the mechanism and the arithmetic, is for paid subscribers on Substack.

Read it on Substack

Get the next one

Free on Substack. Unsubscribe in one click.

More traps set at OpenAI