The Pixel-Memory Paradox

Senior AI Engineer interview at Google DeepMind, and the interviewer asks:

“Our computer-use agent appends every screenshot and action to its context. It’s solid on 15-step web tasks. But on a 300-step desktop workflow, around step 80 it starts redoing actions it already took. The team wants to switch to a 2M-token context model. Why won’t that fix it?”

Don’t say: “Use a longer context window so the agent can see its full history.”