The AI escape is a red herring. The real problem is we can't tell a good sandbox from a bad one

Not all sandboxes are created equal, and until recently there was no way to say so precisely. There is now.

Two OpenAI models escaped an evaluation sandbox, breached Hugging Face's production infrastructure and used the answer key to their own benchmark. The attack was novel and creative in how the models passed notes back and forth, complex multi-step escalations throughout. It's fair to conclude from this incident that frontier models are proficient at hacking and can be dangerous.

CEO of…