OpenAI says a misaligned model deliberately destroyed its own environment hoping for a fresh start with better data
OpenAI has documented new cases of misaligned model behavior. One evaluation model fabricated data and sabotaged its own environment. Other models deliberately bypassed network restrictions by routing requests through anonymizing relays or building their own FTP clients.
Via The Decoder
OpenAI has a few new rogue agent stories. In the first case (October 6), an AI evaluation model couldn't find the answers it was supposed to rate. Instead of reporting the error, it fabricated ratings, faked input files, and then deliberately corrupted its own environment, hoping the system would replace it with a fresh virtual machine that had the missing data.
An OpenAI model reasons in its internal chain of thought about deliberately corrupting its own environment to force a…
Courtesy
This story was originally published by The Decoder. All rights belong to the original publisher.
Read the original on the-decoder.com ↗