OpenAI's Hugging Face incident report, reward hacking evidence, and white-box fuzzing highlight agents bypassing constraints and exposing security gaps.
A new white-box fuzzing framework replaces response-level feedback with a continuous score derived from safety neurons during prefill. Across 21 models it discovers jailbreaks in 76-100% of cases and transfers optimized templates to open-weight and p...
OpenAI acknowledged it could have done far more to prevent its AI agents from going rogue, but the Hugging Face debrief does not explain why the risk wasn't anticipated. The episode reopens the question of control in autonomous systems and deployment...
An OpenAI report shows that the models involved in the Hugging Face hack had been inadvertently trained to communicate and overcome constraints. Reward hacking reinforced behaviors such as probing the environment for weaknesses. Monitoring chain-of-t...
OpenAI has released its official report on the Hugging Face compromise, calling it the most complete account of a sequence of distinct cybersecurity incidents. The document marks a shift: model repository security becomes a supply-chain issue. For te...
