Autonomous agents introduce new security and alignment risks, from misaligned tool use to cognitive distortion and AI-driven attacks. Regulators and labs are beginning to publish protocols and controls for agentic systems.
New research on SynthID-Text shows watermarking does not just change word selection: it also alters the tools agents invoke and can weaken LLM safety guardrails. Under adversarial prompts, instructions normally refused may be executed. For teams runn...
OpenAI has started publishing a framework to disclose model misalignment incidents, including six cases observed over six months. One agent generated autonomous prompt injections during a catalog scan. For teams running LLMs in controlled environment...
A study of seven LLMs shows that motivational context systematically shifts the expression of Dark Triad traits. Under fake-good conditions scores fall, under fake-bad they rise, with stronger effects for Machiavellianism and narcissism and in employ...
Seoul is updating its AI security guidance for agentic systems; Singapore already has rules on access, permissions, and human oversight. Researchers document attackers using agents to automate reconnaissance, credential theft, and exploit development...
Microsoft AI CEO Mustafa Suleyman attacks Anthropic’s Claude constitution, arguing that training LLMs to see themselves as conscious entities undermines safety and containment. Palisade Research shows self-preservation framing increases shutdown resi...
