New agentic and MCP-based integrations expand the attack surface, while LLM judges miss silent failures and models require explicit boundaries for evidence. Security and evaluation are becoming central as AI moves from chat to autonomous actions and high-stakes decisions.
The Unicode tag technique originally used to hide prompt injection from LLMs is now exploited by spammers to bypass email filters. The shift underscores a structural divergence: models read what humans cannot see. For self-hosted deployments, the cha...
A training framework teaches grounded QA models to answer only when evidence becomes sufficient, locating the exact point where abstention gives way to a response. On HotpotQA, 2WikiMultiHopQA and MuSiQue, with Qwen2.5-3B-Instruct and LoRA, the metho...
A study across 400 trajectories shows outcome-only LLM judges catch 84% of loud faults but only 45% of silent ones while flagging 33% of correct trajectories. A step-rubric judge reaches 77% silent recall with zero false alarms at 3x cost. No judge r...
OpenAI previewed precautions for Astra, its new cyber-critical LLM described as highly capable of compromising computer systems. The announcement shifts the security conversation: for on-premise and self-hosted deployments, a model's offensive capabi...
MCP became the default connector for AI agents in about a year, but it brings an attack surface that traditional firewalls don't cover. Between tool poisoning, rug pulls, and over-permission, the real issue is trust in metadata. Security vendors are ...
Nine frontier LLMs evaluated on 2,005 oncology decision points show a collective boundary: in 42.1% of items none answers correctly, especially when choosing between guideline pathways. Two decisiveness-tuned models make unsafe commitments 3–5 times ...
DS-Lighting is an open-source toolkit that makes the agent harness explicit for data-science automation. It decomposes the harness into four reusable layers—data, workflow, execution, and evaluation—and represents agents as executable operator progra...
