Topic / Trend Rising

Agentic AI and RAG Overhaul

Agentic loops are outperforming traditional RAG pipelines, and models like AREX-2 improve through propose-measure-reflect-revise cycles. New runtimes and controls for memory and world models make agents more efficient and reliable.

Detected: 2026-10-02 ยท Updated: 2026-10-02

Related Coverage

2026-10-02 โ€ข ArXiv cs.AI

Causal World Models for Modular LLM Agents: The Graph Is Not Enough

Observational world models are not enough for modular LLM agents: a sequence does not say whether payment authorizes shipment or a hidden factor explains both. The FedCausalCompose framework shows that interventional error decreases with intervention...

#LLM On-Premise #DevOps
2026-10-02 โ€ข ArXiv cs.AI

Heavy-Tailed Memory in LLM Agents: A Control Signal That Cuts Token Use

An audit shows that LLM agents concentrate retrieval on a small core and leave rare states in a long tail, where prediction errors build up. The CTWM controller allocates prompt budget with a single exponent and reduces tokens by 24.48% on LongMemEva...

#LLM On-Premise #DevOps
2026-10-01 โ€ข LocalLLaMA

RAG on FRAMES: 18 pipelines beaten by an agent loop. Reranker under scrutiny

A benchmark on 824 multi-hop questions from FRAMES compares 18 RAG pipelines with an agent loop. The best pipeline reaches 78.9%, the agent 92.7%. The most awkward result concerns reranking: a small model drops accuracy by 9 points, a large one barel...

#LLM On-Premise #Fine-Tuning #RAG
2026-10-01 โ€ข ArXiv cs.CL

TomasuLLM: Out-of-Order Speculative Execution for LLM Agents

A runtime executes LLM agent tool calls out of trajectory order but commits only after validation. Speedups up to 1.35x on benchmarks with slow tools, zero false accepts across 4,010 records. A structural shift for self-hosted deployments focused on ...

#Hardware #LLM On-Premise #DevOps
2026-10-01 โ€ข ArXiv cs.AI

AREX-2: Self-improving LLM agents through long-horizon reflection

AREX-2 explores self-improvement in LLM agents through reflection and long-horizon iterations. Trained on synthetic trajectories from machine learning and algorithmic programming tasks, built on Qwen3.8-27B, it achieves 81.8 on MLE-bench Lite and 70....

#Hardware #LLM On-Premise #DevOps
2026-09-30 โ€ข LocalLLaMA

AREX-2 Turns Inference into a Revision Loop: What Changes for On-Premise

BAAI has released AREX-2, a 27B parameter agent model compatible with Qwen3.8. Its propose-measure-reflect-revise loop uses scores, logs, and errors to refine answers. With a 262,144 token context and GGUF files, it matters for self-hosted deployment...

#Hardware #LLM On-Premise #DevOps
2026-09-30 โ€ข ArXiv cs.CL

Sieve and Sage: separating noise from absence of evidence in RALMs

A framework splits retrieval failures into two states: unanswerable and distracted. A lightweight module, Sieve, filters noisy documents before invoking the costly LLM, Sage. In tests, accuracy improves by up to 69.4 percentage points and Macro-F1 by...

#LLM On-Premise #DevOps #RAG
2026-09-26 โ€ข LocalLLaMA

KoboldCpp ships built-in local agent: 9 tools, small prompt, 12GB VRAM

KoboldCpp now includes an integrated agent harness, enabled with a checkbox or --agent flag. It offers nine built-in tools, a roughly 2,000-token system prompt, and aims to replace external tools like Opencode, Codex, and Claude Code. Minimums are 28...

#Hardware #LLM On-Premise #DevOps
โ† Back to All Topics