Topic / Trend Stable

LLM Evaluation, Behavioral Limits and Domain Science

Benchmarks and studies reveal persistent gaps in LLM reasoning and self-description, while domain-specific models advance in chemistry, medicine and physical systems.

Detected: 2026-09-25 ยท Updated: 2026-09-25

Related Coverage

2026-09-25 โ€ข ArXiv cs.CL

Safety, ad hominem, and local control: the real cost of tamed LLMs

Safety fine-tuning is not neutral: it narrows the strategic space of LLMs in real debates. For on-premise deployments, control over weights, pipelines, and TCO becomes the real variable. AI-Radar's analysis focuses on the trade-off between ready-to-u...

2026-09-25 โ€ข ArXiv cs.CL

Ad hominem attacks: why safety fine-tuning holds LLMs back

A benchmark on political dialogues shows that LLMs prioritise logical defences and fail to exploit ethotic counterattacks in ad hominem exchanges. The study attributes this limit to safety fine-tuning, which narrows the strategic action space. For te...

#Hardware #LLM On-Premise #Fine-Tuning
2026-09-24 โ€ข ArXiv cs.CL

Where LLMs Disagree: Targeting Expert Effort to Speed Codebook Revision

A study on thousands of tutoring-session transcripts shows that using disagreement among multiple LLMs to target expert attention shortens codebook revision from months to days. Among three methods, Rationale Labeling reaches 64.9% accuracy against 5...

#Hardware #LLM On-Premise #DevOps
2026-09-23 โ€ข Tech.eu

DiffuseDrive fills the data gaps holding back physical AI

Hungarian startup DiffuseDrive generates synthetic data to train physical AI systems in defence, mining, aerospace and autonomous vehicles. Its platform identifies missing edge cases in datasets, produces them with control over object position and si...

#Hardware #LLM On-Premise #Fine-Tuning
2026-09-23 โ€ข ArXiv cs.AI

A Framework Learns 3D Cell Properties from 2D Images and Population Statistics

A population-supervised framework links 2D red-cell images to latent biophysical quantities, aggregating them into mean corpuscular volume, red-cell distribution width, and mean corpuscular haemoglobin. It combines shared local inference, a structure...

#LLM On-Premise #Fine-Tuning #DevOps
2026-09-23 โ€ข ArXiv cs.AI

Didactic Data or Clinical Cases: What Really Shapes Medical LLMs

A token-matched study shows didactic and clinical data shape medical large language models asymmetrically: clinical data improves clinic-oriented tasks while remaining competitive on knowledge-intensive ones, whereas didactic data mainly boosts theor...

#Hardware #LLM On-Premise #Fine-Tuning
2026-09-22 โ€ข TechCrunch AI

AstroForge puts a small transformer in command of its next spacecraft

AstroForge will give its next Autonomy-1 space probe a small transformer-based model responsible for onboard decisions. Local inference becomes unavoidable without connectivity and under severe physical constraints. The shift from deterministic softw...

#Hardware #LLM On-Premise #DevOps
2026-09-21 โ€ข Microsoft Research

RetroChimera: open-source retrosynthesis between Transformer and templates

Microsoft Research publishes in Nature a framework combining a Transformer model and a graph neural network. Learned ranking reduces unconstrained proposals and outperforms previous models in tests with chemists. Code and weights are open source.

#Hardware #LLM On-Premise #Fine-Tuning
2026-09-18 โ€ข LocalLLaMA

Bonsai's 98.2% Claim Clashes With the Whitepaper Benchmarks

Bonsai's own documents show Ternary Bonsai 2 27B scoring 52.8 on Terminal-Bench 2.1 and 60.8 on SWE-bench Verified, roughly three quarters of the full-precision model used as comparison. Yet the competitor name appears wrong, and the 98.2% retained-c...

#Hardware #LLM On-Premise #DevOps
โ† Back to All Topics