Saturated benchmarks and multilingual failures are pushing researchers toward deeper evaluation signals, while new training methods aim to reproduce reasoning without explicit chain-of-thought. This reflects a search for more robust AI measurement and reasoning.
When several models reach near-perfect scores, benchmarks lose their ability to differentiate them. A study shows that full task transcripts from saturated benchmarks retain predictive information. Pairwise judging reduced prediction error by 5.3 tim...
A zero-shot benchmark of eight LLMs shows that summarization quality does not transfer from English to Bengali. GPT-5.6 Luna leads several English lexical metrics, but LLaMA 3.3 70B achieves the best Bengali ROUGE and BLEU scores; Gemini 2.5 Flash po...
Researchers use an inverse LLM to reconstruct reasoning traces from answers alone. Trained once, the model generates intermediate steps offline for prompt-answer data, avoiding the multiple rollouts of reinforcement learning. On Qwen3-0.6B, a single ...
A new test uses Levin's Kt and language models as representational machines to generate items whose difficulty is measurable in bits, before any human or frontier model can solve them. Twelve LLMs were evaluated on a first certified battery, showing ...
