TomasuLLM: Out-of-Order Speculative Execution for LLM Agents
A runtime executes LLM agent tool calls out of trajectory order but commits only after validation. Speedups up to 1.35x on benchmarks with slow tools, zero false accepts across 4,010 records. A structural shift for self-hosted deployments focused on ...