Llama.cpp catches up: local benchmarks on RTX 5080 show a turning point
A hobbyist compared llama.cpp over time with his own inference engine on an RTX 5080 16GB. Within a few months llama.cpp went from being slower to surpassing the custom alternative, while keeping efficient VRAM usage. The story signals a maturation o...