Llama.cpp adopts OpenAI API

The open-source community has welcomed the integration of OpenAI Responses API support into Llama.cpp. This implementation aims to make the use of language models easier, paving the way for new applications and integrations.

One user reported successfully testing the integration with Unsloth/GLM-4.7-Flash in Llama.cpp (ROCm) and Codex CLI, highlighting its effectiveness in exploring large codebases. Although more complex feature implementations have yet to be thoroughly tested, the initial results appear promising.

Llama.cpp is a C++ library designed for large language model inference. Its popularity stems from its ability to run these models on a wide range of hardware, including devices with limited resources. Adding support for the OpenAI API could further expand its accessibility and versatility.