Open-source is becoming operational rather than rhetorical: Mesa NPU drivers, vendor support for llama.cpp, Linux kernel AI-patch policies, and public-sector migration targets move sovereign AI from headline to practice.
With North Micro Vision on llama.cpp and Transcribe in Unsloth, Cohere normalizes local inference and fine-tuning on private data. The move shifts TCO analysis: marginal cost of dedicated hardware can diverge from per-token API cost. VRAM and quantiz...
Cohere announced integration of the vision encoder of North Micro Vision Instruct into llama.cpp, making all its recent architectures compatible with the local runtime. Cohere Transcribe also arrives in Unsloth for fine-tuning. A concrete signal for ...
The bi-weekly r/LocalLLaMA thread asks creators to present open source, locally hostable projects and explain why they matter, how they compare, and how they were tested. More than a showcase, it signals a shift from model availability to software cr...
Intel software engineers have released LLM-Scaler-vLLM PV 1.5, a containerized Docker stack designed to simplify LLM inference on Intel Arc hardware. The release signals a software investment aimed at making Intel's discrete GPUs more competitive in ...
At Open Source Summit Europe, the focus was on GPUs and AI, but the most concrete part came from CRA compliance plans, OSPO metrics, and migration targets such as Berlin's 70 percent open source by 2032. Bureaucracy is becoming infrastructure.
Mesa extends support to NPUs and demonstrates YOLOX via PyTorch, moving accelerator access outside proprietary toolchains. For edge and on-premise, the open driver reduces lock-in and porting costs, changing the TCO calculation. AI-Radar reads the st...
Mesa's open-source driver stack extends NPU support: Tomeu Vizoso's work brings YOLOX via PyTorch to neural accelerators without proprietary SDKs. The structural signal is a shared driver that reduces lock-in, simplifies local deployment, and shifts ...
Linux kernel developers are considering removing the Assisted-By tag requirement for patches created with LLM assistance, citing the widespread use of AI. The change would ease contributor overhead but shift provenance verification to reviewers and o...
