From local speech pipelines and document parsing to Rust‑based GPU drivers and compositors optimized for AI workloads, both chipmakers are investing heavily in the software ecosystem that brings advanced AI capabilities directly onto user‑owned hardware.
FastFlowLM 1.0, the open-source software for running language and multimodal models on Ryzen AI NPUs, officially joins the ROCm ecosystem. The move signals AMD’s intent to deliver a unified stack for local inference, from discrete GPUs to integrated ...
The Nova DRM driver, successor to Nouveau, gets new features for Linux 7.3 kernel. Written in Rust, it aims to provide open-source support for NVIDIA GPUs. We analyze what it means for on-premise AI and self-hosted stacks.
Starting with release 45, Fedora's container-optimized OS will handle memory pressure automatically via systemd-oomd and zRAM-backed swap. A move that speaks directly to those running LLM workloads on constrained hardware.
The Israeli startup closes a Series A+ round to expand its edge AI platform from grocery retail to fast food, logistics, and industry. The goal: turn existing hardware into an intelligent network that learns locally, without sending raw data to the c...
AMD releases Spur, a Rust-based ROCm component for scheduling GPU workloads across clusters of thousands of units. A signal that the open-source AI computing ecosystem is maturing.
The analysis examines how the release of NVIDIA's speech stack (ASR, TTS, codec) optimized for local execution via GGUF and NeMo-Speech.cpp redefines TCO calculation, data sovereignty, and on-premise architectures. The shift from cloud to device alte...
The company aims to embed GPUs directly into next-generation radio access networks. Edge computing proves to be the battleground for data sovereignty and distributed inference, with Beijing setting the rules.
NVIDIA has released speech synthesis, recognition and compression models in GGUF format, runnable locally via NeMo-Speech.cpp. This move enables on-premise voice pipelines, cutting cloud dependency and bolstering audio data control.
NVIDIA updates its document parsing model with expanded multilingual support and the ability to extract structured data from charts and tables. This makes fully on-premises handling of sensitive documents more practical, reducing reliance on cloud AP...
The New York startup sets up a 40-person London hub, targeting European companies. With AI inference at its core, the expansion signals a growing demand for local infrastructure to run models in production, driven by latency requirements and data sov...
Denial embeds Flutter directly into a Rust-based Wayland compositor, cutting latency, memory footprint and software layers. For on-premise workloads pairing self-hosted LLMs on edge devices, this co-location is more than an engineering curiosity – it...
Denial is a new Wayland compositor that directly embeds the Flutter engine into its codebase. Written in Rust and leveraging Smithay, it targets optimal Arch Linux integration. The architecture cuts overhead and boosts responsiveness, hinting at a po...
AMD has released a new set of updates for its AMDGPU DC display drivers on Linux, introducing fixes for HDMI FRL support and the implementation of HDMI 2.1. These developments, aimed at the open-source driver, also include an option to disable DCE di...
