Shortages and gray-market modifications are tightening the market for high-VRAM GPUs while AI accelerator roadmaps accelerate. Google, TSMC, Intel, and Chinese vendors are pushing TPU, ASIC, CoWoS, and local inference hardware forward.
New optimizations for single AMD Radeon R9700 cards double performance with Qwen3.8 27B in NVFP4 format: up to 153.1 tokens/s in decode, 3,619 tokens/s in prefill, and 471 aggregate tokens/s with eight concurrent requests. The updated vLLM MXFP4 repo...
Intel released Compute Runtime 26.35.39758.10 for Windows and Linux, updating OpenCL and Level Zero. The update enables LEO for Nova Lake and introduces the Intel Portable ISA (PISA). For self-hosted deployments, a stable ISA across silicon generatio...
Google is reportedly weighing CoWoS as a backup for 2027 TPUs because EMIB-T substrate yields are lagging expectations. The report highlights a bottleneck in advanced packaging, with potential effects on cloud capacity, costs and deployment strategie...
Google has outlined an expansion of its AI compute capacity and shortened the development cycle of its TPUs to six months. A pace that brings specialized hardware closer to software logic and strengthens the role of large cloud providers, while organ...
Google's TPU systems reaching one million chips shifts the limit from hardware to power. The analysis looks at consequences for data center design, TCO, and on-premise strategies, where energy constraints become as decisive as compute capacity. No ad...
The headline signals a shift: Chinese GPU vendors are no longer aiming only to match Nvidia’s H100 in single benchmarks. They are building scalable platforms where interconnects, software, and cluster-level throughput matter. For on-premise deploymen...
TSMC's 3nm and 2nm nodes and CoWoS packaging remain tight as AWS, MediaTek, and TPUs shift capacity volumes. For those evaluating on-premise AI hardware, scarcity of accelerators and interposers means longer lead times and cost pressure. Demand from ...
The GeForce RTX 5090 has vanished from U.S. retail channels, with third-party sellers asking up to $9,500. For teams building self-hosted LLM machines, the signal is clear: consumer channels no longer guarantee stable pricing, and the race for local ...
Nvidia's flagship GPU has disappeared from US online retailers, with third-party sellers asking up to $9,500. The scarcity signals tension between limited supply and demand that extends beyond gaming, affecting local AI hardware and self-hosted LLM d...
According to DIGITIMES, Google's TPU recoups its investment in about a year. The figure opens upside for MediaTek and Broadcom ASIC revenues and signals that custom silicon for training and inference is now a concrete economic option. The fast paybac...
On Friday Intel released Linux NPU Driver 1.38, adding official support for Ubuntu 26.04 LTS. The open-source user-space components work with the IVPU kernel driver to leverage the Core Ultra NPU, a concrete step for local AI inference on long-term s...
A 96 GB VRAM RTX 5090 sold on Alibaba for under $4,000 shows growing gray-market demand for affordable on-premise inference. The Chinese mod triples the standard card's memory, lowering the barrier for running larger models locally. But without warra...
