The demand for robust AI infrastructure is driving innovation in GPU technology, data center networking, and heterogeneous computing. Discussions around VRAM constraints for large context windows and the market for used AI supercomputers highlight the intense resource requirements.
An open-source USB tool removes the software limit that cuts AI performance of Nvidia GPUs on Windows to half speed. The news reopens the debate on artificial segmentation of consumer hardware and on the choices of those evaluating on-prem deployment...
A Mac M4 Max test with a Qwen3.8 27B model and 164k tokens of context shows cache and KV can cost as much as weights. The old 64GB rule no longer holds.
As first production units ship, NVIDIA revises some specifications for its Rubin GPU platforms. The timing signals a shift from validation to supply and forces AI infrastructure planners to reassess integration, power, and cooling assumptions.
PsiQuantum has built an 8x8 optical switch prototype for AI data center GPU networks. The company draws on its photonics expertise and reports lower light loss than rival solutions, with plans to develop larger devices. The project highlights the gro...
The first Loom SDK v0.1 from AMD marks the start of the Hyperloom roadmap announced at Advancing AI, aiming to optimize agentic workloads across CPUs, GPUs and NPUs. For local deployment, the signal is twofold: AMD wants to unify the ROCm ecosystem, ...
The pull request in qwen-code signals that Qwen4 targets a one-million-token window. For self-hosted inference the cost is not theoretical: the key-value cache grows with tokens and fills VRAM along with weights. Qwen4-27B makes multi-GPU setups or a...
Alibaba brings Qwen4 to a one-million-token context window. The news emerges from a pull request in qwen-code: Qwen4-27B is expected tomorrow at the Apsara event in the Netherlands, while Qwen4-max is dated November 1st with October 1st as a likely p...
An IT vendor has listed a used AI supercomputer on eBay for $60 million: 9,600 Nvidia A100 GPUs, 4,200 AMD EPYC CPUs and 300 decommissioned racks, with free shipping. The listing highlights how AI hardware life cycles are feeding a secondary market r...
