The AI hardware build-out is hitting physical limits: soaring GPU prices, power quality for clusters, new GPU challengers, and even theft of high-end cards. Local and data center inference both face constraints in VRAM, power, and supply chain security.
A Reddit post reports the disappearance of two pallets of ZOTAC RTX 5090 cards, worth $470,000, from a Brazilian airport. The episode shows how the physical GPU supply chain has become a critical link for self-hosted inference planners: VRAM and memo...
Bolt Graphics is seeking $100 million to develop Zeus, a GPU aimed at competing with Nvidia and AMD beyond AI workloads. The source includes no technical specifications, but the move signals an attempt to build a third hardware pole. Success will dep...
The RTX 5060 Ti 16 GB reaches $1,292 in Japan with increases up to 144%; the RTX 5080 passes $2,400. More than a gaming issue, it signals VRAM demand contested by local LLM inference. Final prices challenge the TCO of self-hosted nodes and push a rev...
A change in the GNOME 52 compositor reduces unnecessary buffer copies between GPUs on hybrid laptops. Less wasted bandwidth and battery, with an indirect benefit for users running local inference on the discrete GPU.
Siemens invests in Skeleton, pushing its valuation above $1 billion. The goal: US manufacturing expansion and R&D in Silicon Valley for power systems that remove harmonics and rapid fluctuations in AI GPU clusters, delivering up to 40% energy savings...
