Consumer GPUs are becoming scarce, expensive or counterfeit while AI demand pushes vendors toward enterprise and professional accelerators. Intel, AMD, Biren and newcomer Bolt Graphics are all repositioning around inference hardware.
Bolt Graphics is seeking $100 million to develop Zeus, a GPU aimed at competing with Nvidia and AMD beyond AI workloads. The source includes no technical specifications, but the move signals an attempt to build a third hardware pole. Success will dep...
A real-world test shows affinity handles four Radeon AI PRO R9700 cards without degenerate output. The 2.875 bpw quant keeps 11,008 experts in VRAM, reaching 79 tok/s greedy decoding with no host pool allocated. The earlier bug was an artifact of sim...
The RTX 5060 Ti 16 GB reaches $1,292 in Japan with increases up to 144%; the RTX 5080 passes $2,400. More than a gaming issue, it signals VRAM demand contested by local LLM inference. Final prices challenge the TCO of self-hosted nodes and push a rev...
A 24-billion-parameter LLM tested on an AMD W7900 with a 128,000-token context and sustained speed around 95 tokens per second signals that on-premise inference is maturing beyond NVIDIA's ecosystem. AI-Radar explores trade-offs, data sovereignty, an...
A user reported a positive experience with LiquidAI's LFM2.5-24-A2B model (24B parameters), highlighting high performance (~95 tps) on an AMD W7900 GPU. The model, requiring 30GB of VRAM for Q8 quantization with a 128k token context, proves reliable ...
Intel has turned Crescent Island into a commercial lineup: the D-Series. The D270 card combines 32 Xe3P cores, 256 XMX engines, up to 480 GB of LPDDR5X and 1.5 TB/s of bandwidth. Rated performance reaches 1.3 PetaFLOPS FP8, with support from FP4 to F...
Intel has announced the GPU D Series, the successor to products known as Crescent Island and aimed at enterprise inference. The announcement lacks VRAM or performance details, but the renaming signals a more direct positioning in the market for on-pr...
Intel has named its Crescent Island data center inference card D-Series and revealed D270 specs: 1.3 PFLOPS dense FP8 and 1.5 TB/s memory bandwidth. A signal for on-prem LLM serving economics.
A Reddit rumor points to an RTX 5080 with 24 GB in Q1 2027, but board partners still lack details. For local LLM inference, VRAM is the key constraint. The information vacuum slows integrators and self-hosted system builders, while cloud vendors rema...
A buyer paid $350 for a broken RTX 4090, only for a technician to find a fake GPU die and swapped memory. The scam, documented by a Russian repair specialist, uses sophisticated dummy PCBs. For anyone building on-premise LLM infrastructure, the episo...
Biren Technology is targeting the BR20X GPU for AI systems up to 1,024 chips, according to Yicai. US restrictions, however, are slowing mass production for the cloud. The analysis explains why this scale jump is not just a hardware challenge: it affe...
Counterfeit RTX 4090s that are almost indistinguishable from genuine parts during visual inspection and initial software tests are turning consumer GPU purchases for on-premise LLM inference into a structural risk. The damage goes beyond replacement ...
Reports point to new counterfeit RTX 4090 cards with GPUs and memory nearly indistinguishable from original chips. For teams building self-hosted LLM infrastructure, uncertified hardware introduces uncertainty around performance, stability, and TCO. ...
According to reports, Nvidia has suspended production of the GeForce RTX 5090 to focus capacity on AI data center and professional GPUs. The move signals a clear industrial priority: accelerated computing margins outweigh gaming margins. For self-hos...
According to an unconfirmed report, NVIDIA may stop the GeForce RTX 5090 and allocate GB202 chips to the RTX PRO series. If true, the shift would reshape the self-hosted GPU market, affecting high-VRAM options for local LLM inference and pushing team...
