A Reddit post sheds light on a grey area of the hardware market that directly affects those deploying Large Language Models on-premise. A small US-based lab active in producing custom GPUs with expanded memory has bluntly stated that GeForce RTX 4090 and 5090 cards modded with 96 GB of VRAM «are literally a scam.» The verdict is clear: as of June 2026, these cards do not exist, and those offering them are merely exploiting the AI community’s hunger for VRAM.

The lab, which works with two Chinese factories specialized in modifying consumer GPUs, has so far only received and verified cards with 48 GB for the 4090 and 32 GB for the 4080 Super. The 96 GB frontier remains pure speculation. The problem is far from theoretical: many organizations evaluating self-hosted LLM infrastructure look with interest at modded GeForce cards as a cheaper alternative to A100 or H100 workstations, but the allure of memory quadrupled compared to standard models (which offer 24 GB) can become a trap.

The scam scheme

Offers for 96 GB 4090 and 5090 cards circulate on forums, Asian marketplaces, and some Telegram channels, often with attractive prices and vague delivery times. According to the lab’s administrator (known as /u/computune), these are ads built on nothing: no working sample has ever been shown or independently tested. Anyone who pays for these orders never receives the card and loses their money. At a time when demand for inference VRAM is skyrocketing, the scam finds fertile ground.

Why the temptation is so strong

Building an on-prem inference server with consumer GPUs allows total control over the Total Cost of Ownership and keeps data within one’s borders, a crucial aspect for digital sovereignty. A hypothetical 96 GB RTX 4090 would enable loading 70-billion-parameter models at FP16 without splitting the workload across multiple cards, simplifying deployment and reducing latency. It would be a game changer. Precisely this potential, combined with the chronic scarcity of VRAM in the consumer segment, makes otherwise fraudulent announcements appear credible.

The broader picture for on-prem hardware choices

This episode confirms an unwritten but recognized rule in the field: third-party modifications of consumer GPUs face precise physical and validation limits. 48 GB on the AD102 architecture requires double-density memory modules and PCB interventions that cannot scale indefinitely without undermining stability. Meanwhile, professional variants such as L40S or RTX 6000 Ada offer high capacities but at a cost prohibitive for many independent labs. From a risk-analysis perspective, anyone investing in custom accelerators must ask not just whether the product exists, but whether it has a verifiable supply chain.

The industry’s suggested approach

The lab’s message is more than a warning: it’s an invitation to share information and demand public benchmarks before any purchase. For organizations looking to evaluate the risks and benefits of self-hosting LLMs, AI-RADAR provides analytical tools at /llm-onpremise to compare trade-offs between modded consumer GPUs, enterprise solutions, and private cloud. Diversifying sources and independent verification remain the only defenses in a market where desperation for VRAM collides with opaque business operations.

The lesson of June 2026 is clear: the promised 96 GB remain a mirage. The only custom card currently field-verified is the 48 GB 4090. Anyone serious about bringing inference on-premise would do well not to chase chimeras.