🏷️ Hardware

LLM DeepSeek V4.1 Flash on Hugging Face: self-hosting back in the spotlight 2026-10-17

LLM NVIDIA and the 4B BF16 Model: The Specific Weight of Local Inference 2026-10-17

Hardware ORL pushes diffusion LLMs to 2,788 tokens/s on a single RTX 5090 2026-10-16

LLM Reflection's Beam: Token-Efficient Reasoning, 501B Memory Footprint 2026-10-16

LLM Hybrid Reasoning Agents: Hidden Thinking Cuts Token Use and Reshapes Inference Economics 2026-10-16

LLM Tencent Hy-Memory-30B-A3B: Why 3B Active Parameters Matter More Than 30B Total 2026-10-16

LLM Qwen Flash Next: a solo Q2 quant challenges ISTA Lab 2026-10-16

Frameworks Intel Ships LLM-Scaler-vLLM PV 1.5: Docker Stack for LLMs on Arc GPUs 2026-10-16

Hardware Open source sovereignty: the boring work of making it real 2026-10-16

Hardware Bolt Graphics seeks $100 million to challenge Nvidia and AMD with the Zeus GPU 2026-10-16

Frameworks PRISM: privileged information for multi-agent topology design 2026-10-16

Frameworks DeepUnfolding Agent: Adaptive Control Becomes an External Service 2026-10-16

Hardware DeepSeek-V4-Flash on 4x Radeon AI PRO R9700: the 79 tok/s configuration that finally works 2026-10-16

LLM Meta Opens Weights for Muse Spark Open: 816B Parameters and a 1M Token Context 2026-10-15

LLM Nemotron 3.5 Bolt: A 74B VLM Compressed to 24GB for On-Premise 2026-10-15

Market RTX 5060 Ti hits $1,292 in Japan: GPU Black Friday is already a test 2026-10-15

Hardware GNOME Mutter Improves Damage Tracking for Secondary GPU Copy Buffers 2026-10-15

LLM Microsoft's local 137B-parameter MoE model and the on-premise coding push 2026-10-15

LLM Mr.Chatterbox-2.7B-Chat: an LLM trained from scratch on Victorian texts 2026-10-15

LLM Bengali shatters English LLM benchmark certainties 2026-10-15

LLM Inverse Models Turn Answer-Only Data Into Reasoning Distillation 2026-10-15

LLM LiquidAI LFM2.5-24-A2B: Robust Performance on AMD W7900 for On-Premise LLMs 2026-10-15

LLM Ling-3.1-flash: 560B Parameters, 25B Active, and a 1M-Token Context Window 2026-10-14

LLM NVIDIA Nemotron Bolt 3.5 74B: 24GB MoE via 2-bit quantization 2026-10-14

Altro Skeleton Technologies surpasses $1B valuation with Siemens backing for US AI power expansion 2026-10-14

LLM China's open-weight models trail US closed models by 7 months, and data transparency matters more 2026-10-14

Altro Apple researchers turn idle Macs into a virtual GPU cloud with ‘Minions’ 2026-10-14

LLM 51 offline labs to learn AI from neurons to agents 2026-10-14

Frameworks Mesa Expands NPU Support: YOLOX and PyTorch Join the Open Driver Stack 2026-10-14

Hardware A jailbroken PS5 runs Qwen 27B at 20 tokens/s: a signal for self-hosting 2026-10-13

LLM LiquidAI LFM2.5-24B-A2B: 24B parameters, 2B active for on-device 2026-10-13

Hardware Reverse engineering CUDA: the ironic challenge from an AMD user 2026-10-13

Hardware Intel's Crescent Island Becomes D-Series with Up to 480 GB LPDDR5X 2026-10-12

Hardware From Crescent Island to D Series: Intel Targets Enterprise Inference 2026-10-12

Altro In 2030 a home GPU cluster will be seen like a gun for home defense 2026-10-12

Hardware Intel D-Series D270 Targets Inference with FP8 and 1.5 TB/s 2026-10-12

LLM MiniCPM-V 4.7: the first open-source MoE with smooth on-device inference 2026-10-12

LLM Boole-1.7B: 1-bit quantization becomes a concrete on-premise option 2026-10-12

Frameworks ROCm 10 versus Rusticl on AMD Strix Halo: the open-source driver battle for local compute 2026-10-12

Hardware RTX 5080 24GB rumored for Q1 2027, board partners still waiting 2026-10-12

Hardware A 'broken' RTX 4090 for $350 hides a fake GPU and swapped memory 2026-10-12

Hardware Biren's BR20X targets 1,024-chip AI systems, but US curbs cloud mass production 2026-10-12

LLM AutoIndexer: When Models Rewrite Their Own Output Like in a Text Editor 2026-10-12

LLM AIQ, when LLM compression changes its mathematical base 2026-10-12

Altro OpenMed 3.0: On-Premise Clinical AI Securing Healthcare Data Sovereignty 2026-10-12

LLM What Actually Runs on 10-16GB VRAM: A Field Ranking of Local LLMs 2026-10-11

LLM AesCode 8B and 32B: Microsoft bets on code for generative graphics 2026-10-11

Hardware A GPU in the 'wrong' place? Hotspot 19 degrees cooler 2026-10-11

Hardware Counterfeit RTX 4090 cards hit the market: the hidden risk for on-premise LLM inference 2026-10-11

Hardware Nvidia reportedly halts GeForce RTX 5090 production to prioritize AI data center GPUs 2026-10-10

Hardware NVIDIA may discontinue RTX 5090 to prioritize GB202 for RTX PRO series 2026-10-10

Altro KNOD advances in-kernel GPU offloading for packet processing on AMD GPUs 2026-10-10

LLM Vega, an open-source 800M parameter decision model with 73k token context 2026-10-10

LLM Open-source GLM 5.3 Flash tops Artificial Analysis Cyber Index over Claude 2026-10-09

LLM Qwen-Image-2.1-Turbo: eight denoising steps and open weights 2026-10-09

Altro Qwen-Image-2.1-Turbo on Hugging Face: what it means for self-hosting 2026-10-09

Altro Nvidia defends open-source AI security alliance as hundreds of companies await vetting 2026-10-09

Frameworks Boro: NVIDIA's Open-Source Bet on Local AI for Linux Kernel Development 2026-10-09

Altro Diffu-LoRA: Fine-Tuning That Allocates Parameters Where Needed 2026-10-09

LLM Freezing the Decoder, Healing the Encoder: The Shared Learning Rate Trap 2026-10-09