New open-weight models such as Qwen 3.8, Meta Muse Glimmer, Nemotron-3.5 Lightning, Ling-3.0 and Luth-2 are being released or prepared for local inference, with GGUF, MLX and FP8 formats available quickly. The ecosystem is shifting toward self-hosted deployment on consumer and edge hardware.
A commit in the ms-swift framework exposes the string Qwen 3.8 35BA3B, with no announcement or specs. The name suggests a 35-billion-parameter model with a mixture-of-experts architecture, but the source confirms nothing. We analyze what it means for...
A Reddit megathread aggregated official links and quantized variants for the new Qwen 3.8 27B on release day. GGUF, MLX, and FP8 builds were already available, highlighting the maturity of local inference ecosystems and the shift toward deployment-ce...
Hugging Face shows an official countdown for Qwen/Qwen3.8-27B, suggesting a pre-release phase. The move signals a community-driven distribution strategy and gives on-premise teams a window to assess VRAM constraints, quantization, and TCO before avai...
The new Nemotron-3.5 Lightning 30B-A3B in BF16 arrives on Hugging Face. This move shifts the focus toward ultra-efficient MoE architectures, designed for those who run LLMs on their own hardware, cutting cloud dependency without sacrificing performan...
The new Luth-2-0.8B and 2B models set a new state of the art for French, outperforming models up to three times their size across language and math benchmarks. Light enough to run locally, they enable practical on-premise deployment and data sovereig...
InclusionAI releases Ling-3.0-tiny, an 8B-parameter MoE with just 1.3B active, reaching 100-105 tokens/s on DGX Spark and 86-90 on an M4 Pro MacBook, with a peak memory of 8.34 GiB at 8K context in FP8. Performance sits between 4B and 8-12B dense mod...
Meta releases Muse Glimmer, a 30-billion-parameter model optimized for on-device agentic workflows. ExecuTorch now supports inference on NVIDIA GPUs and Apple silicon Macs, integrating GGUF, k-quant, 128K+ token context, and DFlash speculative decodi...
The arrival of Muse-Glimmer-30B in GGUF format isn't just a model release. It signals a strengthening local inference infrastructure, shifting focus from cloud behemoths to on-premises GPU practicality and sovereign data pipelines.
Meta releases Muse Glimmer, a 30-billion-parameter LLM under Apache 2.0 license, optimized for local AI agents on consumer GPUs. Quantized to 4-bit, the model requires under 20 GB, targeting on-device tasks with personal data access. Benchmarks show ...
Meta releases Muse Glimmer, a 30B parameter model under Apache 2.0, optimized for always-on agentic workflows on consumer hardware. 4-bit quantization and speculative decoding allow it to fit within 24 GB GPUs, enabling local autonomous agents with m...
