Topic / Trend Rising

Qwen Open-Source Roadmap and Million-Token Context

Leaked repository entries and official statements point to Qwen 4 models with up to 1M token context and a possible 120B class, while Qwen confirms 4.0 and 5.0 will remain open source. This reshapes self-hosted LLM planning around VRAM, quantization, and API-free deployment.

Detected: 2026-11-04 ยท Updated: 2026-11-04

Related Coverage

2026-11-02 โ€ข LocalLLaMA

Qwen confirms: 4.0 and 5.0 models will remain open source

Qwen's head Liu Dayi Heng has denied rumors that future Qwen series would move to API-only releases: Qwen 4.0 and 5.0 will remain open source. With 3 billion downloads, over 460 models, and 300,000 derivatives, the decision strengthens a strategic ec...

#Hardware #LLM On-Premise #Fine-Tuning
2026-10-31 โ€ข LocalLLaMA

Qwen4 120B: The On-Premise Signal Behind a Pull Request

A detail in a pull request reignites the debate on a class of 120-billion-parameter LLMs. For teams managing self-hosted deployments, the size reshapes calculations around VRAM, quantization, and TCO, without official announcements. The signal points...

2026-10-30 โ€ข LocalLLaMA

Qwen4 and the 120B parameter signal: what it means for local inference

A pull request in the QwenLM/qwen-code repository has drawn attention to a possible 120-billion-parameter model. It is not an official announcement, but the 120B class touches a central issue for on-premise deployments: aggregated VRAM, quantization,...

#Hardware #LLM On-Premise #DevOps
2026-10-29 โ€ข LocalLLaMA

Qwen4, one-million-token context: the real test is VRAM

The pull request in qwen-code signals that Qwen4 targets a one-million-token window. For self-hosted inference the cost is not theoretical: the key-value cache grows with tokens and fills VRAM along with weights. Qwen4-27B makes multi-GPU setups or a...

2026-10-29 โ€ข LocalLLaMA

Qwen4 and the One-Million-Token Window: The Real Constraint Is VRAM

Alibaba brings Qwen4 to a one-million-token context window. The news emerges from a pull request in qwen-code: Qwen4-27B is expected tomorrow at the Apsara event in the Netherlands, while Qwen4-max is dated November 1st with October 1st as a likely p...

#Hardware #LLM On-Premise #Fine-Tuning
โ† Back to All Topics