Projects now train 1B LLMs for around $200, while tools such as Unsloth Desktop reduce local training VRAM and compact MoE models like Ling-3.0-tiny, Luth-2, and Nemotron-3.5 Lightning become viable on consumer hardware.
Unsloth Desktop is the first open-source app for running and training LLMs locally. It spans Windows, macOS, Linux and supports NVIDIA, AMD, Intel, and Mac hardware. It claims 2× faster training, 70% less VRAM, private search, RAG, MCP, and an OpenAI...
The new Nemotron-3.5 Lightning 30B-A3B in BF16 arrives on Hugging Face. This move shifts the focus toward ultra-efficient MoE architectures, designed for those who run LLMs on their own hardware, cutting cloud dependency without sacrificing performan...
The new Luth-2-0.8B and 2B models set a new state of the art for French, outperforming models up to three times their size across language and math benchmarks. Light enough to run locally, they enable practical on-premise deployment and data sovereig...
An experiment shows that for $200 on rented GPUs you can train a 1.1B parameter LLM and deploy it on CPU or even a smartwatch. The negligible cost rewrites the TCO calculus for organizations evaluating self-hosted solutions: data sovereignty becomes ...
A personal project demonstrates how to train a 1.1-billion-parameter LLM from scratch on 20 billion tokens for around $200. The model, fine-tuned with LoRA and quantized, runs on CPU and even on a WearOS watch. Concrete evidence that data sovereignty...
InclusionAI releases Ling-3.0-tiny, an 8B-parameter MoE with just 1.3B active, reaching 100-105 tokens/s on DGX Spark and 86-90 on an M4 Pro MacBook, with a peak memory of 8.34 GiB at 8K context in FP8. Performance sits between 4B and 8-12B dense mod...
