New desktop tools and training approaches make small LLM training and fine-tuning feasible on commodity hardware and very small budgets. Experiments show that 1B-scale models can be trained for around $200 and fine-tuned with surgical MoE routing.
Unsloth Desktop is the first open-source app for running and training LLMs locally. It spans Windows, macOS, Linux and supports NVIDIA, AMD, Intel, and Mac hardware. It claims 2× faster training, 70% less VRAM, private search, RAG, MCP, and an OpenAI...
An experiment shows that for $200 on rented GPUs you can train a 1.1B parameter LLM and deploy it on CPU or even a smartwatch. The negligible cost rewrites the TCO calculus for organizations evaluating self-hosted solutions: data sovereignty becomes ...
A personal project demonstrates how to train a 1.1-billion-parameter LLM from scratch on 20 billion tokens for around $200. The model, fine-tuned with LoRA and quantized, runs on CPU and even on a WearOS watch. Concrete evidence that data sovereignty...
A new approach called TEXAS exploits how mixture-of-experts models activate their sub-models to steer fine-tuning, focusing supervision only on relevant tokens. For those running LLMs on-premises, this means more efficient adaptation on proprietary d...
Pathway introduces BDH, a post-transformer architecture matching GPT-2 scaling from 10 million to 1 billion parameters while training on ordinary GPUs. A signal for those seeking self-hosted LLMs without extreme hardware constraints.
