Small task-specific models for TTS, wake-word detection, speech, DNA, 3D generation, and semantic search make local and CPU-only AI practical. These models challenge the assumption that production AI requires large hosted APIs.
An independent project has shared an early 4-billion-parameter model for coding and 3D scene generation, fine-tuned from Qwen3.5-4B. GGUF checkpoints Q4_K_M and Q8_0 are available on Hugging Face while training continues. The author plans to update t...
An experiment with a GGUF Q4 LLM in WebGL2 breaks on tokenization, not linear algebra. The advice to clone llama.cpp signals that in local and self-hosted deployments the differential lies not in the engine but in integration with data and processes....
A developer on Reddit describes an attempt to build a browser-based LLM inference engine using WebGL2 and GLSL, running a GGUF model in Q4 quantization. Tokenization becomes an endless debug hell. The advice: clone llama.cpp. AI-RADAR examines what t...
IBM Research has released ClariEdge, a dataset of about 3,900 examples for recognizing ambiguous queries in RAG systems and generating clarification requests. A lightweight LoRA reaches 96.6% classification accuracy and beats prompted baselines from ...
Hugging Face has released a new open-source model designed to treat DNA as a language. The goal is to help researchers understand how genetic changes affect gene activity and health. The news highlights a convergence between LLMs and computational bi...
Kitten-TTS 2 brings 1.58-bit ternary quantization to a 1.7 billion parameter model that runs in real time on CPU. Self-hosting becomes realistic without GPUs, shifting TCO from VRAM to software execution quality. For organizations under data sovereig...
A 305-million-parameter speech encoder, frozen or augmented with low-rank adapters, takes on Saudi and Gulf Arabic speech recognition. The frozen system is statistically comparable to Cohere Transcribe Arabic on CER and 3.4 times faster on CPU; the a...
KittenML has released code and weights for Kitten-TTS 2, a TTS model with 1.58-bit ternary quantization and 1.7 billion parameters. It runs in real time on CPU, performs zero-shot voice cloning from under five seconds of audio, supports more than 20 ...
An Apache-2.0 open source project offers an on-device voice front-end for local assistants: five models for text-based wake word, voiceprint, voice separation and personal VAD. The Rust engine runs in the browser, Python and Android; models take 7.5 ...
A local test with EmbeddingGemma2 shows semantic image search on a consumer GPU, indexing 3,003 screenshots in 510 seconds with a 330 MB Q8 model and 768-dimensional vectors. But retrieval quality depends heavily on query wording and corpus character...
