Topic / Trend Rising

Compact and Specialized Domain Models

A wave of compact and specialized models targets edge devices, domain-specific tasks and lean subagents: vision-language on smartphones, 3D asset generation, web-search subagents and verbosity reduction. The focus is on specialized capability per watt or parameter rather than on raw scale.

Detected: 2026-11-10 ยท Updated: 2026-11-10

Related Coverage

2026-11-07 โ€ข LocalLLaMA

Obsessive-1.7B: a 1.1 GB subagent for verifiable answers

A fine-tuned LFM3-1.7B acts as a web-search subagent that returns a value, quote, and URL, or "Not found". Trained with LoRA on an RTX 4060 laptop, it cuts invented answers in fixed benchmarks but trades raw live accuracy for reliable replies. Its lo...

#LLM On-Premise #Fine-Tuning #DevOps
2026-11-06 โ€ข LocalLLaMA

Mirage: a 22 MB vision model that gives text-only LLMs visual skills on device

Cactus Compute has released Mirage, a 22 MB visual-language model with 51.3 million parameters aimed at phones, wearables, and robots. On a Samsung Galaxy S26 it runs in 74 ms on the NPU and 107 ms on the CPU, covering scene description, object detec...

#Hardware #LLM On-Premise #Fine-Tuning
2026-11-06 โ€ข LocalLLaMA

Oc-e-Non-v1: the LLM that halves response length

A lightweight project shows how to cut verbosity in a local LLM. Oc-e-Non-v1, derived from Qwen3-4B-Instruct-2507, reduces average response length by 50% and bakes concise behavior into the model rather than relying only on prompting. That matters fo...

#Hardware #LLM On-Premise #DevOps
2026-11-06 โ€ข LocalLLaMA

CCORE GLB-3D-Coder: an open dataset for 3D assets with a 4B LLM

The author of CCORE GLB-3D-Coder has released the dataset used to train the 4-billion-parameter model: 3,918 validated and rendered examples across 40 domains, with reasoning traces, HTML/JavaScript responses, and an MIT license. A base for fine-tuni...

#Hardware #LLM On-Premise #Fine-Tuning
2026-11-05 โ€ข LocalLLaMA

CCORE GLB-3D-Coder 4B: The Self-Hosted Worksite for 3D Assets

The final release of CCORE GLB-3D-Coder 4B signals a concrete path for generating 3D assets locally: a 4B LLM fine-tuned to produce Three.js code exportable as GLB. GGUF weights and the expected dataset open self-hosted scenarios, with data sovereign...

2026-11-05 โ€ข LocalLLaMA

CCORE GLB-3D-Coder 4B brings self-hosted 3D asset generation to a 4B model

The final version of CCORE GLB-3D-Coder 4B, a full fine-tune of Qwen3.5-4B, is now available with Safetensors weights and GGUF files. It generates Three.js scenes exportable as GLB for Godot, Blender, and Unity. A concrete signal for self-hosted 3D a...

#Hardware #LLM On-Premise #Fine-Tuning
2026-11-04 โ€ข ArXiv cs.CL

Memento: Context Management Turns a Qwen3-8B into a Long-Context Contender

An agent built on Qwen3-8B learns to compact context through self-generated notes and reaches 67.8% accuracy on book question-answering benchmarks with books up to 2.5 million tokens, never holding more than 20K tokens. It beats a GPT-5.5 agent and n...

#Hardware #LLM On-Premise #Fine-Tuning
โ† Back to All Topics