Missing model cards, undocumented GGUF repositories, disappearing weights, and contested benchmarks are creating reliability risks for self-hosted AI. Calls for stricter validation and transparent release practices are growing.
A user reports models disappearing from Hugging Face, highlighting an often overlooked risk for self-hosted deployments: the model supply chain is revocable. The names of the vanished models - uncensored, offensive cyber, abliterated - point to likel...
SkillEval introduces an evaluation framework based on skill profiles automatically discovered by LLMs and estimated with cognitive diagnosis models. Tested on 3,811 models and 9,523 items, it produces more calibrated and predictive profiles. Applicat...
A Hugging Face repository called RecursiveSI/flint, followed by the string 40B A2.5B, revives the issue of transparency around open models. With no model card or numerical precision details, the name becomes a battleground for those calculating on-pr...
Irene Solaiman, Hugging Face's chief policy officer, has warned that model benchmarking methods are complex and still maturing. Embedded evaluators are not a shortcut. For anyone choosing an LLM, evaluation is a governance issue, not just a technical...
The bi-weekly r/LocalLLaMA thread asks creators to present open source, locally hostable projects and explain why they matter, how they compare, and how they were tested. More than a showcase, it signals a shift from model availability to software cr...
A GGUF repository with no notes on Hugging Face shifts verification costs to deployers. AI-Radar analyzes quantization, context, VRAM, and provenance, showing why missing documentation blocks self-hosted pipelines, TCO calculation, and sovereignty.
A repository named unsloth/DeepSeek-V4.1-Flash-1017-GGUF has appeared on Hugging Face without any official document or announcement from the Unsloth team. The lack of technical notes leaves open questions about quantization, context window, and VRAM ...
