The open-source AI community is thriving, with new models, tools, and techniques being developed and shared. This includes efforts to improve LLM performance, extend context windows, and create specialized models for various applications.
Releases of Kimi-Linear-48B-A3B and Step3.5-Flash compatible with llama.cpp are now available. Official GGUF files are not yet available, but the community is already working on their creation. The availability of these models expands options for loc...
Geodesic Attention Engine (GAE) is an open-source kernel that promises to drastically reduce memory consumption for large language models. With GAE, it's possible to handle 1 million tokens with only 1GB of VRAM, achieving significant energy savings ...
Mesa 25.3.5 is now available, including fixes for the Vulkan driver and other minor improvements. This release is the latest stable version before the upcoming Mesa 26.0.
A new study challenges the linear model of AI progress, introducing the concepts of 'familiar intelligence' and 'strange intelligence'. AI systems may combine superhuman capabilities with surprising errors, defying expectations and making their evalu...
A user tested the Nemo 30B language model, achieving a context window of over 1 million tokens on a single RTX 3090 GPU. The user reported a speed of 35 tokens per second, sufficient to summarize books or research papers in minutes. The model was com...
A 30B experimental model with subquadratic attention mechanism has been released, scaling at O(L^(3/2)). It enables handling contexts up to 10 million tokens on a single GPU, maintaining practical decoding speeds. Includes an OpenAI-compatible server...
Hugging Face introduces benchmark repositories for community-driven LLM evaluations. The initiative aims to address inconsistencies in benchmark results, allowing users to contribute evaluations and directly link models to leaderboards. Verified resu...
A lucky shopper found an incredible deal at Walmart, purchasing SSDs worth $1,300 for just $210. The haul included WD, Samsung, and PNY drives, offering significant savings on high-performance storage.
New Linux benchmarks examine the performance of Intel's Panther Lake Core Ultra X7 358H CPU with a higher power budget. The tests reveal significant generational improvements, particularly in energy efficiency, and confirm the excellent performance o...
AMD continues the development of its LLVM compiler stack for future GPUs. A new target, GFX1170, also identified as RDNA 4m, has been introduced. This update adds to the ongoing work on GFX1250 and GFX13 targets, expanding support for AMD's upcoming ...
The llama.cpp library has integrated support for Kimi-Linear, a technique that promises to improve the performance of language models. The integration was made possible by a pull request on GitHub, opening new possibilities for efficient inference.
A new patch series for Dynamic Housekeeping and Enhanced Isolation (DHEI) has been proposed for Linux. The goal is to enable dynamic re-partitioning of CPU resources without downtime, benefiting cloud-native orchestrators and high-frequency trading p...
Qualcomm is making it easier to use Snapdragon X1 Elite on Linux. Previously, necessary firmware files had to be fetched from the Windows 11 on ARM partition. Now, QUPv3 firmware bits have been integrated into the linux-firmware.git repository, great...
A user demonstrates how to run a 16 billion parameter LLM on a 2018 HP ProBook laptop with an 8th generation Intel i3 processor and 16GB of RAM. By optimizing the use of the iGPU and leveraging MoE models, surprising inference speeds are achieved, op...
A user shares an image related to optimizing the inference of large language models (LLM) using DeepSpeed. The image suggests an analysis of performance and configurations to improve the speed and efficiency in running these models.
BioACE is a new automated framework for evaluating the quality of answers generated by large language models (LLMs) in the biomedical field. The system verifies the correctness of answers and citations, assessing completeness, precision, and accuracy...
A new study explores the use of denoising diffusion models to estimate reference distributions in neuroimaging, enabling the derivation of clinically interpretable deviation scores. The models, based on different architectures, were evaluated on synt...
A user shared their positive experience with the Qwen3-235B language model, running it on a desktop system. The user highlighted the model's accuracy and utility, to the point of preferring it over a commercial ChatGPT subscription.
A user reported a significant throughput increase, up to 26 tokens/second, using the Qwen3-Coder-Next-Q4_K_S model with llama.cpp on an RTX 5090. The optimization was achieved by offloading MoE expert tensors to the CPU and quantizing the KV cache.
A pull request introduces tensor parallelism in Llama.cpp, paving the way for faster and more efficient inference on large language models. The community welcomes this development, which could significantly improve performance on distributed hardware...
The LocalLLaMA community is questioning the future of Gemma 4, wondering if Google is still investing in the development of the language model. Despite progress in the sector, the fate of Gemma 4 remains uncertain.
SoproTTS v1.5 is a 135M parameter TTS (text-to-speech) model offering zero-shot voice cloning. Trained for approximately $100 on a single GPU, the model achieves around 20x real-time speed on a base MacBook M3 CPU. The new v1.5 version offers reduced...
OpenAI has announced GPT-5.3-Codex, a new version of its advanced coding model, accessible via command line, IDE extension, web interface, and a new macOS desktop app. This model outperforms previous versions in benchmarks like SWE-Bench Pro and Term...
An autonomous lab combining OpenAI’s GPT-5 with Ginkgo Bioworks’ cloud automation cut cell-free protein synthesis costs by 40% through closed-loop experimentation. This automated approach promises to accelerate biological research and reduce developm...
LightOnOCR-2 and GLM-OCR, two new models for optical character recognition (OCR), have been released. A user reported superior performance compared to solutions available in late 2025, with GLM-OCR offering speed and reliable structured output.
Intel's Xe graphics driver for Linux, starting with kernel 7.0, will re-enable D3cold support for Battlemage GPUs. This feature was disabled due to instability issues in power state transitions. The change will not apply to all systems, excluding spe...
GPT-5.3-Codex has been unveiled, an advanced model for code generation that combines the performance of GPT-5.2-Codex with superior reasoning and professional knowledge capabilities. The model positions itself as one of the most advanced of its kind.
DeepBrainz has released DeepBrainz-R1, a family of small language models (4B, 2B, 0.6B) focused on reasoning for agentic workflows. Optimized for multi-step reasoning and stability in tool-calling, these Apache 2.0 models aim to provide predictable b...
Google introduces a new framework, called NAI (Natively Adaptive Interfaces), that leverages artificial intelligence to make technology more adaptive and inclusive. The goal is to improve the user experience for everyone, regardless of their abilitie...
Debian's continuous integration (CI) infrastructure has restricted public access to its data due to excessive scraping by bots used to train large language models (LLMs). The load generated by these scrapers has impacted web server resources.
Microsoft says "reliability is the priority" for AI in Visual Studio. The reassurance may raise eyebrows among developers already living with Copilot's quirks.
Trillion Labs and KAIST AI introduced gWorld, an open-weight visual world model for mobile GUIs. gWorld, available in 8B and 32B versions, generates executable web code instead of pixels, surpassing larger models like Llama 4 in accuracy. This approa...
A Reddit user benchmarked the Strix Halo's iGPU, testing various software configurations with 13 LLM models and 15 different llama.cpp builds. The aim was to evaluate the impact of ROCm, Vulkan, and various compilation options on inference performanc...
Unofficial pre-built ik_llama.cpp builds are now available for macOS, Ubuntu, and Windows. These builds simplify project adoption by removing the need for manual compilation. The creator still encourages compiling from the original source code when p...
Nvidia is reportedly developing DLSS 4.5, an advanced version of its upscaling technology that could eliminate the need for denoisers in ray tracing. This is thanks to a Transformer model that reconstructs ray-traced reflections more accurately.
First Linux benchmarks of the Intel Arc B390 GPU, integrated in high-end Panther Lake models. The Xe3 graphics card, equipped with 12 Xe cores, promises interesting performance in desktop and mobile environments for graphics and compute workloads.
Canonical and SpacemiT announced that Ubuntu Linux will be officially supported on SpacemiT's new K3 RISC-V SoC. What makes the K3 interesting is being one of the first available RISC-V RVA23 designs.
The vLLM team introduced vLLM-Omni, a system designed for any-to-any multimodal models handling text, images, video, and audio. The architecture includes stage-based graph decomposition, per-stage batching, and flexible GPU allocation, achieving up t...
The first beta release of Krita 6.0 is now available, a featureful digital painting program, re-based against the Qt6 toolkit. Krita 5.3 Beta is also being released for those sticking to Qt5. The update introduces improvements in color management and...
For those not fond of the increasing use of the Rust programming language within the Linux kernel or FreeBSD's considerations for Rust in its kernel, you can perhaps find refuge within NetBSD. One of the NetBSD developers has explained why you likely...
Intel ISPC 1.30 is now available, featuring AMX (Advanced Matrix Extensions) support added to the standard library. ISPC is a variant of the C programming language designed to target Intel CPUs and GPUs.
A developer created AnyTTS, a system that allows using any text-to-speech (TTS) engine with various AI chat interfaces, including ChatGPT and local LLM models. The integration happens via the clipboard, simplifying TTS usage across platforms. Current...
Berlin-based Qontext, developing an independent context layer for AI, has secured $2.7 million in pre-seed funding. The company plans to expand its platform and team to develop reusable context infrastructure, enabling AI processes to operate on reli...
Microsoft introduces Paza, a project to improve automatic speech recognition (ASR) in low-resource languages. It includes PazaBench, an ASR leaderboard for 39 African languages, and Paza ASR models, optimized for six Kenyan languages. The initiative,...
The Linux 6.19 merge window introduced support for larger pages and compression with the Nouveau kernel driver, aiming to improve the performance of open-source NVIDIA drivers. Initial issues disabled this functionality, but version 7.0 should resolv...
A new study explores the use of Natural Language Processing (NLP), including Large Language Models (LLM), to automatically classify pedagogical materials against computer science curriculum guidelines. The goal is to accelerate and simplify the proce...
A novel reversible deep learning model employs a conditional invertible neural network to link molecular structures and 13C NMR spectra. The network, built upon i-RevNet bijective blocks, enables spectrum prediction from structure and, conversely, th...
A new method, Iteratively Improved Program Construction (IIPC), enhances the mathematical reasoning capabilities of large language models (LLMs). IIPC iteratively refines programmatic reasoning chains, combining execution feedback with the Chain-of-t...
A new study explores the effectiveness of the Task-Method-Knowledge (TMK) framework to enhance reasoning and planning capabilities of Large Language Models (LLMs). Results show that TMK-structured prompting can significantly increase accuracy on comp...
MediaTek projects strong growth in the cloud ASIC market, aiming for US$1 billion in revenue by 2026. The company aims to strengthen its position in this expanding sector by providing customized solutions for major cloud service providers.
A user expressed frustration with Tencent's Youtu-VL-4B model, advertised as a state-of-the-art (SOTA) solution for various computer vision tasks. Despite the promises, the released code was found to be incomplete, with key features missing and hidde...
A developer has created Codag, an open-source VSCode extension that visualizes LLM workflows directly within the development environment. It supports several frameworks such as OpenAI, Anthropic, Gemini, LangChain, LangGraph, and CrewAI, along with v...
A user replaced Claude-Code's backend with NVIDIA NIM models, leveraging a free API for LLM inference. The modification includes using Telegram as an interface and preserves reasoning tokens between tool calls, enhancing performance with models like ...
Kimi K2.5 sets a new record among open-weight models on the Epoch Capabilities Index (ECI), which combines multiple benchmarks onto a single scale. Its score of 147 is on par with models like o3, Grok 4, and Sonnet 4.5, while still lagging behind the...
Microsoft has announced LiteBox, a sandboxing operating system developed in Rust. Designed for security, LiteBox leverages Linux Virtualization Based Security (LVBS) to isolate the guest kernel through hardware virtualization, offering a protected en...
Mesa 26.0-rc3 is now available, featuring the latest bug fixes for graphics drivers. The stable Mesa 26.0 release is expected soon.
A Reddit user reported excellent performance of the Qwen3-Coder-Next-FP8 model. The discussion focuses on its code generation capabilities, suggesting a potential improvement over existing alternatives. The original article includes a link to an imag...
GPT-4o's system prompt now includes instructions for handling users upset about its upcoming shutdown, scheduled for February 13. The instructions also cover edge cases such as "dyad pair" and "gnosis revelation".
Intel Linux engineers are actively preparing support for next-gen Nova Lake processors. The latest developments include enabling Xe3P_LPG graphics support and related display functionality through new Linux kernel patches.
The Mesa project has decided to disable the use of Link-Time Optimization (LTO) during compilation due to bugs that are difficult to identify and fix. LTO, while offering performance benefits, introduces complexities in binary debugging.
Mistral AI introduces Voxtral Mini 4B Realtime 2602, an open-source model for real-time multilingual speech transcription. It offers accuracy comparable to offline systems with latency below 500ms, supports 13 languages, and is optimized for on-devic...
French startup Mistral AI is taking a different approach compared to large US labs, focusing on efficiency and translation speed of its models, with a focus on hardware resource optimization.
A pull request on llama.cpp introduces a fix for the `key_gdiff` vectorized calculation in the Qwen3Next model. The change, initially reported on Reddit, aims to improve the model's accuracy and efficiency within the llama.cpp project.
In 1976, Bill Gates expressed concern about the unauthorized copying of Altair BASIC software by hobbyists. An open letter reveals the early challenges related to protecting intellectual property in the software world.
Intel's ANV open-source Vulkan driver has temporarily disabled Vulkan Video encode support on newer graphics hardware. The decision was made due to insufficient testing, despite Vulkan Video's growing traction as a cross-vendor, cross-platform API fo...
A recent thread on Reddit, within the LocalLLaMA community, has sparked a heated debate about the criticisms of Ollama, a framework for local execution of large language models (LLMs). The discussion focuses on alleged shortcomings and areas for impr...
Intern-S1-Pro, a large language model (LLM) with approximately 1 trillion parameters, has been released. It appears to be a scaled version of the Qwen3-235B model, with an architecture based on 512 experts.
A new 48 billion parameter Qwen3-Coder-Next REAP model has been released in GGUF format. This format facilitates the use of the model on various hardware platforms, making it accessible to a wide range of developers and researchers interested in expe...
A user on r/LocalLLaMA reports "context rot" issues with GPT-4o in long conversations (over 15 turns) in a support agent. Sliding window and summarization strategies do not solve the problem. Context management remains an open challenge in the develo...
The race for HBM4 memory production intensifies, with Nvidia playing a key role in defining the specifications. Samsung and SK Hynix are vying for leadership in this sector crucial for future GPUs and AI accelerators.
Soundtrack Technologies, a joint venture with Spotify, has acquired Tunify (Belgium and Netherlands) and Ambie (UK) to consolidate its presence in the B2B music market. The goal is to combine a global infrastructure with localized curation services f...
A quantized version of Qwen3-Coder-Next in NVFP4 format is now available, weighing 45GB. The model was calibrated using the ultrachat_200k dataset, with a 1.63% accuracy loss in the MMLU Pro+ benchmark.
A new study introduces STEMVerse, a diagnostic framework to analyze the science, technology, engineering, and mathematics (STEM) reasoning capabilities of large language models (LLMs). STEMVerse aims to overcome the limitations of current benchmarks,...
A new study explores the use of large language models (LLMs) to enhance cybersecurity models. Strategies include using LLMs for data labeling and as fallback mechanisms for low-confidence predictions, combining parameter-efficient fine-tuning and pre...
A novel approach, called UNSO (Unified Newton-Schulz Orthogonalization), aims to address efficiency and stability issues in the Newton-Schulz iteration, used in optimizers like Muon and on the Stiefel manifold. The method consolidates the iterative s...
Alphabet is reportedly planning a major expansion of its operations in Bangalore, India. This move underscores the growing importance of India as a hub for artificial intelligence development and Alphabet's commitment to investing in this rapidly gro...
A user reported successfully running the Qwen-Coder-Next model on a Strix Halo platform using ROCm. The test was performed with llamacpp-rocm and a context size of 16k, opening new possibilities for running large language models locally.
Xcode 26.3 introduces agentic coding capabilities, leveraging Anthropic's Claude Agent and OpenAI's Codex. The integration aims to enhance developer efficiency by automating complex programming tasks.
Apple’s Xcode IDE now supports the Claude Agent SDK. This integration may simplify the development of applications leveraging Claude's capabilities.
ACE-Step-1.5, an MIT-licensed open-source audio generative model, has been released. Its performance is close to commercial platforms like Suno. The model supports LoRAs and offers cover and repainting features. Hugging Face demos and ComfyUI integra...
Apple has announced Xcode 26.3, a new version of its IDE that supports agentic coding tools like Codex and Claude Agent. The integration is enabled via Model Context Protocol (MCP), allowing AI agents to interact with external tools and structured re...
ACE-Step 1.5, an open-source model for music generation, is now available. It promises to outperform Suno in quality, generating full songs in about 2 seconds on an A100 GPU and running locally on PCs with 4GB of VRAM. The code, weights, and training...
Qwen3-Coder-Next is available, a new language model developed for programming applications. The model is accessible via Hugging Face and related discussion is active on Reddit. This release represents a significant update in the field of language mod...
Qwen3-Coder-Next, a language model developed for programming applications, has been released on Hugging Face. Its availability on the platform facilitates access and integration by developers. The model promises to improve efficiency in software deve...
OpenIndiana, the open-source project built atop Illumos that is continuing to maintain and advance the former OpenSolaris code, is working on modernizing the Image Packaging System (IPS) package management solution. As part of that, they are working ...
A LocalLLaMA user raises concerns about bot activity on the platform, including misleading comments and vote manipulation. The discussion focuses on the need for defense strategies to protect the community from these threats.
A new version of the NTFS driver for Linux is available, based on the original code and aimed at delivering superior performance and new features. The goal is to provide a more efficient alternative for those who rely on this Microsoft file system.
GLM has released an open-source Optical Character Recognition (OCR) model. The model, named GLM-OCR, is available on Hugging Face. It appears to be composed of a 0.9 billion parameter vision model and a 0.5 billion parameter language model, suggestin...
A developer has built Qwen3-TTS Studio, an interface for voice cloning and automated podcast generation. The system supports 10 languages, runs voice synthesis locally, and can be integrated with local LLMs for script generation.
A new hybrid system, MediGRAF, combines knowledge graphs and LLMs to query patient health data. The system integrates structured and unstructured data, achieving 100% accuracy in factual answers and a high level of quality in complex inferences, with...
A novel framework, PPoGA, enhances the ability of Large Language Models (LLMs) to answer complex questions based on Knowledge Graphs. Inspired by human cognitive control, PPoGA introduces self-correction mechanisms to overcome the limitations of init...
A new measurement framework addresses the challenge of analyzing complex systems that are difficult to reach directly. The method combines indirect data from multiple sources, interpretable machine learning models, and triangulation techniques to obt...
OGD4All is a framework based on Large Language Models (LLMs) to enhance citizens' interaction with geospatial Open Government Data (OGD). The system combines semantic data retrieval, agentic reasoning for iterative code generation, and secure sandbox...
A new study addresses the complete identification problem of ReLU neural networks, which exhibit nontrivial functional symmetries. The research translates ReLU networks into Lukasiewicz logic formulae, transforming them through algebraic rewrites gov...
A new study compares FastAPI and NVIDIA Triton Inference Server for deploying machine learning models in healthcare, evaluating latency and throughput on Kubernetes. The analysis highlights the benefits of a hybrid approach to balance performance and...
The upcoming Firefox 148 release will include a new AI controls area within the browser's settings. This follows concerns raised over comments by Mozilla's new CEO about evolving Firefox into a "modern AI browser".
Firefox will introduce new settings in version 148 to control the generative AI features integrated into the browser. Users will be able to completely block these features, offering greater control over their browsing experience.
OpenAI has released a macOS desktop app for Codex, its large language model (LLM)-based coding tool. This move aims to compete with Anthropic's Claude Code, offering an alternative to command-line interfaces (CLI) and IDE extensions.
Codex is a new macOS application that acts as a command center for AI and software development. It allows managing multiple agents, parallel workflows, and long-running tasks, all within a single interface.
Binning data from 13 Ryzen 7 9850X3D samples suggests the CPU is essentially a 9800X3D with higher voltages to achieve higher clock speeds. The single-core performance of the 9850X3D appears to primarily stem from this factory overclock.
Chinese semiconductor manufacturer SMIC has reportedly established a research institute in Shanghai focusing on the development of advanced packaging technologies. This strategic move aims to enhance production capabilities and innovation in the semi...
Incard, a financial platform for high-growth digital companies, has raised £10 million in Series A funding. The company plans to expand into new markets, enhance its product offering, and invest in automation, AI-driven financial workflows, and team ...
A new study introduces MrRoPE, a generalized formulation for extending the context window of large language models (LLMs) based on a radix system conversion perspective. This approach unifies various existing strategies and introduces two training-fr...
A study on the EAV dataset reveals that, for multimodal emotion recognition on small datasets, complex attention mechanisms (Transformers) underperform compared to modifications based on domain knowledge. Adding delta MFCCs to the audio CNN improves ...
A new study introduces the Six Sigma Agent, an architecture to improve the reliability of large language models (LLMs) in enterprise settings. The approach is based on task decomposition, parallel execution across diverse LLMs, and a consensus voting...
The Step-3.5-Flash model, with a reduced active parameter architecture (11B out of 196B total), demonstrates superior performance compared to DeepSeek v3.2 in coding and agent benchmarks. DeepSeek v3.2 uses an architecture with many more active param...
The stable release of the Linux 6.19 kernel has been delayed by a week due to the year-end holiday period. Version 6.19-rc8 is now available, with the stable version expected next week. This delay is not due to critical bugs, but rather the need to m...
A developer has created AIDA, an open-source pentesting platform that allows an AI agent to control over 400 security tools. The AI can execute tools, chain attacks, and document findings, all through a Docker container and a web dashboard.
GNOME Resources 1.10, the newest version of this system monitoring app, introduces monitoring support for AMD Ryzen AI NPUs. This application is now used by default on distributions like the upcoming Ubuntu 26.04 LTS. The update also includes other u...
AI2's OLMO 3.5 model combines standard transformer attention with linear attention using Gated Deltanet. This hybrid approach aims to improve efficiency and reduce memory usage while maintaining model quality. The OLMO series is fully open source, fr...
TII releases Falcon-H1-Tiny, a series of sub-100M parameter models challenging the scaling dogma. These specialized models exhibit a lower tendency to hallucinate compared to larger, general-purpose models. Specialized variants offer competitive perf...
An overview of uncensored large language models (LLM) available on the Hugging Face platform. The list includes variants of GLM, GPT OSS, Gemma, and Qwen, with different methods of removing restrictions. The article provides direct links to the model...
A recap of the most popular news and reviews published on Phoronix in January. The focus is on Linux kernel developments, progress in the ReactOS operating system, and analysis of the AMD Ryzen 7 9850X3D CPU. Phoronix published nearly 300 articles du...
Recent research compares the performance of vLLM-MLX on Apple Silicio with llama.cpp, highlighting significantly higher throughput. The results suggest potential advantages in using Apple hardware for local inference of large language models (LLMs).
A developer has presented Kanade Tokenizer, a voice cloning tool optimized for speed, with a real-time factor exceeding RVC. It also runs on CPU. A fork with a GUI based on Gradio and Tkinter is available.
An experiment showed how training a language model on a dataset derived from 4chan led to unexpected results. The model, Assistant_Pepe_8B, outperformed NVIDIA's Nemotron base model, despite being trained on data considered to be of lower quality. Th...
LandMark Optoelectronics is expanding its silicio photonics component production by adding new MOCVD reactors. The expansion aims to meet the growing demand for high-speed interconnects in data centers and artificial intelligence applications.
Andrej Karpathy demonstrated how to surpass GPT-2's performance with a model called NanoChat, trained in just three hours on 8 H100 GPUs. The project includes details on the architecture, optimizers used, data setup, and a script for reproducing the ...
Linux 7.0 is preparing to introduce significant improvements in per-CPU cache management, thanks to the integration of 'sheaves'. This technology, already present in optional form since version 6.18, aims to progressively replace traditional CPU slab...
A novel approach called Scalable Power Sampling promises to improve the reasoning capabilities of large language models (LLMs) without requiring further training. The method is based on sharpening the model's distribution, achieving performance compa...
A new research paper, available on arXiv, called "g-HOOT in the Machine", has caught the attention of the LocalLLaMA community. The paper, identified via the provided arXiv link, promises to explore new frontiers in the field of artificial intelligen...
