AI-RADAR.it
AI-RADAR.IT
News & analysis on local LLMs, stack & on-prem hardware.

AI-Radar - Local LLMs, AI Hardware and Trends Observatory

AI-Radar for on-prem LLMs & Home AI

The daily radar on models, frameworks, and hardware to run AI locally. LLMs, LangChain, Chroma, mini-PCs, and everything you need for a distributed "in-house" brain.

⚙️ Stack: Local LLMs · LangChain · Transformers · ChromaDB · MiniPCs · AI boxes
🛰️ Ask Observatory (Q&A + RAG) connected to the article archive.
👥 160+ members · Join free →
📡

The Daily Signal

Qwen4 120B: The On-Premise Signal Behind a Pull Request

Qwen4 120B: The On-Premise Signal Behind a Pull Request

A detail in a pull request reignites the debate on a class of 120-billion-parameter LLMs. For teams managing self-hosted deployments, the size reshape...

📡 AI Signal 2026-10-31

⚡ Trending Now

View All →
Open-weight debate and community trust AI in science, medicine and academic... AI-generated code and supply-chain security Efficient inference, quantization...

🛠️ Guides & On-Premise Observatory

🚀 Run models locally → All guides →

Evergreen, hands-on references for running AI locally — hardware, cost, privacy and the full stack.

🖥️ LLM On-Premise Observatory Hardware, stack, governance and reference architectures for local AI. →
⚡ Best GPUs for Local LLM 📊 VRAM for Llama 70B 🧮 KV-cache & Context Memory 💰 Cost of Running LLMs Locally 🏎️ vLLM vs llama.cpp vs SGLang 🧩 Ollama vs LM Studio 🔒 Private ChatGPT for Business 📉 LLM Quantization Explained 🇮🇹 On-Prem LLMs for Italian SMBs ⌨️ Local Coding Assistant (VS Code) 💬 Build a Private RAG Chatbot 🚀 Run models locally (Qwen, Llama, R1…)

Latest Analysis & Radar News

AI-generated articles from feeds, with space for human editorial layer above the raw content.

Qwen4 120B: il segnale on-premise dietro una pull request
📁 OnPremise AI generated ℹ️ LocalLLaMA

Qwen4 120B: The On-Premise Signal Behind a Pull Request

A detail in a pull request reignites the debate on a class of 120-billion-parameter LLMs. For teams managing self-hosted deployments, the size reshapes calculations around VRAM, quantization, and TCO, without official announcements. The signal points to stratification of open models and new pressure on hardware and compliance.

2026-10-31 📰 Source
LRMoE ricalibra il carico di addestramento MoE sui nodi con memoria limitata
📁 Frameworks AI generated 🏆 ArXiv cs.AI

LRMoE Recalibrates MoE Training Load on Memory-Limited Nodes

A Mixture-of-Experts training system cuts cumulative MoE-layer training time by 21.2 to 44.8 percent against SYMI by reducing memory demand in backpropagation and rebalancing retained work. LRMoE plans expert placement and retention quotas, selects the token-expert pairs that matter for updates, and compacts communication, making memory-constrained nodes more efficient.

2026-10-31 📰 Source
Dartmouth, il rettore anti-imbrogli IA si dimette: Claude usato senza dichiararlo
📁 Altro AI generated ✅ Ars Technica AI

Dartmouth provost who warned about AI cheating resigns after undisclosed Claude use

Dartmouth provost Santiago Schnell wrote a Washington Post op-ed against AI cheating, then resigned after a committee found he failed to disclose AI use in an academic paper and the op-ed. He handed over his institutional laptop but not personal LLM logs, and wouldn't meet investigators. The Claude enterprise account showed revision, debugging, and figure work.

2026-10-30 📰 Source
Dissenso su LocalLLaMA: benchmark, bias e modelli open-weight
📁 LLM AI generated ℹ️ LocalLLaMA

Dissent in LocalLLaMA: benchmarks, bias, and open-weight models

A Reddit thread challenges the convictions of the self-hosted community: inflated open-weight rankings, skepticism toward Haiku 5.5, the misunderstood Strata project, and the uselessness of the ThreeJS benchmark. For those evaluating on-premise deployments, this dissent is a signal: metrics must be contextualized against VRAM, quantization, and real workloads.

2026-10-30 📰 Source
DFlash2 per Qwen3.8-Flash-Next ora gira su llama.cpp: +17% in media
📁 LLM AI generated ℹ️ LocalLLaMA

DFlash2 for Qwen3.8-Flash-Next lands on llama.cpp: 17% faster on average

llama.cpp v0.8.0 adds compatibility with DFlash2 for Qwen3.8-Flash-Next. Tests on Apple Silicon M5 Max with quantized GGUFs show an average 17% decoding throughput gain over MTP, with peaks of 39% on list-like prompts and a minor prose regression. The Q4_0 draft head is about 350MB versus 2.2GB for the MTP head, but the compute buffer offsets the VRAM savings. Vision prompts work too.

2026-10-30 📰 Source
Il primo satellite data center di Google è online e scrive poesie
📁 Hardware AI generated ✅ TechCrunch AI

Google’s first data center satellite is online and writing poetry

Google has brought online its first data center satellite, carrying the first TPU in space and running a Google DeepMind Gemma 4 model that writes cheesy poetry. The experiment shows LLM inference can operate in a remote, constrained, self-contained environment. For teams evaluating on-premise or edge deployments, it is an extreme case that stresses hardware and pipelines without cloud dependence.

2026-10-30 📰 Source
Qwen4 e il segnale del modello da 120B: cosa cambia per chi fa inference locale
📁 LLM AI generated ℹ️ LocalLLaMA

Qwen4 and the 120B parameter signal: what it means for local inference

A pull request in the QwenLM/qwen-code repository has drawn attention to a possible 120-billion-parameter model. It is not an official announcement, but the 120B class touches a central issue for on-premise deployments: aggregated VRAM, quantization, and TCO. We analyze the signals and implications.

2026-10-30 📰 Source
SenseNova-Loop-9B: il decoder che gira due volte per contesti lunghi
📁 LLM AI generated ℹ️ LocalLLaMA

SenseNova-Loop-9B: a decoder that runs twice for long contexts

SenseNova brings to Hugging Face a multimodal LLM with reused decoder blocks and hybrid attention. With 24 layers run twice and 56 executions from 32 distinct layers, it targets agentic workloads and documents up to 256K tokens. The approach reduces parameters but not compute, a signal for those validating self-hosted infrastructure.

2026-10-30 📰 Source
PsiQuantum porta la fotonica nelle reti GPU: switch ottico 8x8 con meno perdite
📁 Hardware AI generated ℹ️ Tom's Hardware

PsiQuantum brings photonics to GPU networks: 8x8 optical switch with lower losses

PsiQuantum has built an 8x8 optical switch prototype for AI data center GPU networks. The company draws on its photonics expertise and reports lower light loss than rival solutions, with plans to develop larger devices. The project highlights the growing role of optical interconnects in easing bottlenecks between accelerators.

2026-10-30 📰 Source
Un altro OS generato dall'AI: chiuso in nome della sicurezza
📁 Altro AI generated ✅ Phoronix

Another AI-generated OS, closed in the name of security

A new operating system generated almost entirely by AI agents has reached the newsroom. Unlike most of these projects, which are open-source, this one is closed in the name of security. The story fuels debate over auditability, code provenance, and trust in critical components produced by LLMs: for those evaluating on-premise deployments, closure shifts the burden of proof.

2026-10-30 📰 Source
Estensione Claude Code di Anthropic compromessa: backdoor SSH persistente dal Cursor Marketplace
📁 OnPremise AI generated ℹ️ LocalLLaMA

Official Claude Code Extension on Cursor Marketplace Compromised with Persistent SSH Backdoor

Researchers have reported that the official Anthropic Claude Code extension on Cursor Marketplace was compromised to install a persistent SSH backdoor on infected hosts. The risk is especially relevant for developers using Claude Code as a local LLM harness in VS Code. The issue shifts attention from model security to software supply chain risk in local AI tooling.

2026-10-30 📰 Source
Nvidia e Hugging Face: il vero collo di bottiglia diventa la distribuzione
📁 OnPremise AI generated ℹ️ Tom's Hardware

Nvidia and Hugging Face: The Real Bottleneck Becomes Distribution

The reported Department of Justice probe into Nvidia's possible acquisition of Hugging Face signals a shift in control from hardware to model distribution. For teams running self-hosted LLMs, what is at stake is the neutrality of repositories, frameworks, and fine-tuning practices, with consequences for interoperability, TCO, and data sovereignty.

2026-10-30 📰 Source
DoJ indaga su Nvidia per l'acquisizione da 13 miliardi di Hugging Face
📁 Market AI generated ℹ️ Tom's Hardware

DoJ Reportedly Probes Nvidia Over $13B Hugging Face Acquisition

The US Department of Justice has reportedly opened an inquiry into Nvidia's roughly $13 billion acquisition of Hugging Face, with concerns focused on competition in AI and pressure on customers. A tie-up between the leading GPU vendor and the main hub for open models would raise questions about neutrality and lock-in for organizations running self-hosted inference and fine-tuning.

2026-10-29 📰 Source
Il deposito IPO di Anthropic svela: il grosso del calcolo serve la ricerca, non i clienti
📁 Market AI generated ℹ️ Tom's Hardware

Anthropic’s IPO filing shows most of its compute goes to R&D, not serving customers — $800B in TPU/GPU contracts

Anthropic's IPO filing reveals that the majority of its compute capacity is absorbed by research and development rather than serving customers. The company also disclosed contracts worth $800 billion for TPUs and GPUs. This highlights the capital intensity of frontier AI and has implications for inference economics, supplier concentration, and self-hosted deployment trade-offs.

2026-10-29 📰 Source
AMD rilascia Loom SDK 0.1 per ROCm: CPU, GPU e NPU nello stesso stack
📁 Frameworks AI generated ✅ Phoronix

AMD Releases ROCm HRX Loom v0.1, Targeting CPUs, GPUs and NPUs

The first Loom SDK v0.1 from AMD marks the start of the Hyperloom roadmap announced at Advancing AI, aiming to optimize agentic workloads across CPUs, GPUs and NPUs. For local deployment, the signal is twofold: AMD wants to unify the ROCm ecosystem, but the release remains early.

2026-10-29 📰 Source
LIMe riduce del 15% il calcolo per addestrare LLM senza cali di qualità
📁 LLM AI generated ℹ️ LocalLLaMA

LIMe Cuts LLM Training Compute by 15% Without Sacrificing Quality

At EMNLP 2026, T-Tech researchers presented LIMe, an attention extension that reuses key-value buffers from earlier layers. In tests with models around one billion parameters, training reached the same loss as the LLaMA baseline using 15% less compute, with gains in multi-step reasoning and arithmetic tasks.

2026-10-29 📰 Source
Nvidia finisce sotto esame negli USA per l'acquisizione di Hugging Face
📁 Market AI generated ✅ DigiTimes

Nvidia under US scrutiny over Hugging Face acquisition

The deal that brings Nvidia to acquire Hugging Face is under scrutiny by US justice officials. For those working with on-premise LLMs, the news hits a sensitive point: joint control of hardware and model repositories can reshape local deployment dynamics.

2026-10-29 📰 Source
Qwen4 e il contesto da un milione di token: il conto si paga in VRAM
📁 OnPremise AI generated ℹ️ LocalLLaMA

Qwen4, one-million-token context: the real test is VRAM

The pull request in qwen-code signals that Qwen4 targets a one-million-token window. For self-hosted inference the cost is not theoretical: the key-value cache grows with tokens and fills VRAM along with weights. Qwen4-27B makes multi-GPU setups or aggressive quantization likely. The benefit for repository analysis is real, but it changes TCO, benchmarks, and the gap between data center and edge.

2026-10-29 📰 Source
Qwen4 e il contesto da un milione di token: il vero nodo è la VRAM
📁 LLM AI generated ℹ️ LocalLLaMA

Qwen4 and the One-Million-Token Window: The Real Constraint Is VRAM

Alibaba brings Qwen4 to a one-million-token context window. The news emerges from a pull request in qwen-code: Qwen4-27B is expected tomorrow at the Apsara event in the Netherlands, while Qwen4-max is dated November 1st with October 1st as a likely placeholder. The analysis focuses on VRAM costs for local deployment and the consequences for TCO and fine-tuning pipelines.

2026-10-29 📰 Source
Su eBay un supercomputer AI da 60 milioni: 9.600 GPU A100 e spedizione inclusa
📁 Hardware AI generated ℹ️ LocalLLaMA

A $60 million AI supercomputer on eBay: 9,600 Nvidia A100 GPUs and free shipping

An IT vendor has listed a used AI supercomputer on eBay for $60 million: 9,600 Nvidia A100 GPUs, 4,200 AMD EPYC CPUs and 300 decommissioned racks, with free shipping. The listing highlights how AI hardware life cycles are feeding a secondary market relevant to on-premise deployments, with potential savings and operational risks.

2026-10-28 📰 Source
LFM3: meno token, più decisioni, l'inference locale cambia unità di misura
📁 OnPremise AI generated ℹ️ LocalLLaMA

LFM3: fewer tokens, more decisions — local inference changes its unit of measure

Liquid AI has introduced LFM3, a family of compact models from 1.7–2.2 billion parameters with a tri-hybrid architecture and llama.cpp support. The decision models skip token generation and return calibrated answers in a single forward pass. For on-premise and self-hosted deployments, the focus shifts from per-token costs to latency, footprint, and data control.

2026-10-28 📰 Source
Nanbeige4.3-33B: il docente che prepara i modelli compatti
📁 OnPremise AI generated ℹ️ LocalLLaMA

Nanbeige4.3-33B: the teacher shaping compact models

Nanbeige4.3-33B is not just a benchmark: it is a teacher for a distillation pipeline. For self-hosted inference, the signal is clear: cost shifts from deployment to distillation. The 3B can run on modest hardware, but the teacher requires resources. Data sovereignty depends on the ability to distill on-premise.

2026-10-26 📰 Source
DeepSeek-V4.1 GSQ-RCO: quantization pronta, runtime in ritardo
📁 OnPremise AI generated ℹ️ LocalLLaMA

DeepSeek-V4.1 GSQ-RCO: quantization ready, runtime lagging

ISTA-DASLab's release of GGUF quantized weights for DeepSeek-V4.1-Flash-1017 is not just a quantization milestone. It exposes the real bottleneck in local deployment: runtime integration. With llama.cpp still lacking official support and references pointing to forks like Xolotl or Maya, on-premise adopters must weigh compatibility, TCO, and maintenance. Having the files is not enough: a runtime must actually execute them.

2026-10-25 📰 Source
WebGL2 e LLM nel browser: il debito nascosto della tokenizzazione
📁 OnPremise AI generated ℹ️ LocalLLaMA

WebGL2 and in-browser LLMs: the hidden tokenization debt

An experiment with a GGUF Q4 LLM in WebGL2 breaks on tokenization, not linear algebra. The advice to clone llama.cpp signals that in local and self-hosted deployments the differential lies not in the engine but in integration with data and processes. The browser is a real frontier for sovereignty, but requires mature runtimes and a TCO perspective.

2026-10-24 📰 Source
RAG modulare: un LoRA che decide quando fermarsi e chiedere
📁 OnPremise AI generated 🏆 ArXiv cs.AI

Modular RAG: a LoRA that decides when to stop and ask

IBM Research releases ClariEdge, a dataset of about 3,900 examples for spotting ambiguous queries in RAG. A lightweight LoRA obtained through fine-tuning reaches 96.6% accuracy and outperforms larger baselines. The signal: specialized local components can filter before and after retrieval, reducing data exposure and token consumption. Costs remain in curating hard negatives and monitoring out-of-distribution behavior.

2026-10-23 📰 Source
Ternario e solo CPU: il TTS locale ridisegna il TCO
📁 OnPremise AI generated ℹ️ LocalLLaMA

Ternary and CPU-only: local TTS redraws the TCO map

Kitten-TTS 2 brings 1.58-bit ternary quantization to a 1.7 billion parameter model that runs in real time on CPU. Self-hosting becomes realistic without GPUs, shifting TCO from VRAM to software execution quality. For organizations under data sovereignty constraints, the entire voice pipeline can stay local. The signal: aggressive compression becomes a practical architectural choice.

2026-10-22 📰 Source
Cohere porta North su llama.cpp: il self-hosting entra nella strategia
📁 OnPremise AI generated ℹ️ LocalLLaMA

Cohere brings North to llama.cpp: self-hosting enters the strategy

With North Micro Vision on llama.cpp and Transcribe in Unsloth, Cohere normalizes local inference and fine-tuning on private data. The move shifts TCO analysis: marginal cost of dedicated hardware can diverge from per-token API cost. VRAM and quantization levels remain unclear, but for Cohere models self-hosting is no longer a fallback.

2026-10-20 📰 Source
Una Radeon da 16 GB esegue un LLM da 27B con 262k token: il segnale
📁 OnPremise AI generated ℹ️ LocalLLaMA

A 16 GB Radeon runs a 27B LLM with 262k tokens: the signal

A homelab, not a vendor, documented a 27-billion-parameter LLM with 262,000 tokens of context on a single Radeon RX 9060 XT with 16 GB of VRAM, using quantization, KV cache streaming, and software fixes. The signal: the entry cost for high-context self-hosted LLMs shifts from GPU count to managing the memory-precision-throughput trade-off. The hidden cost remains integration and support.

2026-10-18 📰 Source
Il 4B BF16 di NVIDIA e il conto della VRAM nell'inference locale
📁 OnPremise AI generated ℹ️ LocalLLaMA

NVIDIA's 4B BF16 and the VRAM bill in local inference

The release of Dory1.0-4B-BF16 shows how BF16 precision redefines local deployment. It is not just a small model: about 8 GB of weights shift attention to VRAM, TCO, and quantization. For teams with workstations and small servers, the signal is clear: the intermediate segment between cloud and edge is growing, with implications for GPU vendors and cloud providers. An analysis of the trade-off between control and infrastructure.

2026-10-17 📰 Source
AMD W7900 e LFM2.5: il segnale di un on-premise sempre più concreto
📁 Hardware AI generated ℹ️ LocalLLaMA

AMD W7900 and LFM2.5: A Concrete Signal for On-Premise LLM

A 24-billion-parameter LLM tested on an AMD W7900 with a 128,000-token context and sustained speed around 95 tokens per second signals that on-premise inference is maturing beyond NVIDIA's ecosystem. AI-Radar explores trade-offs, data sovereignty, and TCO.

2026-10-15 📰 Source
Mesa porta YOLOX su NPU: il driver aperto ridefinisce l'inference locale
📁 OnPremise AI generated ✅ Phoronix

Mesa brings YOLOX to NPUs: the open driver reshapes local inference

Mesa extends support to NPUs and demonstrates YOLOX via PyTorch, moving accelerator access outside proprietary toolchains. For edge and on-premise, the open driver reduces lock-in and porting costs, changing the TCO calculation. AI-Radar reads the structural signal: AI acceleration follows the GPU trajectory, where value shifts from simple hardware access to orchestration with shared frameworks and reproducible pipelines.

2026-10-14 📰 Source
Reverse engineering CUDA con AI: il sintomo di un lock-in che pesa sull'on-premise
📁 OnPremise AI generated ℹ️ LocalLLaMA

Reverse engineering CUDA with AI: the on-premise lock-in symptom

A Reddit post revives the idea of using LLMs to recreate open source CUDA and free AMD GPUs. The signal is not immediate technical feasibility, but structural tension between stack control, software compatibility, and TCO in self-hosted infrastructure. For those evaluating on-premise deployments, the debate shows how hardware choice is inseparable from ecosystems, frameworks, and migration constraints.

2026-10-13 📰 Source
Scontrini on-device: il segnale per chi controlla l'inference locale
📁 OnPremise AI generated ℹ️ LocalLLaMA

Receipts on-device: the signal for those controlling local inference

A 0.8B model reading receipts on the phone shows on-device inference as a concrete option for personal documents. The project combines fine-tuning on donated data, JSON output and a self-hosted release valve via an OpenAI-compatible server. For those evaluating local deployments, the signal is the trade-off between memory, data quality and TCO, with sovereignty as a constraint rather than a preference.

2026-10-12 📰 Source
RTX 4090 contraffatte: la falla hardware dell'inference self-hosted
📁 Hardware AI generated ℹ️ LocalLLaMA

Counterfeit RTX 4090s: the hardware gap in self-hosted inference

Counterfeit RTX 4090s that are almost indistinguishable from genuine parts during visual inspection and initial software tests are turning consumer GPU purchases for on-premise LLM inference into a structural risk. The damage goes beyond replacement costs: it includes instability under sustained load, unreliable benchmarks and a higher TCO. For self-hosted and data-sovereign deployments, hardware provenance becomes an infrastructure skill, not just a logistics detail.

2026-10-11 📰 Source
GLM 5.3 Flash e Mistral Large 4: il sorpasso che sposta il TCO
📁 Market AI generated ℹ️ LocalLLaMA

GLM 5.3 Flash and Mistral Large 4: the overtake that shifts TCO

Two open models lead the Artificial Analysis Cyber Index and outperform every single Anthropic model. The overtake is not just a ranking: it shifts the TCO calculation from API fees to on-premise infrastructure, reopening the debate on data sovereignty, quantization, and GPU management. AI-RADAR analyzes the implications for local deployments, fine-tuning, and self-hosted stacks, plus the ripple effects on cloud vendors and system integrators.

2026-10-10 📰 Source
SAP simula l'azienda: dati sintetici senza schema e il nuovo perimetro sovrano
📁 OnPremise AI generated 🏆 ArXiv cs.AI

SAP simulates the enterprise: schema-free synthetic data and the new sovereign perimeter

SAP's Synthesis Through Simulation framework generates enterprise synthetic data by having an LLM agent operate against APIs that enforce simulated policies, without accessing database schemas. Structural validity emerges by construction, not extraction. For self-hosted infrastructures, the sovereignty and TCO calculus shifts: a local pipeline from simulation to fine-tuning reduces cloud dependency and legal approvals, but moves risk onto the fidelity of the simulated environment.

2026-10-09 📰 Source
LiteBox: il sandbox locale diventa un tassello per l’AI on-premise
📁 OnPremise AI generated ✅ Phoronix

LiteBox: local sandboxing becomes a building block for on-premise AI

Microsoft published the first tagged release of LiteBox, a Rust sandbox to isolate Linux on Linux and Linux on Windows. The signal is maturity: stronger isolation than containers, cross-OS portability, useful for self-hosted LLM pipelines. It reduces dependence on cloud sandboxes and strengthens sovereignty. Overhead, attack surface and operational integration remain to be assessed.

2026-10-08 📰 Source
Guida esterna nei LLM: il bias non si elimina, si calibra
📁 Frameworks AI generated 🏆 ArXiv cs.LG

External guidance in LLMs: bias cannot be eliminated, only calibrated

GA-GRPO formalizes external guidance in LLM reasoning fine-tuning as an operator introducing measurable bias based on divergence between guidance and policy. The theory shows bias is inevitable and grows over time, but optimal guidance weight decreases as training progresses. Tests with Qwen2.5-Math-7B on nine benchmarks show a 31% GPU-hour saving, with direct implications for TCO in on-premise and self-hosted deployments.

2026-10-07 📰 Source
ROCm 10.1: la cadenza software che riscrive il TCO on-premise
📁 OnPremise AI generated ✅ Phoronix

ROCm 10.1: The Software Cadence Reshaping On-Premise TCO

ROCm 10.1 confirms AMD's six-week cycle for its GPU stack. More than individual features, predictability matters: for self-hosted deployments it reduces the risk of being stuck on old versions and makes software a governable part of the pipeline. Stack maturity enters TCO alongside VRAM and performance. Unknowns remain on framework compatibility, SKUs, and release quality.

2026-10-06 📰 Source
Quando un LLM locale perde il filo: biografie nel refactoring e quantization spinta
📁 OnPremise AI generated ℹ️ LocalLLaMA

When a Local LLM Loses the Thread: Biographies in Refactoring and Aggressive Quantization

A refactoring task on an RTX 5070 Ti with Qwen3.8-27B in IQ3_XXS quantization produces a biographical digression about Lee Kuan Yew inside the reasoning. The episode shows how aggressive compression and speed can erode internal coherence, making traceability fragile in self-hosted deployments. For on-premise deployments, the focus shifts from tokens per second to the stability of intermediate steps, with implications for agentic pipelines and human oversight.

2026-10-05 📰 Source
Helion in vLLM: il tuning dei GEMM diventa ricerca, non artigianato GPU
📁 Frameworks AI generated ✅ PyTorch Blog

Helion in vLLM: GEMM tuning becomes search, not GPU craft

Helion's linear backend in vLLM shows a single GEMM kernel with an ahead-of-time autotuner can cover specialized variants and improve inference by up to 10% on Qwen3. For self-hosted LLM teams, the signal is twofold: less dependence on deep CUDA skills, but the cost shifts to offline tuning and configuration governance.

2026-10-03 📰 Source
BIG-IP Next per Kubernetes: l'efficienza AI si sposta dalla GPU alla rete
📁 OnPremise AI generated ✅ ServeTheHome

BIG-IP Next for Kubernetes: AI Efficiency Shifts from GPU to Network

F5's test on BIG-IP Next for Kubernetes shows that the same GPU cluster can deliver more than triple the performance by tuning traffic balancing and routing. For on-premise deployments, node-level efficiency becomes central to TCO; the risk is coupling optimization to a proprietary stack. AI-RADAR analyzes implications for local infrastructure teams, between unused capacity and technical dependency.

2026-10-02 📰 Source
🎬
🎥 VIDEO
📁 General Editoriale

Plants Governed Agents

A demo showing the integration of MachinaOS with MES via Shopfloor-Copilot

2026-10-01
Fine-tuning oltre il testo: DASA trasforma il gradiente nel dataset
📁 LLM AI generated 🏆 ArXiv cs.AI

Fine-tuning beyond text: DASA turns gradients into the dataset

DASA uses activation gradients from a frozen reference model to produce synthetic embeddings, fine-tuning LLMs without readable text. Tests on Llama and Qwen show performance similar to or better than natural language data, with up to 4.9x speedup over GRADMM. For self-hosted deployments, the balance shifts among data curation, compute, portability, and audit.

2026-09-30 📰 Source
Nemotron 3: il valore si sposta dai pesi all'orchestrazione dell'inference
📁 OnPremise AI generated ℹ️ LocalLLaMA

Nemotron 3: Value Shifts from Weights to Inference Orchestration

Nemotron 3's IOI 2026 score is not just a milestone. The stated result rests on GenCorrect, a test-time compute loop that multiplies tokens per query. For on-premise deployments, open weights and NVFP4 quantization lower the hardware barrier, but operational cost shifts to VRAM, throughput, and TCO. AI-RADAR analysis: why it matters and which trade-offs to evaluate.

2026-09-29 📰 Source
Nvidia spinge i personal AI computer: l'on-premise diventa un formato
📁 OnPremise AI generated ✅ DigiTimes

Nvidia pushes personal AI computers: on-premise computing changes scale

Nvidia's push on personal AI computers signals a shift in the center of gravity: LLM inference moves closer to the local device. It is not just consumer hardware, but a miniature on-premise node touching VRAM, quantization, TCO and data sovereignty. IT teams face a third path between cloud and data center: evaluate stable workloads, memory constraints and operational complexity.

2026-09-28 📰 Source
Qwengram-0.8B: memoria esterna e gate dinamica cambiano i conti del self-hosted
📁 OnPremise AI generated ℹ️ LocalLLaMA

Qwengram-0.8B: External Memory and Dynamic Gating Shift Self-Hosted LLM Trade-offs

Qwengram-0.8B freezes Qwen3.5-0.8B and adds a 51-billion-parameter n-gram memory outside the GGUF. Perplexity drops by 5.05%, but the relevant signal is architectural: late injection controlled by a per-token gate, Q8_0 quantized sidecar, and no backbone fine-tuning. For local LLM operators, the separation between weights and knowledge is the key: updating memory without touching the model opens new scenarios but imposes strict constraints on runtimes.

2026-09-26 📰 Source
Sicurezza, ad hominem e controllo locale: il vero costo degli LLM addomesticati
📁 LLM AI generated 🏆 ArXiv cs.CL

Safety, ad hominem, and local control: the real cost of tamed LLMs

Safety fine-tuning is not neutral: it narrows the strategic space of LLMs in real debates. For on-premise deployments, control over weights, pipelines, and TCO becomes the real variable. AI-Radar's analysis focuses on the trade-off between ready-to-use API models and self-hosted systems that can reshape conversational behavior.

2026-09-25 📰 Source
AMD e GDDR7 su Linux: il segnale infrastrutturale per chi fa inference on-premise
📁 Hardware AI generated ℹ️ Tom's Hardware

AMD and GDDR7 on Linux: the infrastructure signal for on-premise inference

AMD's initial work on GDDR7 support in Linux GPU drivers signals a shift for teams running on-premise AI infrastructure. The seemingly technical news highlights the importance of memory bandwidth for LLM inference and lowers integration friction for self-hosted environments. It's a signal to read through the lens of TCO and data sovereignty, rather than a product announcement.

2026-09-24 📰 Source
AliceAI 80B: architettura custom e il nodo dei runtime
📁 LLM AI generated ℹ️ LocalLLaMA

AliceAI 80B: Custom Architecture and the Runtime Bottleneck

Yandex has published an 80B-parameter base model with a custom architecture and reduced active component. It is not a Qwen3 fine-tune and lacks Llama.cpp support: a double signal. AI-RADAR analyzes implications for on-premise deployment: inference ecosystem maturity, porting cost, architecture proliferation. Not a plug-and-play model, but an indicator of technical direction.

2026-09-22 📰 Source
BI-Bench e BI-Agent: il vero divario è nell'orchestrazione dei dati
📁 OnPremise AI generated 🏆 ArXiv cs.LG

BI-Bench and BI-Agent: the real gap is in data orchestration

End-to-end BI exposes a structural limit of LLMs: below 50 percent accuracy without human guidance. The real gains come from architectures that orchestrate tools and post-training on proprietary data. For on-premise and self-hosted deployments, TCO shifts toward GPUs, metadata, and pipelines, not per-token cost.

2026-09-21 📰 Source
Von, 395M parametri e solo CPU: cosa cambia per l'inference on-premise
📁 OnPremise AI generated ℹ️ LocalLLaMA

Von, 395M parameters and CPU-only: what changes for on-premise inference

Von, an open source LLM with 395 million parameters, runs entirely on CPU with 1-2 GB of memory and claimed latency between 25 and 300 ms. Announced on Reddit as a drop-in replacement for JEV and not yet optimized, it reopens the discussion about GPU-free local deployments. For AI-RADAR the signal is not the benchmark, but the low cost of independent verification and self-hosted deployment inside the corporate perimeter.

2026-09-20 📰 Source
Bonsai 2 Swift e il costo nascosto dei token nel self-hosted
📁 OnPremise AI generated ℹ️ LocalLLaMA

Bonsai 2 Swift and the hidden token cost of self-hosted LLMs

UkisAI's question about Bonsai 2 Swift is not a simple update request. It highlights how the TCO of local LLMs increasingly depends on runtime behavior: wasted tokens, overthinking loops and quantization choices are redefining on-premise efficiency.

2026-09-19 📰 Source
← Previous Page 1 / 2 Next →
View Full Archive 🗄️

AI-Radar is an independent observatory covering AI models, local LLMs, on-premise deployments, hardware, and emerging trends. We provide daily analysis and editorial coverage for developers, engineers, and organizations exploring local AI solutions.

AI-RADAR badge LaunchTry LAUNCHING SOON ON LaunchTry Fazier badge