AI-RADAR.it
AI-RADAR.IT · AI-RADAR.NET · AI-RADAR.TECH
News & analysis on local LLMs, stack & on-prem hardware.

🗄️ News Archive

Complete history of AI signals, ordered by date.
Total Articles: 15931

This archive is the long-term memory of AI-Radar: model launches, framework releases, infrastructure shifts, and market signals tracked over time in one searchable timeline. Use it to compare how narratives evolved, identify which technologies sustained momentum, and validate decisions with historical context rather than short-lived hype. For faster navigation, jump to focused hubs like LLM, Frameworks, Hardware, or the Trends pillar.

💡 Looking for something specific? Use the Search Bar at the top for a detailed search.

Jul 06 2026
LLM

Tencent drops Hy3 with Apache 2.0: the 295B MoE LLM Europe can now deploy on-prem

Tencent has open-sourced the Hy3 model: 295 billion total parameters, 21 billion active, mixture-of-experts architecture, and — crucially — an Apache 2.0 license. It replaces the former community license that prohibited use in South Korea, the UK, and the European Union. For enterprises considering on-premise deployment in Europe, the license change removes the main legal obstacle.

→
Jul 06 2026
Altro

Sherpa.ai raises $18M to advance data-sovereign AI for enterprises

The Basque startup specializing in privacy-preserving AI closed an $18M round led by Forgepoint Capital. The funding will evolve its platform for collaborative training and inference without sharing sensitive data, with applications in healthcare, finance, and government. The move signals the growing demand for infrastructure that ensures data control.

→
Jul 06 2026
Market

Kingboard raises CCL prices again as AI demand squeezes PCB supply chain

Kingboard has announced another price hike for copper clad laminates (CCL), a critical material for printed circuit boards, driven by surging demand for AI hardware. The move signals supply chain strains that could ripple through server and networking equipment costs, with implications for those managing on-premise infrastructure.

→
Jul 06 2026
Altro

Aylight raises €4.5M for multi-wavelength lasers in AI data centers

Swiss startup Aylight has closed a €4.5 million pre-seed round to develop chip-scale multi-wavelength lasers for AI data center optical interconnects. The technology, based on a frequency-modulated comb, promises to reduce the number of discrete lasers needed, improving energy efficiency and infrastructure scalability. The funding, co-led by Elaia and Swisscom Ventures, will support first foundry prototypes.

→
Jul 06 2026
Market

China’s IC design nears 1 trillion yuan, but Nvidia’s CUDA lays bare its limits

China’s chip design revenue shines, but Nvidia’s software dominance remains a stumbling block. Without a mature CUDA alternative, the gap tightens the race for on-premise AI and forces difficult choices on those building sovereign infrastructures.

→
Jul 06 2026
Altro

Athena: Offline Voice Assistant with 397B Parameters on a Consumer GPU and System RAM

Athena runs a 397B mixture-of-experts LLM, neural TTS, speech recognition, and an audio codec entirely on local hardware with no cloud or telemetry. The C++ project shows that emotional, long-memory voice assistants are feasible on-premises using just a single consumer GPU.

→
Jul 06 2026
Frameworks

D7VK 1.12: The Bridge Between Direct3D 7 and Vulkan on Linux Keeps Growing

The new version of the translation layer bringing old Direct3D 7 APIs to Vulkan has been released, with steady performance gains. A piece of the puzzle making Linux ever more robust for those managing heterogeneous GPU workloads on-premise.

→
Jul 06 2026
Hardware

SJ Semiconductor launches $1.5 billion 3DIC project for AI chips

Chinese advanced packaging maker SJ Semiconductor has kicked off a $1.5 billion project to produce 3D integrated circuits for AI chips. The investment aims to bolster hardware supply chains amid surging demand, with direct implications for on-premise deployment and data sovereignty considerations.

→
Jul 06 2026
Hardware

Nearfield Instruments: Process Control Challenges EUV Dominance in AI Chip Manufacturing

An exclusive interview reveals the strategy of Dutch startup Nearfield Instruments: using process control to compete with EUV lithography in AI chip manufacturing. An approach that could reduce costs and bottlenecks, with implications for on-premise deployments.

→
Jul 06 2026
Hardware

China’s chip equipment makers ramp up expansion as AI and memory boom fuels domestic demand

Chinese semiconductor equipment manufacturers are expanding capacity to meet booming domestic demand driven by AI and memory chips. The shift reshapes the hardware supply chain and could open new possibilities for self-hosted LLM deployments.

→
Jul 06 2026
Market

Greatek acquires Onsemi Philippines plant, advancing Taiwan+1 in semiconductor packaging

Taiwanese OSAT Greatek acquires Onsemi’s packaging plant in the Philippines, reinforcing a production diversification move that directly affects the supply chain for AI chips. In a market where advanced packaging capacity determines the availability of GPUs and accelerators, this development carries weight for those planning on-premise infrastructure.

→
Jul 06 2026
Altro

Anthropic tightens controls, Chinese courts as weapons: wake-up calls for on-premise AI

Anthropic tightens access controls to its models; the Innoscience-Infineon clash highlights the strategic use of Chinese courts. Two signals pushing organizations to carefully assess data control and supply chain resilience for AI.

→
Jul 06 2026
Hardware

Phison: AI demand could end NAND memory's boom-and-bust cycle

Phison believes AI-driven demand is reshaping the NAND memory market, historically prone to sharp expansions and contractions. This shift matters for on-prem infrastructure design, where storage is a critical cost factor.

→
Jul 06 2026
Market

AWS boosts custom chip shipments, driving demand surge for Taiwanese suppliers

AWS is hiking its ASIC shipments, creating a fresh demand wave for Taiwanese semiconductor suppliers. The ramp-up of custom cloud silicon reshapes the LLM inference landscape and has indirect effects on availability and pricing for on-premise hardware.

→
Jul 06 2026
Market

SEMI warns Trump administration against memory market interference

The semiconductor industry group cautions against political moves that could destabilize the memory sector. A wake-up call for on-premise AI infrastructure planners: DRAM and HBM availability and cost directly impact LLM inference TCO and performance.

→
Jul 06 2026
Market

China tightens scrutiny on Taiwan investments: ripple effects for AI hardware

A new Chinese law increases scrutiny of Taiwanese investments, according to DIGITIMES. The move may affect the semiconductor supply chain, potentially impacting availability and costs of hardware used for on-premise LLM inference and training.

→
Jul 06 2026
Altro

Alibaba reportedly bans Claude Code for employees, citing security as China pivots to domestic AI tools

The Chinese giant has reportedly blocked Anthropic's coding assistant over data protection fears. The move underscores how technological sovereignty is reshaping corporate policies, with direct implications for those evaluating on-premise AI stacks today.

→
Jul 06 2026
Hardware

Micron breaks ground on Hiroshima expansion for AI memory production

Micron has started construction on an expansion of its Hiroshima plant, aiming to increase production of memory chips for artificial intelligence. The move addresses the growing demand for high-bandwidth memory (HBM) essential for GPUs and accelerators used in LLM training and inference, signaling the hardware industry's readiness for wider AI workloads, including on-premise deployments.

→
Jul 06 2026
Altro

Linux 7.2-rc2 Released: 'Things Look Very Normal' for Upcoming Stable Kernel

The development team has published the second release candidate for the Linux 7.2 kernel, with Linus Torvalds noting 'Things look very normal.' A signal of a mature development cycle, highly relevant for on-premise infrastructures that depend on stability. The stable release is expected in August.

→
Jul 06 2026
Market

Taiwan scooter market: Gogoro's surge and SYM's lead reinforce the tech supply chain

Taiwan scooter sales rose in June, with SYM holding its lead and Gogoro surging. A sign of industrial vitality that also impacts on-premise AI hardware, where component availability and local supply chain resilience are increasingly strategic.

→
Jul 06 2026
Hardware

CG Semi kicks off commercial production: India’s third semiconductor plant fuels the race for domestic AI hardware

CG Semi's packaging and test plant in Gujarat has begun commercial production, marking India's third semiconductor hub. Beyond electronics, it’s a building block for on-premise AI and digital sovereignty, where local chip availability cuts risk, lead times, and costs.

→
Jul 06 2026
Market

Meta's AI cloud plan: chasing returns, not an AI retreat

Rumors point to Meta exploring an AI cloud offering to monetize its massive infrastructure investments. It is not an AI retreat but a strategy to generate returns. The move reignites the debate about when to build an on-premise stack versus relying on external services, balancing TCO, control, and data sovereignty.

→
Jul 05 2026
Hardware

Taiwan's chip sector faces helium crunch: nearly 90% reliant on Qatar

Taiwan's semiconductor industry, a pillar of global chip production, is entering a critical helium supply phase. With near-total dependence on Qatar, the fragility of the supply chain raises questions about future costs and availability of GPUs for on-premise AI.

→
Jul 05 2026
Market

Asahi Kasei expands photoresist film capacity in Taiwan for AI chip packaging

Japanese chemical company Asahi Kasei invests to boost production of photoresist films for advanced semiconductor packaging, driven by AI chip demand.

→
Jul 05 2026
Market

AI supercycle to push chip market past $2 trillion by 2030

Demand for compute power driven by LLMs and generative AI could push the semiconductor market beyond $2 trillion by 2030, according to DIGITIMES. What this means for those considering self-hosted deployments and on-prem infrastructure.

→
Jul 05 2026
Hardware

China’s Zhonghao Xinying Launches Xuyu AI Processor, Challenging GPU Dominance

Chinese chipmaker Zhonghao Xinying has unveiled Xuyu, a TPU processor designed to rival GPU architectures in AI workloads. The move signals a shift in the custom accelerator market, with potential impact on on-premise deployment choices and data sovereignty considerations.

→
Jul 05 2026
Market

Tech billionaires pour $120M into killing California wealth tax

Silicon Valley's elite have mobilized record spending to block Proposition 40, a one-time 5% tax on large fortunes. The political fight spotlights what's at stake for holders of digital assets and strategic infrastructure, and raises questions about TCO and resource control in an era of rampant AI investment.

→
Jul 05 2026
Market

Minions & Monsters opens with $64M, the franchise’s weakest debut

Universal’s Minions & Monsters topped the US July 4 box office with roughly $64 million over its first five days, the weakest opening in Despicable Me franchise history and far below the $120 million-plus debuts of its two predecessors. The soft start raises franchise-fatigue questions for Comcast’s most reliable animation machine.

→
Jul 05 2026
Market

AI-native startups hire fewer juniors, more elites: Harvard study sheds light

A working paper from Harvard and INSEAD reveals that startups built around artificial intelligence hire fewer entry-level workers and rely heavily on senior technical talent. The lean, flat teams signal a trend that carries direct implications for organizations considering on-premise LLM deployment, where senior expertise is already in short supply.

→
Jul 05 2026
LLM

A 270 million parameter LLM built from scratch and designed for local inference

An independent researcher has built a custom language model with a Transformer architecture optimized for local execution. Rotary Positional Embeddings, RMSNorm, SwiGLU, and grouped query attention form an autoregressive decoder that points clearly toward running AI directly on-device.

→
Jul 05 2026
LLM

Local VLMs in July 2026: The Community Weighs In on Setups and Choices

A Reddit thread asks users to share their favorite locally run Vision-Language Models. Detailed hardware, inference engine, and usage reports emerge, showing how the community works around unreliable benchmarks with hands-on accounts. A valuable snapshot for anyone evaluating on-premise stacks.

→
Jul 05 2026
LLM

Are Open Weight LLMs Viable Long-Term? Qwen’s Delay and the Hardware Hurdle

Qwen's decision to delay the release of larger models raises questions about the long-term viability of open weight LLMs. With performance already lagging 2–4 months behind state-of-the-art systems, additional delays could alienate the community relying on consumer GPUs for local inference.

→
Jul 05 2026
Hardware

RAM price madness drives maker to build DIY magnetic core memory using Apollo-era tech

A hobbyist assembled a USB drive with hand-threaded magnetic core memory, recycling vintage Russian components. An extreme response to current costs, raising questions about data longevity and sovereignty for those evaluating self-managed hardware stacks.

→
Jul 05 2026
Hardware

Qwen 3.6 27B: FP8 hits the sweet spot for local inference on Blackwell

Field tests with a single RTX 6000 Pro 96 GB show FP8 quantization strikes the best balance between generation speed and reliability. NVFP4 delivers peak token throughput but introduces instability in agent mode, while BF16 lags behind. vLLM proves more stable and faster than llama.cpp on this workstation.

→
Jul 05 2026
Altro

India orders Meta to remove Instagram ads exploiting children – 7 days to explain

India's IT ministry has ordered Meta to immediately disable Instagram ads promoting child sexual exploitation material and give an explanation within seven days. The incident highlights the fragility of automated content moderation and renews the debate on platform accountability and AI oversight.

→
Jul 05 2026
Altro

Citi’s Jane Fraser says banking faces two AI races — and the defensive one reshapes the game

Citigroup CEO Jane Fraser told the South China Morning Post that the financial sector is running two AI races at once: an offensive one to boost revenue and customer experience, and a defensive one to protect the banks. The latter pushes for a rethink of infrastructure, data sovereignty, and on-premise deployment — topics that AI-RADAR tracks closely.

→
Jul 05 2026
Altro

US control of frontier AI hangs over NATO’s Ankara summit

Washington decides which allies get access to the most advanced AI models. The July 7–8 NATO summit highlights digital sovereignty concerns, pushing Europe to consider on-premise stacks to reduce technological dependency.

→
Jul 05 2026
Altro

‘Sweet niblets,’ Hannah Montana Linux returns: v26 on Debian with KDE Plasma

After nearly two decades, the Hannah Montana-themed Linux distribution is back with a new release. Built on Debian and sporting a reskinned KDE Plasma interface, version 26 proves that a project born as a joke can still have a life, thanks to the robustness of its open-source foundations.

→
Jul 05 2026
Hardware

Hon Hai hits 40% sales growth: Nvidia’s AI server momentum

Taiwan’s Hon Hai (Foxconn) posts a 40% quarterly revenue jump, driven by AI server demand for Nvidia. The stronger-than-expected figures spotlight supply-chain pressure and the implications for enterprises evaluating on-premise Large Language Model deployments.

→
Jul 05 2026
Altro

South Korea to channel AI chip tax windfall into a ‘future response fund’

South Korea's government will turn the extra tax revenue from its semiconductor boom into an investment vehicle focused on artificial intelligence and advanced manufacturing. The stated goal is to build resources for future generations while reinforcing the country's position in the global AI chip supply chain.

→
Jul 05 2026
Altro

NHS app to deploy AI triage: the tightrope between innovation and data sovereignty

The UK government announced that the NHS app will use an AI tool to assess symptoms and direct patients to the right service. The pilot will reach 200,000 users in England within the next year, part of a £10bn tech overhaul. The move sharpens the focus on healthcare data privacy, control, and deployment architectures — critical issues for those tracking on-premise AI evolution in regulated settings.

→
Jul 05 2026
Altro

UK warning: don't post kids' photos, AI is turning them into abuse material

The UK's National Crime Agency warns parents that posting images of children online fuels the creation of AI-generated sexual abuse material. The Internet Watch Foundation has already identified over 8,000 such photos and videos. The exponential growth of deepfake child abuse forces a rethink of public sharing and detection systems, with implications for organizations managing sensitive data on-premise.

→
Jul 05 2026
Altro

Mistral CEO warns closed AI models give providers ‘immense leverage’ over your business

Mistral CEO Arthur Mensch warns enterprises that closed AI models force data retention and give providers disproportionate leverage, reigniting the debate on digital sovereignty and the viability of self-hosting.

→
Jul 05 2026
Altro

Alibaba bans Anthropic’s Claude Code over alleged China-detection backdoor

Alibaba Group has reportedly banned Anthropic’s Claude Code after discovering a hidden feature capable of detecting access from China. Employees have been instructed to switch to Qoder, widening the rift between the two companies. The incident reignites debates on data sovereignty and the hidden risks of cloud-based AI services.

→
Jul 05 2026
LLM

Qwen 3.7 9B: Alibaba closes models, what changes for self-hosting

Alibaba made Qwen 3.7 models proprietary and API-only, fueling the search for open alternatives in the 8B-9B class for local deployment. The silence on a 9B version prompts reflection on the LLM market direction for those prioritizing sovereignty and control.

→
Jul 05 2026
LLM

LongCat 2.0 goes open source: MIT license for the 1.6T parameter model with 48B active

The weights of longcat 2.0 (1.6 trillion total parameters, 48 billion active) are now available under the MIT license. A strong signal for teams evaluating on-premise LLM deployments, with implications for data sovereignty, customization, and TCO.

→
Jul 05 2026
Hardware

DARPA eyes 30-year nuclear waste batteries for autonomous drones and off-grid AI

Project SYMPHONEE aims to use Strontium-90 to power persistent military drones for decades. This choice could reshape edge AI computing by cutting cloud dependence and lowering TCO for long-endurance missions that require no energy maintenance.

→
Jul 05 2026
Hardware

AMD Preps Linux 7.3 Graphics Drivers: A Signal for On-Premise AI

AMD has submitted initial pull requests for graphics drivers targeting the Linux 7.3 kernel. The staging work reflects the company’s ongoing commitment to its open-source stack, with potential implications for on-premise infrastructure using AMD GPUs for LLM inference.

→
Jul 05 2026
Frameworks

MrFlow: Training-free Diffusion Acceleration up to 25x through Multi-Resolution Pipeline

A new training-free method, MrFlow, accelerates text-to-image generation using a multi-resolution pipeline. It achieves up to 10x speedup without sacrificing visual quality, and can be combined with distillation to reach 25x, without custom kernels or retraining.

→
Jul 05 2026
LLM

Local LLMs and agentic workloads: prefill is everything, KV heads beat parameters

A benchmark of 13 models at 65K-128K context on a consumer GPU reveals prefill accounts for 94-99% of wall-clock time for short outputs, making it the key metric. KV head count, not parameter size, determines long-context scaling. Quantization and Mamba2 yield surprises, while MLA suffers on Vulkan. The analysis redefines criteria for on-prem agentic deployments.

→
Jul 05 2026
Hardware

Qwen3.6-27B at Q8: pushing context to 100K on 32 GB VRAM

An experiment demonstrates how to stretch Qwen3.6-27B at Q8 to a context window of up to 115K tokens on a single 32 GB VRAM GPU, by quantizing the KV cache at different precisions. Speculative decoding benchmarks reveal trade-offs between context length, inference speed, and accuracy, offering a concrete use case for on-premise deployment on high-end consumer hardware.

→
Jul 05 2026
Hardware

AI and HPC wave pushes CHPT revenue to new monthly peak

Demand for test interfaces for chips targeting AI and HPC workloads has pushed Chunghwa Precision Test Tech (CHPT) to its highest monthly revenue ever in June. The figure reflects pressure on the advanced semiconductor supply chain, with potential knock-on effects for those planning on-premise deployment of GPUs and accelerators.

→
Jul 05 2026
Market

Component inflation: The Taiwan PMI warning that also hits on-premise AI

The slowdown in Taiwan's manufacturing PMI, tied to rising semiconductor costs, is a signal not to be overlooked for those planning on-premise LLM infrastructure. Longer lead times and increasing TCO challenge self-hosted deployment strategies.

→
Jul 05 2026
Hardware

Robots, AR glasses, and AI PCs impact display tech: local inference changes the rules

The triad of AI PCs, augmented reality glasses, and robotics is reshaping display technologies, shifting inference workloads to edge devices and impacting hardware choices for on-premise deployment. Latency, costs, and data sovereignty drive evolution.

→
Jul 05 2026
Market

From Bloomberg to DIGITIMES: building a media model for the AI era

The shift from a generalist media model to a specialized one, as exemplified by DIGITIMES, is not just an editorial choice but a necessity for enterprise decision-makers evaluating hardware, LLMs, and data sovereignty.

→
Jul 05 2026
Frameworks

"Application" architecture makes smaller LLM more effective at complex tasks

A Reddit user demonstrates how confining an LLM agent to dedicated "applications," each with limited tools and context, makes a 4B-parameter Gemma 4 model more effective than its 26B counterpart on consumer hardware.

→
Jul 05 2026
Altro

RTX 3090 and LLMs: Running Qwen 27B with 200K Tokens Locally Is a Reality

The AI maker community celebrates the power of the NVIDIA RTX 3090: a user shares their experience running the Qwen 27B model with a 200,000-token context window, using the ‘club 3090’ configuration from GitHub. The consumer GPU with 24 GB of VRAM proves the feasibility of on‑premise inference with long contexts, highlighting advancements in quantization and optimization tools for those pursuing local solutions.

→
Jul 04 2026
Altro

Google's AI Meets the Founding Fathers: Cloud Productivity vs. Data Sovereignty

A new Google ad imagines the U.S. Founding Fathers using AI in Workspace to draft the Declaration of Independence. A powerful image that raises questions about data control and deployment choices for those who cannot afford to hand sensitive information to cloud services.

→
Jul 04 2026
Altro

Anthropic Accused of Literal Prompt Injection: A Reddit Report Sparks Debate

A Reddit user claims to have found evidence of deliberate prompt injection by Anthropic. Regardless of the claim's validity, the incident shines a light on the transparency of cloud LLM providers and the value of full-stack control for organizations that cannot outsource trust.

→
Jul 04 2026
Altro

Midjourney Demands Hollywood Studios Reveal Their Own AI Practices

Amid a legal battle with three major studios, the generative AI company is seeking to compel them to disclose their own use of AI models. The move shifts the focus from copyright infringement claims to transparency around real AI adoption in the film industry, with potential implications for deployment decisions.

→
Jul 04 2026
Market

Starling Bank cuts jobs as AI speeds up, but data sovereignty remains the sticking point

The London-based neobank is shedding 130 roles to streamline operations and embed AI deeper. As artificial intelligence promises efficiency, on-premise deployment becomes critical for handling sensitive financial data and avoiding vendor lock-in.

→
Jul 04 2026
LLM

Step 3.7 Flash with Claude-style prompts beats Hermes on code: a wake-up call for local LLM deployments

StepFun's blog reveals that their Step 3.7 Flash model, when steered by Claude-inspired prompts, outperforms the popular Hermes approach on coding tasks. A result that forces us to reconsider the role of software configuration for those running self-hosted LLMs.

→
Jul 04 2026
Altro

Alibaba bans Claude Code: a move that shines a spotlight on code data sovereignty

The Chinese giant reportedly classified Anthropic's coding assistant as high-risk software, halting its internal use. A decision that raises questions about data ownership with third-party LLMs and, for those managing on-premise stacks, strengthens the push toward self-hosted solutions.

→
Jul 04 2026
Altro

Linux DRM Scheduler Patches Slash Job Submission Latency Under Load

A patchset for the Linux kernel's Direct Rendering Manager scheduler shows promise in drastically cutting GPU job submission latency when the system is under heavy CPU load. This matters for on-premise LLM deployments, where resource contention can hurt local inference responsiveness.

→
Jul 04 2026
LLM

Mistral AI: The open source challenge to OpenAI's dominance

The French startup has raised significant funding since 2023 to bring frontier models to the public. But the real differentiator is its open models: a choice that redefines data control and deployment strategies for enterprises.

→
Jul 04 2026
Hardware

Record heat and DGX Spark: the command avoiding summer crashes

A Reddit user shared a fix for DGX Spark lockups during heatwaves: underclocking the GPU via nvidia-smi. Temperatures dropped from 85°C to 60°C, restoring stability. The episode highlights an often-overlooked challenge of on-premise deployments: thermal management in non-professional environments.

→
Jul 04 2026
Altro

Macron and Modi court tech CEOs for data centers: Winning the AI infrastructure race

The AI infrastructure race has become a personal relationship game. Macron and Modi are winning billion-dollar data center investments that will decide where future AI models are trained, reshaping compute geopolitics and offering new sovereignty options for enterprise deployment.

→
Jul 04 2026
Market

China’s Cinemas Are Now Pushed to Add AI Agents, Not Just Popcorn

Beijing’s new guidelines urge movie theaters to integrate AI concierge agents, themed cafés, and karaoke – a move that puts local AI inference and edge hardware in the spotlight for retail deployments.

→
Jul 04 2026
Hardware

Micron breaks ground on $9bn Hiroshima fab to feed AI memory hunger

Micron started building a ¥1.5 trillion expansion in Hiroshima for High-Bandwidth Memory, the stacked DRAM behind AI accelerators. The move underscores supply-chain pressures that will shape GPU availability and TCO for organizations running LLMs on their own infrastructure.

→
Jul 04 2026
Altro

OpenAI Never Visited Site of Flagship UK Data Centre Project

According to The Guardian, OpenAI never visited the designated site for the Stargate UK data centre before the announcement, raising questions about the government programme’s due diligence. For those planning on-premise LLM deployments, physical site assessment remains a critical and often overlooked step.

→
Jul 04 2026
Altro

India summons Meta over CSAM ads, data sovereignty back in focus

After a BBC investigation, India's IT ministry summons Meta executives. The scandal over paid ads promoting child sexual abuse material opens the debate on who controls AI moderation models and where data flows — key considerations for those evaluating on-premise architectures.

→
Jul 04 2026
Altro

USB 4K 60 FPS Video Capture on Linux: Kernel Finally Smooths Things Out

Newer Linux kernel releases are ironing out long-standing issues with 4K 60 FPS USB video capture. A quiet but meaningful step for edge and on-premise setups where processing video streams locally is non-negotiable.

→
Jul 04 2026
Altro

dSpark and MTP: Does Disk Spillover Become Tolerable for Inference?

New inference boosters like dSpark, dflash, MTP, and QAT promise accelerations, but historically disk spillover killed performance, dropping from 4–5 tokens/sec to 0.5 tokens/sec. The question: do these improvements make the drop bearable?

→
Jul 04 2026
Hardware

Windows Guru Uses 19th-Century Stirling Engine for Auxiliary Cooling on AMD Threadripper 3970X – Waste Heat Powers $40 Flywheel

An enthusiast fitted a $40 Stirling engine onto an AMD Threadripper 3970X system, using waste CPU heat to spin the flywheel and provide auxiliary cooling with zero additional electricity consumption. A throwback to 1816 technology that raises questions about thermal management in high-performance PCs.

→
Jul 04 2026
LLM

Google's TabFM: zero-shot tabular predictions without training

Google Research has released TabFM, a zero-shot foundation model for tabular data. It handles classification and regression with mixed numerical and categorical columns, without fine-tuning or hyperparameter search—training examples are passed as context and predictions are made in a single forward pass. For those working with structured data in regulated settings, the approach promises to simplify on-premise deployment, keeping data local and reducing reliance on cloud-based training pipelines.

→
Jul 04 2026
Hardware

Linux 7.3 Adds PCI IDs for Intel Nova Lake S Graphics

The drm-xe-next branch for Linux 7.3 begins adding PCI IDs for upcoming Intel Nova Lake S GPUs. As Intel steps up upstream Linux enablement, interest grows around its hardware for on-premise AI workloads, though the software ecosystem still has ground to cover.

→
Jul 04 2026
Hardware

Linux 7.2-rc2 raises the default RISC-V 64-bit CPU core limit to 256

A change in the Linux kernel, set for the next release candidate, bumps the default supported CPU core limit for RISC-V 64-bit to 256. The new default signals that many-core RISC-V processors aimed at servers and parallel workloads are on the horizon.

→
Jul 04 2026
Altro

Japan tests Starlink-equipped fire hydrant signs as emergency Wi-Fi hotspots

The project uses widespread fire hydrant sign infrastructure to create a backup satellite connectivity network, designed for natural disaster scenarios.

→
Jul 04 2026
Altro

Infineon wins fourth German patent ruling against Innoscience, GaN battle reaches Shanghai

Infineon has secured its fourth German court win against Innoscience in a GaN patent dispute, which now also flares in Shanghai. The battle touches on power semiconductors critical for datacenter efficiency and operational costs in on-premise AI infrastructure.

→
Jul 04 2026
Frameworks

GNOME Mutter Finally Learns to Survive GPU Resets

A Google Summer of Code project brings automatic GPU reset recovery to Mutter, saving the session from abrupt termination. A step forward for Linux desktop stability, crucial also for those running heavy computational workloads on the same machines.

→
Jul 04 2026
Market

Power chip price hikes: the ripple effect on on-premise AI infrastructure

CR Micro’s move is part of a broader power semiconductor price hike cycle that affects server and GPU node components too. For those managing local AI deployments, rising hardware costs impact TCO and refresh cycles, reopening a front often overlooked in on-premise evaluations.

→
Jul 04 2026
Market

TSMC's lower pay vs. fabless rivals: a risk for AI hardware?

Regulatory filings show TSMC's median pay lags behind that of smaller IC design firms. In a fiercely competitive talent market, this gap risks worsening the engineering shortage, potentially slowing advanced chip production and impacting availability and costs for on-premises AI infrastructure deployments.

→
Jul 04 2026
Market

Machvision’s record June revenue shows how AI demand is straining the hardware supply chain

The optical inspection system maker posted its highest-ever monthly revenue in June, driven by the global AI rush. The figure highlights upstream pressure on AI chip production and possible consequences for procurement lead times for organizations planning on-premise LLM deployments.

→
Jul 04 2026
Market

Tesla tops Taiwan imports, cuts Supercharger rates: the energy lesson for on-prem AI

In June 2026, Tesla led Taiwan imports and slashed Supercharger rates. Beneath the commercial moves lies a critical theme for on-premise deployments: energy cost control, a variable that heavily impacts the Total Cost of Ownership of LLM infrastructure.

→
Jul 03 2026
LLM

Longcat 2: INT8 and FP8 quantization now available for on-prem deployment

Meituan has published Longcat 2 model weights in INT8 and FP8 quantized formats. For teams self-hosting LLMs, having ready-to-use compressed versions lowers hardware requirements and inference costs while keeping a good balance between accuracy and VRAM usage.

→
Jul 03 2026
LLM

Why AI Needs a Glossary (and What It Has to Do with On-Premise Deployment)

The explosion of acronyms and neologisms in AI makes a glossary essential. For those evaluating on-premise infrastructure, terminological precision is not a luxury: it’s the tool to navigate hardware specs, sovereignty constraints, and real costs.

→
Jul 03 2026
Altro

Alibaba bans Claude Code after hidden code reportedly tracks Chinese developers

Alibaba has banned employees from using Claude Code after security researchers found hidden code designed to identify Chinese users. The move, effective July 10, escalates a conflict with Anthropic over allegations of AI capability theft through industrial-scale distillation. The incident puts a spotlight on code sovereignty and the risks of cloud-based AI tools.

→
Jul 03 2026
Altro

Palantir CEO spent $200M on hidden homes – here’s why it matters

Alex Karp, the CEO of Palantir, has built a real estate portfolio worth over $200 million, with one constant: extreme seclusion. From a former monastery in Colorado to gated Miami mansions, the news highlights a paradox: the head of the world’s most powerful surveillance company hides while his technology sifts through data everywhere. It mirrors the same worries driving governments and companies toward on-premise deployment.

→
Jul 03 2026
Altro

The man behind Pegasus now sells governments the antidote, and Latin America is buying

Dream, the Israeli AI cybersecurity startup founded by the creator of Pegasus, is expanding into Latin America, targeting governments aligned with Washington. With cyber attacks growing 25% annually and defenses among the weakest in the world, the region is investing in solutions that blend protection with digital sovereignty — a signal for those evaluating on-premise deployment.

→
Jul 03 2026
Market

The AI chip bubble cracks: end of the gold rush or tactical pause?

The PHLX Semiconductor Index plunged roughly 12% in two sessions, after a first half that gained over 80%. A signal that reshapes priorities for those building local stacks around GPUs and on-prem LLMs.

→
Jul 03 2026
LLM

Smartschool and AI for admission tests: why teaching is harder than answering

Building AI for schools, especially for high-stakes exams like the SAT and ACT, is far more complex than creating a chatbot. Smartschool tackles the challenge with a targeted approach to exam prep, where precision and reliability are crucial.

→
Jul 03 2026
Altro

The new browser wars: privacy and data sovereignty beyond Chrome and Safari

Alternatives to Chrome and Safari are no longer just about search engines. Today the game is about privacy, data control and self-hosting possibilities, with implications far beyond simple browsing.

→
Jul 03 2026
Altro

Portugal releases Amalia, a 9B-parameter national LLM

The Portuguese government has released Amalia, a 9 billion-parameter Large Language Model under an Apache 2.0 license. Available in SFT and DPO variants, it aims to strengthen the country's digital sovereignty. The lack of coding benchmarks doesn't hinder its on-premise deployment potential, especially for Portuguese-language workloads.

→
Jul 03 2026
Frameworks

Vulkan 1.4.356 Welcomes Microscaling MX Formats for Machine Learning Inference

The latest Vulkan update introduces the VK_EXT_shader_ocp_microscaling_types extension, enabling Microscaling MX data types promoted by the Open Compute Project. A move aimed squarely at machine learning workloads, offering a new lever for those developing and deploying models locally.

→
Jul 03 2026
Altro

Europe tightens rules on loot boxes: a signal for on-premise AI

European regulators are targeting loot boxes in video games, potentially costing the industry billions. This is part of a broader regulatory push around data and AI. For companies running LLMs on-premise, data sovereignty and infrastructure control become critical to stay compliant without stifling innovation.

→
Jul 03 2026
Frameworks

The Hidden Complexity of PyTorch Testing: Why On-Premise LLM Deployments Depend on It

Dynamically generated tests, OpInfos, and CI sharding aren't just for contributors: for self-hosted LLM operators, understanding how PyTorch validates operators and devices is key to reducing regression risks and speeding up production debugging.

→
Jul 03 2026
LLM

Mistral releases Leanstral 1.5: formal verification with 6 billion active parameters

Mistral has released Leanstral 1.5, an Apache 2.0-licensed LLM focused on formal verification. With only 6 billion active parameters out of 119 billion total, it achieves state-of-the-art results on miniF2F, PutnamBench and FATE, and discovered 5 bugs across 57 real-world repositories. Its small footprint opens up on-premise deployment scenarios for those who cannot expose code to cloud services.

→
Jul 03 2026
Market

SAP freezes hiring and travel to fund its AI pivot

The German enterprise software giant is cutting operational costs to redirect cash into artificial intelligence projects. The move highlights competitive pressure in the enterprise AI space and reignites debate on deployment models, especially in Europe where data sovereignty and on-premise architectures remain critical.

→
Jul 03 2026
Market

European tech investments: chips, quantum and the path to computational sovereignty

June saw more but smaller funding rounds across Europe. Openchip raised 115 million for semiconductors, IQM became the first European quantum company to list in the US. AI-RADAR analysis on what this means for those adopting on-premise stacks and self-hosted LLMs.

→
Jul 03 2026
Altro

Netherlands adopts software-first strategy for military drones in multimillion-euro Intelic partnership

The Dutch Ministry of Defence has signed a multimillion-euro partnership with Intelic to build a software architecture that ensures drones are interoperable from the start. It marks a paradigm shift: instead of buying platforms first and fixing integration later, software becomes the bedrock to connect aerial and ground systems from different manufacturers, drawing directly on feedback from the Ukrainian frontline where NEXUS is already in use.

→
← Previous Page 17 / 160 Next →