Topic / Trend Rising

AI Infrastructure, Hardware & Geopolitics

The intense global competition for AI hardware, including GPUs, memory, and advanced packaging, is driving massive investments and shaping geopolitical dynamics. This trend also highlights the increasing energy demands and supply chain challenges for AI data centers.

Detected: 2026-05-17 · Updated: 2026-05-17

Related Coverage

2026-05-17 Phoronix

FluidX3D 3.7: New Horizons for Computational Fluid Dynamics with OpenCL

FluidX3D, the computational fluid dynamics (CFD) software accelerated by CPU and GPU via OpenCL, has reached version 3.7. This update introduces significant performance enhancements, solidifying its position as a key tool for complex simulations leve...

#Hardware #LLM On-Premise #DevOps
2026-05-16 DigiTimes

Adlink's Focus on Physical AI: Robotics, Healthcare, and Semiconductors

Adlink is focusing on physical AI, integrating AI directly into tangible systems for critical sectors like robotics, healthcare, and semiconductors. This approach demands edge and on-premise solutions to ensure low latency, data sovereignty, and reli...

#Hardware #LLM On-Premise #DevOps
2026-05-16 DigiTimes

Taiwan chipmakers quietly fill gaps left by Korea's HBM push

The global semiconductor market sees Taiwanese chipmakers, such as Nanya, stepping up High Bandwidth Memory (HBM) production. This move aims to fill supply gaps left by a stronger Korean focus on other areas, ensuring a crucial supply for next-genera...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-16 DigiTimes

AI Fuels Networking Infrastructure Demand: Cisco and Taiwan Suppliers

The accelerated adoption of artificial intelligence, particularly Large Language Models, is driving a surge in orders for networking infrastructure providers. Cisco, a key player in the sector, is experiencing significant growth, benefiting the Taiwa...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-16 Tom's Hardware

Texas County Bans AI Data Centers: Senator Challenges Legality

A Texas county has imposed a one-year ban on data centers in rural areas, a move that follows the relocation of AI infrastructure to remote locations to circumvent regulations. The decision, however, is challenged by a state senator who questions its...

#Hardware #LLM On-Premise #DevOps
2026-05-16 Tom's Hardware

Fiber Optic Demand for AI Data Centers Explodes: One-Year Delivery Delays

AI-dedicated data centers demand 36 times more fiber optic cabling than standard server configurations. This surge in demand, coupled with a severe glass shortage, is causing cable delivery lead times to stretch up to a full year. This presents a sig...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-16 Tom's Hardware

RTX 5090 and MacBook: The Potential of eGPUs for Intensive Workloads

A recent test demonstrated the capability of an RTX 5090 GPU, connected via an eGPU dock to an M-series MacBook, to handle extremely intensive graphical workloads. The experiment, which saw the system run Cyberpunk 2077 at over 100 FPS with max setti...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-16 DigiTimes

Rising AI Server Demand Fuels Growth in Infrastructure Component Market

The surge in demand for artificial intelligence servers is generating significant revenue growth for manufacturers of infrastructure components, such as server rack rail kits. This trend highlights an acceleration in physical infrastructure investmen...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 TechCrunch AI

The AI Energy Wave: Lake Tahoe and Rising Costs

The escalating energy demand driven by artificial intelligence is beginning to manifest in significant price increases, as highlighted by the situation in Lake Tahoe. This popular Silicon Valley destination is bracing for higher electricity prices, a...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 DigiTimes

Agentic AI Accelerates Server Market: Nearly 20 Million Units by 2026

The global server market is poised for significant growth, with shipments projected to approach 20 million units by 2026. This expansion is driven by the increasing adoption of Agentic AI, which demands robust and dedicated infrastructure. DIGITIMES'...

#Hardware #LLM On-Premise #DevOps
2026-05-15 Phoronix

Vulkan 1.4.352: NVIDIA Introduces Cooperative Matrix Support, AI Impact

The latest revision of the Vulkan specification, version 1.4.352, includes an important proprietary NVIDIA extension: VK_NV_cooperative_matrix_decode_vector. This new feature aims to optimize matrix operations, which are fundamental for artificial in...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 Tom's Hardware

xAI: Colossus 1 Reallocated for Inference, Colossus 2 to Focus on Blackwell

xAI's Colossus 1 supercomputer, initially intended for Grok's training, has been reallocated for inference workloads by Anthropic due to its inefficient mixed-architecture design. Meanwhile, Elon Musk is preparing Colossus 2, a new infrastructure bas...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 DigiTimes

Market Dynamics: AI Servers Squeeze ODM Margins as Consignment Gains Traction

The AI server market is experiencing intense demand, but the complexity and high cost of components are pressuring Original Design Manufacturer (ODM) margins. Concurrently, the consignment model is gaining traction, influencing hardware procurement s...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 The Next Web

Iceotope Secures $26M: Liquid Cooling Becomes Crucial for AI

Iceotope, a British company specializing in precision liquid cooling, has closed a $26 million Series B funding round. The investment, led by Barclays Climate Ventures and Two Seas Capital, aims to expand the company's product line and patent portfol...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 The Next Web

Samsung's Labor Dialogue: Reflections on the Tech Supply Chain

Samsung Electronics has reopened dialogue with its main union, removing preconditions for negotiations. Discussions could resume on June 7, following the conclusion of an 18-day strike. This development, while concerning industrial relations, highlig...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 DigiTimes

Energy Crisis and RE100: Taiwan Risks Global Tech Orders

Ping Cheng, Chairman of Delta Electronics, has warned about potential delays in Taiwan's adherence to the RE100 initiative. A shortage of green power could jeopardize the island's ability to meet sustainability commitments, risking its crucial positi...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 DigiTimes

Nvidia Vera Rubin: Issues Reportedly Cleared, Production Ramp for 3Q26

Nvidia has reportedly resolved issues concerning its upcoming Vera Rubin platform, with the supply chain aiming for a production ramp-up in the third quarter of 2026. This timeline is crucial for enterprises planning on-premise AI infrastructures, im...

#Hardware #LLM On-Premise #DevOps
2026-05-15 DigiTimes

AAEON: AI Wave Fuels Growth and Orders, Strategy to 2026

AAEON, a hardware solutions provider, is experiencing a significant increase in orders, driven by growing demand in the artificial intelligence sector. This trend is part of a strategic growth plan the company has outlined until 2026. The expansion r...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 LocalLLaMA

China's Modded GPUs: The Quest for Extra VRAM in On-Premise LLM Deployments

A growing interest surrounds modded GPUs from China, such as RTX 4090 variants with 48GB of VRAM, for on-premise AI. While offering increased memory crucial for Large Language Models, a significant lack of reliable information in English raises criti...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 DigiTimes

Trump-Xi Summit: Implications for Nvidia and the Global AI Silicon Market

A potential summit between former US President Donald Trump and Chinese President Xi Jinping could redefine Nvidia's access to the Chinese market. This scenario highlights how geopolitical dynamics influence the AI hardware supply chain, with direct ...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 DigiTimes

Nvidia H200 Sales to China Slow Despite US Approval

Despite approval from US authorities, sales of Nvidia H200 GPUs in China are facing significant slowdowns. This scenario emerges within a context of geopolitical tensions and trade restrictions that impact the availability of critical hardware for ar...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 DigiTimes

Auras: No Operational Impact from Nvidia Vera Rubin Changes, Revenue Jumps

Auras announced that modifications to the Nvidia Vera Rubin project will not affect its operations. The company reported a significant increase in revenue and profit, highlighting the resilience of supply chains in the AI hardware sector. Decisions o...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 DigiTimes

Pan-International's Strategic Shift Towards AI Servers and AFM Motors

Pan-International has announced a significant strategic reorientation, focusing on AI servers and AFM motors to generate over half of its revenue by 2030. This move highlights a clear direction towards high-growth sectors, with notable implications f...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 DigiTimes

AI Era Reshapes SMIC's Priorities: More Investment, Fewer Dividends

SMIC, a key player in the semiconductor industry, is reorienting its financial strategy. The company has decided to prioritize capital investments over dividend distribution. This move is a direct response to the growing "AI boom," which is profoundl...

#Hardware #LLM On-Premise #DevOps
2026-05-15 DigiTimes

Hua Hong Semiconductor's Strategy: AI Demand and Specialty Tech Expansion

Hua Hong Semiconductor is shifting its strategy towards the growing demand for artificial intelligence and the expansion of specialized technologies. This move reflects the evolving semiconductor market, where the need for optimized silicon for AI wo...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 DigiTimes

Foxconn Forecasts More Than Double Annual AI Server Shipments

Foxconn anticipates annual shipments of AI servers to more than double, signaling robust demand for dedicated AI infrastructure. The company attributes this growth to a strategic combination of a diverse "AI server mix" and an optimized "consignment ...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 DigiTimes

AI Servers and PCB Evolution: An Imperative for On-Premise Infrastructure

The acceleration of AI servers is driving the industry towards increasingly advanced PCB technologies. This development is crucial for those managing Large Language Models (LLM) workloads on-premise, directly impacting processing capacity, thermal ma...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 DigiTimes

Foxconn: AI Servers Drive 63% Operating Profit Jump, Offsetting Seasonal Dips

Foxconn reported a 63% increase in operating profit, a significant achievement highlighting the growing demand for AI-dedicated infrastructure. The strong expansion in the AI server segment enabled the company to offset seasonal downturns in other ar...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 DigiTimes

Nan Ya PCB Targets High-End IC Substrate Growth Amid AI Demand

Nan Ya PCB is increasing its production of high-end integrated circuit (IC) substrates, responding to the growing demand from the artificial intelligence market. This strategic move underscores the importance of advanced hardware components in suppor...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-15 DigiTimes

AI, Lasers, and Autonomous Satellites: The New Space Arms Race

Global strategic competition is extending into space, where artificial intelligence, laser systems, and autonomous satellites are redefining defense and security dynamics. This scenario imposes new technological and operational challenges, with a gro...

#Hardware #LLM On-Premise #DevOps
2026-05-15 DigiTimes

Indium Phosphide Semiconductors: New Horizons for AI Power and Bandwidth

Indium Phosphide (InP) compound semiconductors are emerging as a promising technology to overcome current power and bandwidth limitations in AI hardware. This innovation could redefine architectures for Large Language Model (LLM) inference and traini...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 Ars Technica AI

Lake Tahoe Energy Crisis: Data Centers Prioritized Over Residents

Lake Tahoe residents face an impending energy crisis as supplier NV Energy will cease provision by May 2027. This decision stems from the increasing power demand for new data centers in Nevada, projected to require 5,900 megawatts by 2033, highlighti...

#Hardware #LLM On-Premise #DevOps
2026-05-14 Tom's Hardware

AMD Radeon RX 7800 XT: Driver and Fans, a Thermal Management Issue

Users of AMD Radeon RX 7800 XT GPUs are reporting a fan management issue following a recent driver update. The Zero RPM feature, designed to silence the card under low load, appears to be causing unexpected temperature increases. This raises question...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 TechCrunch AI

Cerebras' $5.5B IPO Shakes Up the AI Market in 2026

Cerebras marked the first major tech IPO of 2026, raising $5.5 billion and seeing its stock surge by 108%. This unexpected success, just a year after its prospects seemed dim, highlights growing investor confidence in the AI hardware sector and high-...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 Tom's Hardware

AMD FSR 4 Upscaling Officially Released for Radeon RX 7000 and 6000 Series

AMD has officially announced FidelityFX Super Resolution 4 (FSR 4), its upscaling technology for Radeon RX 7000-series (RDNA 3 architecture) and 6000-series (RDNA 2) graphics cards. This innovation aims to improve visual quality and performance, leve...

#Hardware #LLM On-Premise #DevOps
2026-05-14 Phoronix

AMD: Progress in Linux Enablement for Next-Gen AIE4 NPU

AMD is making significant strides in integrating its next-generation AIE4 NPU platform into the Linux kernel via the AMDXDNA accelerator. The company's software engineers have been working on these crucial hardware support patches since March. While ...

#Hardware #LLM On-Premise #DevOps
2026-05-14 TechCrunch AI

Wirestock Secures $23M to Fuel AI Models with Multimodal Data

Wirestock has raised $23 million in funding to expand its platform, which supplies multimodal data—photos, videos, and 3D content—to AI labs and companies developing artificial intelligence solutions. With over 700,000 creators, the company positions...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 Tech.eu

Iceotope Raises $26M for AI Infrastructure Cooling

Iceotope Group, a leader in precision liquid cooling solutions, has closed a $26 million Series B funding round. The investment, led by Two Seas Capital and Barclays Climate Ventures, will support the development of critical technologies for AI infra...

#Hardware #LLM On-Premise #DevOps
2026-05-14 Phoronix

AMDGPU Driver Update: Linux 7.2 Prepares for HDMI 2.1 FRL

A new pull request for AMDGPU/AMDKFD drivers has been submitted for integration into the Linux 7.2 kernel, specifically within the DRM-Next staging area. This crucial update introduces FRL (Fixed Rate Link) register headers, a fundamental step toward...

#Hardware #LLM On-Premise #DevOps
2026-05-14 The Next Web

Samsung: Strike Looms, AI Memory Chips at Risk

Samsung Electronics' largest union is preparing an 18-day strike, threatening the supply of crucial AI memory chips. The wage dispute and bonus formula are at the heart of the conflict, which could have significant repercussions on the global AI hard...

#Hardware #LLM On-Premise #DevOps
2026-05-14 The Next Web

SK Hynix Nears Trillion-Dollar Valuation Driven by AI Memory Demand

SK Hynix is on the verge of reaching a trillion-dollar market capitalization, having grown ninefold in the past two years. This milestone, fueled by the surging demand for AI memory, would make South Korea the first country outside the United States ...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 DigiTimes

TSMC Boosts AI Chip Production: CoWoS and SoIC Expansion

TSMC, the leading semiconductor manufacturer, is significantly increasing its production capacity for advanced packaging technologies, CoWoS and SoIC. This strategic move responds to the surging demand for AI accelerators, particularly for Large Lang...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 DigiTimes

Taiwan's MPI: AI Chip Boom Fuels Record Growth in Testing

The explosion in demand for artificial intelligence chips is driving MPI, a Taiwanese semiconductor testing firm, to record growth. This phenomenon highlights the crucial role of testing in ensuring the reliability and performance of AI silicon. For ...

#Hardware #LLM On-Premise #DevOps
2026-05-14 DigiTimes

Taiwan Panel Industry Transforms with AI and MicroLED Optical Communications

Taiwan's panel industry is undergoing a profound transformation, driven by the artificial intelligence wave. This strategic shift is redirecting its focus towards the development of microLED-based optical communications, an evolution poised to redefi...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 The Next Web

700°C Memristor: Tetramem's Breakthrough for AI in Extreme Environments

A startup is developing AI chips based on memristors capable of operating at extreme temperatures, up to 700 degrees Celsius. This innovation promises to extend artificial intelligence computing capabilities into contexts inaccessible to traditional ...

#Hardware #LLM On-Premise #DevOps
2026-05-14 DigiTimes

Japan Bolsters Legacy Chip Supply Chain: Impact on On-Premise AI

Japan is intensifying efforts to secure its legacy chip supply chain. This strategic move is crucial not only for traditional industries but also for ensuring stability and predictability in on-premise AI deployments, where the availability of reliab...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 DigiTimes

TSMC: AI Expansion Drives Demand for Advanced Packaging

During its recent symposium, TSMC highlighted the significant expansion of AI and the increasing demand for advanced packaging solutions. This trend underscores the critical importance of sophisticated integration technologies to support the computat...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 DigiTimes

TSMC's Optimistic Outlook for AI's Future: The Keyword is 'COUPE'

A TSMC executive expresses a positive vision for the future of artificial intelligence, highlighting the importance of an innovative approach summarized by the keyword "COUPE." This perspective underscores the crucial role of silicon advancements in ...

#Hardware #LLM On-Premise #DevOps
2026-05-14 DigiTimes

Tower Semiconductor: $1.3 Billion for Silicon Photonics Amid AI Acceleration

Tower Semiconductor has secured $1.3 billion in commitments for silicon photonics, addressing the accelerating demand for advanced artificial intelligence solutions. This technology is crucial for enhancing interconnects and data transfer speeds in d...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 DigiTimes

AI Surge Fuels Patent Race in Server Cooling

The explosion of artificial intelligence is catalyzing an innovation race in server cooling. Taiwanese firms are emerging as global leaders in this competition to develop efficient solutions. This phenomenon underscores the growing importance of phys...

#Hardware #LLM On-Premise #DevOps
2026-05-14 DigiTimes

China's Fiber Optic Evolution: From Follower to Global Supply Chain Pillar

China's fiber optic industry has undergone a significant transformation, evolving from a technology follower to a global-scale supplier. This shift has profound implications for the worldwide technology supply chain, affecting the availability and co...

#Hardware #LLM On-Premise #DevOps
2026-05-14 DigiTimes

Semiconductors: Asian Workforce Dynamics and On-Premise AI Challenges

Recent labor tensions at Samsung highlight the differing semiconductor workforce dynamics between Taiwan and South Korea. These differences impact global supply chain stability, directly affecting the availability and Total Cost of Ownership (TCO) of...

#Hardware #LLM On-Premise #DevOps
2026-05-14 DigiTimes

Pegatron: Q1 2026 Earnings Decline, AI PC Demand Fuels Recovery

Pegatron reported a significant decline in earnings for Q1 2026, attributed to an off-season period. However, the Taiwanese company anticipates a strong recovery in Q2, driven by accelerating demand for new "AI PCs." This trend highlights the growing...

#Hardware #LLM On-Premise #DevOps
2026-05-14 DigiTimes

Swancor: AI Robotics and Aerospace Technology for Business Growth

Swancor, a company in the composite materials sector, is integrating AI-powered robotics and aerospace-derived technologies to optimize its operations and boost revenue. This strategy highlights a growing trend towards adopting on-premise and edge AI...

#Hardware #LLM On-Premise #DevOps
2026-05-14 DigiTimes

Wieson Eyes 2Q26 Recovery Driven by New Strategic Initiatives

Wieson, a player in the technology landscape, anticipates a significant recovery in the second quarter of 2026. This forecast is supported by the increasing traction of its new business lines. Analyzing such dynamics is crucial for understanding mark...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 DigiTimes

Etron's Robotics Ventures Gain Traction as Memory Market Shifts

Etron is consolidating its investments in the robotics sector, a strategic area showing significant progress. This development coincides with a turning point in the memory market cycle, suggesting new opportunities and synergies. For companies evalua...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 DigiTimes

ASMedia Reports Record Profit, Strategic Expansion into AI and Automotive

ASMedia has reported record profits, signaling a significant strategic expansion beyond the PC chip market. The company is now targeting the artificial intelligence and automotive sectors, diversifying its product portfolio and positioning itself in ...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 DigiTimes

OpenAI and Cerebras: The Move Reshaping the AI Supply Chain

OpenAI is exploring new strategic partnerships, such as with Cerebras, to diversify its AI supply chain. This move highlights a growing industry trend towards seeking alternative hardware solutions to traditional GPU clusters, with significant implic...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 DigiTimes

Foxconn: AI Server Orders and Co-Packaged Optics in Focus

Foxconn is preparing for a key investor briefing, where clarifications are expected regarding AI server orders and the commercialization of co-packaged optics (CPO). The meeting will outline the manufacturing giant's strategy in the growing artificia...

#Hardware #LLM On-Premise #DevOps
2026-05-14 DigiTimes

Lam Research Accelerates in Taiwan: Over 1,000 Engineers for AI Chips

Lam Research, a key supplier in the semiconductor industry, has announced plans to hire over 1,000 engineers in Taiwan. This strategic move responds to the growing global demand for AI-dedicated chips, highlighting the region's importance for the pro...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 Phoronix

Valve Extends Open-Source Driver Support for Older AMD GCN GPUs

Timur Kristóf from Valve continues to enhance open-source Linux graphics drivers for AMD GCN 1.0/1.1 cards. The latest addition introduces support for DRM format modifiers, extending the lifespan of hardware like the Radeon HD 7000 series and offerin...

#Hardware #LLM On-Premise #DevOps
2026-05-14 DigiTimes

Microloops Reports Record Profit as AI Server Cooling Drives Growth

Microloops has announced an unprecedented quarter of profits, a result attributed to the growing demand for cooling solutions for artificial intelligence servers. This success highlights the critical importance of physical infrastructure in supportin...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-14 DigiTimes

Zhang Rujing's Warning: The 2nm Race Is Not the Only Path for Semiconductors

Zhang Rujing, founder of SMIC and a prominent figure in China's semiconductor industry, has issued a warning against an excessive focus on 2-nanometer process nodes. His perspective suggests that innovation in the sector should not be limited solely ...

#Hardware #LLM On-Premise #DevOps
2026-05-14 DigiTimes

Tesla Ramps Up AI, Robotaxi, and Chip Investments for New Growth Phase

Tesla is increasing its investments in artificial intelligence, Robotaxi development, and custom chip production. This strategic move aims to consolidate control over the entire technology pipeline, optimize performance, and reduce long-term costs. T...

#Hardware #DevOps
2026-05-13 TechCrunch AI

xAI and Gas Turbines: The Energy Challenges of AI Data Centers

xAI's Colossus 2 data center in Mississippi is at the center of a legal dispute over its use of nearly 50 "mobile" gas turbines as a power source. This case highlights the complex infrastructure challenges and massive energy requirements companies fa...

#Hardware #LLM On-Premise #DevOps
2026-05-13 Tom's Hardware

JSR Strengthens EUV Supply Chain: New Plant in Taiwan Near TSMC

Japanese chemical giant JSR is expanding its EUV photoresist production in Taiwan, strategically locating near TSMC. This move aims to fill a critical gap in the supply chain for EUV materials, which are essential for advanced wafer production and sc...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-13 The Next Web

Fractile Raises $220M for In-Memory Compute Inference Chip Production

London-based startup Fractile has secured $220 million in funding, led by Accel, with Pat Gelsinger joining as an angel investor. The capital will be used to bring its innovative inference chips, which integrate compute and memory on the same die, in...

#Hardware #LLM On-Premise #DevOps
2026-05-13 Tech.eu

Fractile Raises $220 Million to Overcome AI Inference Bottleneck

UK startup Fractile has closed a $220 million Series B round to develop next-generation inference hardware. The company aims to resolve the growing bottleneck related to the time and cost of producing useful outputs at scale for Large Language Models...

#Hardware #LLM On-Premise #DevOps
2026-05-13 Phoronix

Intel Boosts Compute Runtime: New Features for Xe3P and Nova Lake P

Intel has released a new version of its open-source Compute Runtime, version 26.18.38308.1. The update extends OpenCL and Level Zero support across the company's integrated and discrete graphics hardware, introducing Xe3P enablement and support for f...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-13 DigiTimes

Ajinomoto: 30% Price Hike for ABF Substrates, Impact on AI Supply Chain

Ajinomoto has announced a 30% price increase for its ABF substrate films, critical components for high-performance chip packaging. This move, reported by DIGITIMES, could have significant repercussions on AI hardware costs, impacting on-premise deplo...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-13 DigiTimes

Inventec Forecasts Strong AI and General-Purpose Server Demand Through 2028

Inventec, a key hardware supplier, anticipates robust and sustained demand for both artificial intelligence servers and general-purpose systems. This forecast extends through 2028, indicating continued growth in the IT infrastructure market. The tren...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-13 DigiTimes

Taiwan's Chinsan Secures AI Server Capacity in Thailand Through 2026

Chinsan, a Taiwanese capacitor manufacturer, has secured AI server production capacity in Thailand until 2026. This move highlights the increasing demand for essential hardware components for AI infrastructure and companies' strategies to secure thei...

#Hardware #LLM On-Premise #DevOps
2026-05-13 DigiTimes

Rising Memory Costs: Pressure Intensifies on AI Server ODM Margins

The escalating cost of memory is squeezing the margins of AI server Original Design Manufacturers (ODMs). This market dynamic, highlighted by DIGITIMES, has significant repercussions on the Total Cost of Ownership (TCO) for enterprises evaluating on-...

#Hardware #LLM On-Premise #DevOps
2026-05-13 DigiTimes

AI Demand Lifts Zhen Ding: Server and Chip Substrate Sales Surge

Zhen Ding, a key electronics supplier, is experiencing significant growth in server and chip substrate sales. This increase is directly linked to the surging global demand for artificial intelligence solutions. The phenomenon highlights the growing n...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-13 DigiTimes

ASPEED: AI Server Demand Drives Growth and Strengthens BMC Market Outlook

ASPEED is experiencing sustained growth, propelled by the increasing demand for artificial intelligence servers. This scenario reinforces the market outlook for Baseboard Management Controllers (BMCs), critical components for managing and monitoring ...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-13 DigiTimes

Samsung Labor Crisis: Bonus Dispute Threatens Chip Output

Talks between Samsung management and union representatives have collapsed over a bonus dispute, raising significant concerns for chip production. This impasse could have repercussions on the global supply chain, affecting the availability of crucial ...

2026-05-13 DigiTimes

China's Fiber Optic Giant Unveils World's Largest Preform for AI Data Centers

Fiberhome Telecommunication Technologies, a Chinese fiber optic leader, has announced the production of the world's largest optical preform. This innovation is strategic for supporting the increasing demand for high-capacity infrastructure required b...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-13 DigiTimes

Samsung Foundry's Resurgence: AI Chips and HBM4 Drive 4nm Demand

Samsung Foundry is experiencing a significant resurgence, driven by the increasing demand for artificial intelligence chips. The adoption of HBM4 technology and advancements in 4-nanometer manufacturing processes are key factors redefining its positi...

#Hardware #LLM On-Premise #DevOps
2026-05-13 DigiTimes

Doosan Boosts CCL Production in Thailand: Impact on Hardware Supply Chain

Doosan has announced the construction of a new CCL production plant in Thailand. This strategic move aims to diversify and strengthen the supply chain for a fundamental electronic component, with significant implications for the global hardware marke...

#Hardware #LLM On-Premise #DevOps
2026-05-13 DigiTimes

Taiwan's Semiconductor Supply Chain Sees Positive April, Driven by AI Demand

Taiwan's semiconductor supply chain reported a broadly positive April, clearly showing strong and widespread demand for artificial intelligence. This trend underscores the importance of dedicated hardware for AI workloads, with significant implicatio...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-13 DigiTimes

Acter: AI-driven orders push backlog past NT$50 billion, record Q1 results

Acter announced record first-quarter results, with an order backlog exceeding NT$50 billion. This increase is primarily driven by the growing demand for artificial intelligence solutions. The data highlights the expansion of the AI market and the imp...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-13 DigiTimes

Taiwan to Establish Industrial Parks in US Amid Deepening Bilateral Ties

Taiwan plans to establish new industrial parks in the United States, an initiative underscoring the strengthening bilateral ties between the two nations. This development carries significant implications for the global technology supply chain, partic...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-13 Wired AI

xAI Boosts Infrastructure with 19 New Gas Turbines Amidst Controversy

xAI, Elon Musk's company, is expanding its power infrastructure at the Colossus 2 site, adding 19 new portable gas turbines. This move occurs amidst an ongoing legal dispute over air quality, raising questions about the environmental implications and...

#Hardware #LLM On-Premise #DevOps
2026-05-13 DigiTimes

Moore Threads and Lightwheel.ai: A New China-Made AI Stack for Embodied AI

Moore Threads, a Chinese GPU company, is developing a new embodied AI stack in collaboration with Lightwheel.ai. The initiative aims to create a complete, entirely China-made AI solution, encompassing both hardware and software. This project highligh...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-13 DigiTimes

5G and Enterprise ICT Acceleration: Impacts on On-Premise AI Infrastructure

Recent positive performance in Taiwan's telecommunications sector, driven by 5G migration and enterprise ICT momentum, highlights global trends profoundly influencing Large Language Model deployment strategies. This scenario underscores the increasin...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 Ars Technica AI

AI at Home: SPAN Proposes Distributed Data Centers

San Francisco startup SPAN is piloting an innovative solution for AI compute deployment. The project involves installing thousands of XFRA nodes, small data centers equipped with liquid-cooled Nvidia RTX Pro 6000 Blackwell Server Edition GPUs, direct...

#Hardware #LLM On-Premise #DevOps
2026-05-12 TechCrunch AI

Google and SpaceX in talks to put data centers into orbit for AI compute

Google and SpaceX are reportedly in discussions to explore the feasibility of building data centers in space. This initiative aims to position Earth's orbit as a future frontier for AI computing, despite current costs remaining significantly higher t...

#LLM On-Premise #DevOps
2026-05-12 Tom's Hardware

Jensen Huang Excluded from Presidential Delegation to China

Jensen Huang, CEO of Nvidia, was not part of the U.S. presidential delegation for the state visit to China, unlike other tech leaders such as Apple's Tim Cook and Elon Musk. This absence raises questions about diplomatic dynamics and the role of key ...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 IEEE Spectrum

Your Next AI Query: Where Power Is Most Accessible

The AI industry is exploring new strategies to manage the growing energy demands of data centers. Nvidia and its partners are developing a pilot project for distributed micro data centers, strategically located near utility substations. The goal is t...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 DigiTimes

The AI Infrastructure Wave: Taiwan at the Heart of the Global Supply Chain

The Taiwanese industry is capitalizing on the explosion in demand for artificial intelligence infrastructure, from substrates to servers. This phenomenon highlights the growing need for robust hardware components to support LLM workloads, with signif...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 DigiTimes

US-China Talks: AI at the Core of Rare Earths and Tariff Tensions

Recent trade negotiations between the United States and China highlight the growing interconnection between geopolitics and technology. Discussions focus on rare earths, tariffs, and, notably, the future of artificial intelligence. These factors dire...

#Hardware #LLM On-Premise #DevOps
2026-05-12 DigiTimes

BTL Group Ramps Up AI Server Testing Amid Sustained Demand

BTL Group is accelerating testing for its AI-dedicated servers, responding to an order volume extending through September. This activity highlights the increasing demand for robust, self-hosted AI infrastructure, as enterprises seek on-premise soluti...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 The Next Web

Jensen Huang of Nvidia Absent from US Delegation to China

Jensen Huang, CEO of Nvidia, will not participate in the US business delegation to China led by President Trump. The mission, which will include figures such as Apple's Tim Cook and Tesla's Elon Musk, will focus on sectors such as agriculture, manufa...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 DigiTimes

SK Hynix Bolsters AI Supply Chain with Strategic Silicon Valley Acquisition

SK Hynix has reportedly acquired property in Silicon Valley, a move that underscores the increasing importance of high-performance memory for artificial intelligence. This operation aims to consolidate the supply chain for crucial components, such as...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 DigiTimes

Applied Materials and TSMC: A Strategic Partnership for AI Chips

Applied Materials and TSMC have announced a collaboration at the EPIC Center to accelerate the development of chips dedicated to artificial intelligence. This initiative aims to optimize manufacturing processes and foundational technologies, with sig...

#Hardware #LLM On-Premise #DevOps
2026-05-12 The Next Web

Nscale Secures $790 Million for Narvik AI Data Center

Nscale, an AI infrastructure company, has secured $790 million in financing to continue building its dedicated AI data center in Narvik, northern Norway. This operation underscores the importance of investing in physical infrastructure to support AI ...

#Hardware #LLM On-Premise #DevOps
2026-05-12 DigiTimes

Taiwan's AI Server Market Growth Extends Beyond TSMC

Taiwan's AI server market is experiencing significant expansion, with benefits spreading beyond TSMC's established role. This diversification signals a maturing local supply chain, offering new opportunities for companies seeking robust hardware solu...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 DigiTimes

Component Lead Times: Impact on Viking AI's Revenue Growth

Viking AI reports a 12% revenue increase, yet the industry faces significant challenges. Lead times for resistors have extended to 15 weeks, highlighting growing pressures on the electronic component supply chain. This situation can impact the availa...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 DigiTimes

Taiwan's AI Testing Boom: KYEC, MPI, and WinWay Eye Record 2026 Revenue

Taiwanese companies KYEC, MPI, and WinWay are poised to achieve record revenues by 2026, driven by the surging demand in the artificial intelligence testing sector. This trend underscores the critical importance of rigorous validation for AI infrastr...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 DigiTimes

Taiwan Thermal Firms Ride AI Server Boom, Leading Growth Until 2026

The surging demand for high-performance AI servers is fueling a boom for Taiwanese companies specializing in thermal solutions. By 2026, firms like AVC and Auras are projected to lead significant market expansion, addressing the critical need for eff...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 DigiTimes

Nvidia and Corning Strengthen Partnership: Fiber Optics at the Core of AI

Nvidia is deepening its partnership with Corning, focusing on fiber optics for AI infrastructure. This transition from copper to optical silicon is crucial to support the growing bandwidth and latency demands of Large Language Models (LLMs) and AI ap...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 DigiTimes

Nvidia's Modular AI Strategy Boosts Supply Chain: The Delta Electronics Case

Nvidia's modular approach to developing AI hardware solutions is significantly boosting its suppliers. Delta Electronics, in particular, is benefiting from this strategy, highlighting how the demand for specific AI components is reshaping the supply ...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 LocalLLaMA

Custom Cooling for DGX: An On-Premise Approach for High-Performance LLMs

A user demonstrated an open-loop tap water cooling method for a DGX system, keeping GPUs below 68°C at 95% utilization. The setup handles a Qwen3.5-122b-a10B LLM with Q6_K precision, utilizing 110 GB of memory and an 80k context window, achieving 18....

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 DigiTimes

Arm's AGI CPU Demand Surges Amid Looming Supply Constraints

Demand for Arm-based CPUs dedicated to Artificial General Intelligence (AGI) workloads is experiencing a significant surge, raising concerns about potential supply chain constraints. This situation highlights the infrastructural challenges companies ...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 DigiTimes

Compeq Emerges as Key Supplier in AI and Low-Orbit Satellite Boom

Compeq is positioning itself as a pivotal player in the supply chain for the rapidly expanding artificial intelligence and low-orbit satellite sectors. The company benefits from the increasing demand for advanced components, which are essential for s...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 DigiTimes

Southeast Asia Positions Itself as a Strategic Hub for AI Semiconductors

The semiconductor industry in Southeast Asia is strategically shifting its focus towards producing critical components for artificial intelligence. This transition positions the region as a fundamental strategic hub, with significant implications for...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-12 Phoronix

Open Source Radeon R300-R500 Driver: Code Restructuring Coming in 2026

The open-source "R300g" driver for ATI (AMD) Radeon R300 and R500 series GPUs, dating back over two decades, is set to receive a significant code restructuring in 2026. This effort, led by a single community developer, highlights the longevity and de...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 Phoronix

Vulkan 1.4.351: New Extensions for High-Performance Graphics and Compute

The Vulkan API has been updated to version 1.4.351, introducing six new extensions that enhance its capabilities. Among the novelties, a significant improvement for ray-tracing stands out, reinforcing Vulkan's role as a crucial interface for graphics...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 Tom's Hardware

AMD Reportedly Developing Entry-Level RDNA 4 GPU with 8GB VRAM and 2048 Cores

Rumors suggest AMD is preparing an entry-level RDNA 4 GPU, the RX 9050, featuring 8GB of VRAM and 2048 cores. This potential addition to the Radeon lineup could offer new options for lighter AI workloads and on-premise deployments, balancing cost and...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 Phoronix

AMD Boosts AMDGPU Linux Driver with HDMI 2.1 and DSC Support

AMD has released significant updates for its AMDGPU kernel driver on Linux, introducing support for HDMI 2.1 Fixed Rate Link (FRL) and Display Stream Compression (DSC). These enhancements enable higher resolutions and refresh rates, solidifying the o...

#Hardware #LLM On-Premise #DevOps
2026-05-11 Phoronix

Intel IGC 2.34.4 Compiler Brings New Improvements for Graphics and Compute

The Intel Graphics Compiler IGC 2.34.4 has been released, introducing significant improvements. Essential for the Intel Compute Runtime, it supports Level Zero and OpenCL for acceleration on Intel graphics hardware. This version is also crucial for c...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 Tom's Hardware

Intel and SK Hynix: Packaging Agreement for HBM Integration

Intel and SK Hynix shares surged following reports of a potential strategic chip packaging partnership. The collaboration would involve SK Hynix testing Intel's 2.5D EMIB technology for High Bandwidth Memory (HBM) integration. This move highlights th...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 Tom's Hardware

AI Data Centers: The Rural Strategy to Bypass Constraints and Bureaucracy

AI data center development is shifting towards rural areas. This strategic choice allows companies to bypass complex urban bureaucratic processes, such as city council approvals and land-use reviews, while also reducing public scrutiny. A significant...

#LLM On-Premise #DevOps
2026-05-11 Wired AI

CUDA: Nvidia's True Competitive Advantage Beyond Hardware

Nvidia is often perceived as a leader in GPU hardware, but its true strength lies in software. The CUDA framework creates a robust ecosystem that solidifies its position in the AI market, profoundly influencing deployment strategies, especially for o...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 The Next Web

GPUaaS and AI Sovereignty in Europe: An Illusion to Address

Europe is investing billions in AI development, but the expanding access to GPUs through cloud platforms and GPU-as-a-service (GPUaaS) raises questions about true technological sovereignty. While increasing compute capacity is crucial for AI developm...

#Hardware #LLM On-Premise #DevOps
2026-05-11 DigiTimes

Delta Electronics: Sustained Growth Driven by AI and Liquid Cooling

Delta Electronics is experiencing a period of strong growth, propelled by the increasing demand for artificial intelligence solutions and the expansion of the liquid cooling market. These trends reflect the evolution of IT infrastructures, where ther...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 DigiTimes

AI Data Center Spending Frenzy Ignites Cooling Demand

The surge in investments in AI-dedicated data centers is creating unprecedented demand for advanced cooling solutions. This phenomenon highlights the infrastructural challenges associated with deploying Large Language Models and other AI workloads, w...

#Hardware #LLM On-Premise #DevOps
2026-05-11 DigiTimes

India's Chip Dream: Lam Research Looks Beyond Fabs

Lam Research, through its Managing Director Rangesh Raghavan, emphasizes the importance of a holistic approach to India's "chip dream," extending beyond mere factory construction. The company highlights the need to develop a complete ecosystem, inclu...

#Hardware #LLM On-Premise #DevOps
2026-05-11 The Next Web

SoftBank to Manufacture Large-Scale Batteries for AI Data Centers

SoftBank, through its mobile services subsidiary, is set to begin large-scale battery production at a former Sharp plant in Sakai, Osaka. This initiative aims to support AI data centers, targeting an annual output of one gigawatt-hour. Production, in...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 The Next Web

Microsoft-G42 Kenya Data Center Stalls Over Government Offtake Demands

A $1 billion data center project in Kenya, a partnership between Microsoft and G42, has been suspended. The halt is due to a disagreement with the Kenyan government regarding Microsoft's request for a guaranteed annual capacity offtake. Talks have br...

#Hardware #LLM On-Premise #DevOps
2026-05-11 DigiTimes

AMD and Samsung: 2nm Chip Move Challenges TSMC's AI Dominance

AMD has decided to entrust Samsung with part of its 2-nanometer chip production, a move that could have significant repercussions on the artificial intelligence semiconductor market. This strategic choice challenges TSMC's established leadership in t...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 DigiTimes

Qisda: Economic Recovery Driven by AI and Semiconductors Through 2026

Qisda anticipates significant recovery and profit rebound through 2026, driven by increasing demand in the artificial intelligence and semiconductor sectors. This outlook highlights the centrality of hardware and silicon for AI's evolution and its im...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 DigiTimes

The AI Memory Race: Samsung and On-Premise Inference Challenges

The explosion of artificial intelligence inference workloads is fueling a "memory race" among leading manufacturers. Samsung is at the forefront of this competition, developing solutions that address the growing demand for VRAM and bandwidth. This dy...

#Hardware #LLM On-Premise #DevOps
2026-05-11 DigiTimes

2D NAND Shortage and MediaTek Trading Freeze: Impact on Tech Supply Chain

The semiconductor market is experiencing significant turbulence due to two key events: a trading freeze for MediaTek in Taiwan and a worsening shortage of 2D NAND memory. These developments highlight the inherent fragilities within the global supply ...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 DigiTimes

AI Boom Drives Taiwan's Semiconductor Testing Industry to Record Growth

Taiwan's semiconductor testing industry is experiencing unprecedented expansion, driven by the global surge in demand for AI chips. This boom highlights Taiwan's pivotal role in the supply chain and emphasizes the critical need for rigorous verificat...

#Hardware #LLM On-Premise #DevOps
2026-05-11 DigiTimes

OpenAI and Chipmakers Unite to Combat AI Training Slowdowns

OpenAI and leading chip manufacturers are collaborating on a new initiative, dubbed MRC, aimed at mitigating critical slowdowns affecting artificial intelligence model training processes. This strategic move underscores the importance of optimizing b...

#Hardware #LLM On-Premise #DevOps
2026-05-11 DigiTimes

Taiwan and 6G: Three Key Sectors for the Future Connectivity Era

Taiwan is outlining its strategy for the 6G era, focusing on three key sectors that will be fundamental for the development of future communication infrastructures. This move highlights the importance of advanced connectivity to support emerging work...

#Hardware #LLM On-Premise #DevOps
2026-05-11 DigiTimes

EV Battery R&D: Taiwan-Germany Collaboration and On-Premise AI Challenges

Taiwan and Germany have extended their collaboration in electric vehicle (EV) battery research and development until 2029. While the agreement does not specify the use of artificial intelligence, it raises questions about the infrastructure implicati...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 DigiTimes

Lite-On: 25% Revenue Growth in April Driven by AI and BBU Demand

Lite-On reported a 25% year-on-year revenue increase in April. This growth is primarily attributed to strong demand for AI infrastructure power solutions and Battery Backup Units (BBUs). The data highlights the increasing impact of artificial intelli...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 DigiTimes

AI Surge: Taiwan Seeks New Sources for PCB Materials

The escalating demand for Artificial Intelligence solutions is driving a global market surge, placing significant pressure on the supply chain for essential hardware components. Taiwan, a pivotal player in technology manufacturing, is actively seekin...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 DigiTimes

Nvidia and IREN: A $2.1 Billion Alliance for 5GW AI Infrastructure

Nvidia and IREN are joining forces in a strategic initiative for large-scale AI infrastructure development, backed by a significant $2.1 billion investment. This operation highlights the growing demand for dedicated AI computational capacity and its ...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 DigiTimes

Giga Computing and South Korea's Push Towards Sovereign AI

Giga Computing, a division of Gigabyte, is orienting its strategies towards the South Korean market, particularly to support the growing demand for sovereign Artificial Intelligence solutions. This trend reflects the need for national control over da...

#Hardware #LLM On-Premise #Fine-Tuning
2026-05-11 DigiTimes

The AI Memory Squeeze: A Structural Constraint Until 2028

The artificial intelligence market faces a persistent memory shortage, particularly VRAM for GPUs, essential for Large Language Models. According to analyses, this 'squeeze' is not expected to ease before 2028, posing significant challenges for compa...

#Hardware #LLM On-Premise #DevOps
← Back to All Topics