The AI industry is exploring new strategies to manage the growing energy demands of data centers. Nvidia and its partners are developing a pilot project for distributed micro data centers, strategically located near utility substations. The goal is to optimize available power utilization and enhance operational flexibility by shifting inference workloads based on grid availability, a crucial approach for on-premise and hybrid deployments.
A recent supply chain attack campaign, dubbed 'mini Shai Hulud', has impacted the npm and AI developer ecosystems. Compromised Mistral AI and TanStack packages may have exposed sensitive credentials for GitHub, cloud environments, and CI/CD systems. The incident underscores the growing security risks within development pipelines and the importance of robust practices for data protection and sovereignty, particularly in on-premise and hybrid deployment contexts.
A Reddit case study demonstrates how it's possible to reduce the power consumption of an RTX 4090 GPU to 40% of its maximum limit during LLM Inference with `llama.cpp`, without sacrificing performance. This optimization, achieved by limiting the power limit, offers significant benefits in terms of TCO, thermal management, and hardware longevity for self-hosted deployments.
SoftBank has announced its intention to produce proprietary water-based batteries to power its AI-dedicated data centers. The goal is to achieve gigawatt-hour scale production by 2028, a strategic move to manage the high energy consumption of AI infrastructures and strengthen energy autonomy.
Google has identified an AI-developed zero-day vulnerability capable of bypassing two-factor authentication. This discovery, alongside the emergence of self-morphing malware and Gemini-powered backdoors, signals the beginning of a new era in cybercrime. Advanced automation, such as robots manufacturing robots, highlights the increasing complexity of infrastructures that require protection against these evolving threats.
Tandem Health's CEO, Lukas Saari, highlights the challenges for US competitors in the European market, driven by a growing preference for local providers, especially in healthcare. Tandem, which leverages Large Language Models for an AI clinical co-pilot, capitalizes on this trend, solidifying its position as a key player where data sovereignty and compliance are paramount for European institutions.
European Commission President Ursula von der Leyen has announced plans to extend online protections for minors, proposing bloc-level rules for minimum social media ages. An EU age-verification app is technically complete, while some member states like France and Spain have already launched national initiatives. This raises important questions about data sovereignty and the implementation of compliant solutions.
The open-source Haiku operating system, spiritual successor to BeOS, has achieved a significant milestone with the introduction of multi-core Symmetric Multi-Processing (SMP) support for ARM64 architectures. This functionality, already operational in virtualized environments, marks a step forward for the OS, alongside a series of other improvements implemented during April. This advancement opens interesting scenarios for deployment on diverse hardware, including potential on-premise environments.
Texas Attorney General Ken Paxton has filed a lawsuit against Netflix, accusing the streaming platform of collecting user data without consent and employing 'addictive' autoplay design, particularly for children. Netflix has denied the allegations, calling them meritless. This case raises crucial questions about data sovereignty and the control of personal information, central themes for technology deployment decisions.
Ditto, an Amsterdam-based health-tech startup, has announced a €7.6 million funding round. The company develops AI-driven solutions to generate summaries of medical appointments for patients. The capital, led by Heal Capital, will support expansion into key markets such as Germany, the UK, and Spain. This application of AI in healthcare raises significant questions regarding data sovereignty and deployment choices.
White Circle has closed an $11 million Seed round for its platform dedicated to monitoring, securing, and controlling AI models in production. Support from key industry figures and a customer base including major digital banks highlight the growing demand for solutions to manage artificial intelligence in enterprise environments.
Nscale, an AI infrastructure company, has secured $790 million in financing to continue building its dedicated AI data center in Narvik, northern Norway. This operation underscores the importance of investing in physical infrastructure to support AI workloads, a crucial aspect for companies evaluating on-premise deployments and data sovereignty.
Dutch startup Ditto secured €7.6 million in a funding round led by Heal Capital. The funds will support its European expansion and the development of its AI-powered patient communication platform. The application, which generates summaries of medical consultations and does not store data centrally, aims to enhance patient understanding and reduce administrative burden on healthcare professionals.
A recent analysis using `llama.cpp` revealed how increasing the physical micro-batch size (`ubatch`) can drastically improve prompt prefill speed for partially offloaded Large Language Models on consumer GPUs like the RTX 3090. This approach, while leading to a slight drop in token generation and increased CPU offloading, offers a significant throughput boost, highlighting crucial trade-offs for on-premise deployments.
Taipower's new president has emphasized the growing energy demand generated by artificial intelligence and the need to strengthen the resilience of the electricity grid. This focus highlights the infrastructural challenges utilities face to support the expansion of AI workloads, in both cloud and on-premise contexts, underscoring the importance of a stable and reliable energy supply.
Chinese tech giant Kuaishou aims for a US$20 billion valuation for Kling AI, its spin-off focused on video generation. This strategic move highlights the growing demand for AI solutions in visual content creation and raises crucial questions about the infrastructure required to handle such intensive workloads. Companies are increasingly evaluating on-premise versus cloud deployment options to ensure data sovereignty and control over operational costs.
The accelerated penetration of New Energy Vehicles (NEVs) in China, driven by oil prices, offers insight into the dynamics shaping new technology adoption. This scenario highlights how economic and strategic factors influence infrastructure choices, a relevant parallel for on-premise Large Language Models (LLM) deployment, where TCO and data sovereignty are crucial.
Recent slowdowns in Taiwan's electric vehicle charging infrastructure rollout, attributed to grid and soil issues, offer insight into the complex challenges facing any critical technology deployment. This situation highlights the importance of meticulous planning and site assessment, crucial aspects also for on-premise architectures dedicated to Large Language Models, where resilience and TCO depend on solid foundations.
Nvidia is deepening its partnership with Corning, focusing on fiber optics for AI infrastructure. This transition from copper to optical silicon is crucial to support the growing bandwidth and latency demands of Large Language Models (LLMs) and AI applications, also impacting China's optical market. The move highlights the importance of high-performance connections for on-premise deployments.
London's High Court is hosting a two-week trial between e-commerce giants Shein and Temu. Shein accuses Temu of 'industrial-scale' copyright infringement involving approximately 2,300 product images, while Temu counters with anti-competition claims. The dispute highlights the legal and technological challenges in managing large volumes of digital data, with direct implications for AI deployment strategies.