Skip to content
AI NEWS JOURNAL
AI, IN PERSPECTIVE

Search AI news

Search headlines, summaries and articles to connect the dots.

Newest first

Agentic AI puts the CPU back at center stage as Dell and AMD chase every watt

Agentic AI is rewriting the business development playbook for chipmakers and server builders. Graphics processing units still grab the headlines, but as supercomputing and AI converge, the next wave of demand is landing on central processing units that must fit inside the power budgets data centers already have. The shift has been building for years. […] The post Agentic AI puts the CPU back at center stage as Dell and AMD chase every watt appeared first on SiliconANGLE.

Agents want the crown jewels: HPE and Daxa push governance down to the data layer

Enterprises are handing AI agents their most sensitive data, and governance is struggling to keep pace. Techniques such as semantic caching are emerging as a way to enforce controls inline without slowing agents down. Moving agents from pilot to production means letting them read, change and even delete the records that matter most. That shift […] The post Agents want the crown jewels: HPE and Daxa push governance down to the data layer appeared first on SiliconANGLE.

Three insights you may have missed from theCUBE’s coverage of monday.com’s Elevate event

AI workflow automation is changing how businesses build applications and manage everyday work, raising questions about the role of established software platforms. As organizations experiment with AI-generated applications and autonomous agents, they must also determine how to maintain access controls, integrate existing systems and manage increasingly complex workflows. The growing accessibility of AI development tools […] The post Three insights you may have missed from theCUBE’s coverage of monday.com’s Elevate event appeared first on SiliconANGLE.

Why your fine-tuning job takes longer than the FLOPs say

A study analyzing 272 production supervised fine-tuning jobs on NVIDIA H200 GPUs found that traditional FLOP-based estimates explain only 31% of actual training duration (R² = 0.31, MAE 12.41 h). In contrast, a CatBoost regressor using pre-dispatch job configuration features—including evaluation cadence, checkpoint policy, and per-GPU load—achieved R² = 0.98 with a mean absolute error of 1.71 h and median error of 0.51 h in cross-validation. The model outperforms analytical baselines by capturing overheads beyond compute, such as I/O contention and non-linear interactions between configuration variables. Results highlight the importance of training-specific signals and suggest that scheduling accuracy improves significantly when predictors account for operational overheads.

180B Parameters, 32GB of RAM: Pushing MoE Inference to the Limit with Transformers

The author explores streaming MoE (Mixture of Experts) model experts directly from SSD to achieve near-Strata performance on a 32GB MacBook M5, using a custom implementation in Hugging Face Transformers. By optimizing expert caching, leveraging Metal kernels, and minimizing host-GPU synchronization delays, the approach reaches ~14 tok/s—within 6% of Strata's performance—demonstrating that efficient expert streaming is feasible on consumer hardware without C++ extensions.

Amazon SageMaker AI real-time endpoints now support KV cache aware routing

Amazon SageMaker AI real-time endpoints now support KV cache-aware routing, a new strategy that routes each request to the instance holding the longest cached match for its prompt. Learn how it works, when to use it compared with prefix-aware routing, and how to enable, invoke, and verify it on single model and inference component endpoints.

Build WhatsApp AI agents with Amazon Bedrock AgentCore

SMART, an open-source Python SDK and Terraform stack, deploys the full WhatsApp channel layer to your AWS account with one command. Bring any agent that runs on Amazon Bedrock AgentCore, and SMART handles webhook ingestion, media, conversation memory, scheduling, and Meta message templates.

Dell bets liquid-cooled, software-defined storage can keep AI factories fed

AI factories are growing so dense that storage, not just compute, now decides how quickly they turn data into tokens. For Dell Technologies Inc., the answer starts with turning its PowerEdge servers into flexible, software-defined storage nodes that can change roles as workloads shift. The move from training toward inference and agents has put new […] The post Dell bets liquid-cooled, software-defined storage can keep AI factories fed appeared first on SiliconANGLE.

Dell puts a single gateway between enterprise AI agents and the data they crave

Data intelligence is becoming the deciding layer of the enterprise AI factory as companies learn that racks of GPUs deliver little value when agents lack trusted, governed context. Neocloud providers built the first wave of large-scale AI systems, and core enterprise customers now want the same capabilities inside their own organizations. Dell Technologies Inc. recently […] The post Dell puts a single gateway between enterprise AI agents and the data they crave appeared first on SiliconANGLE.

Getting AI out of the demo and into businesses globally

Most enterprises have AI that works in a demo but stalls before production. AWS Forward Deployed Engineering closes that gap. AWS engineers embed with customer teams to take high-value workflows to production in 45-day sprints, leaving a foundation, workflows, and governance the customer owns.

Idle, then spiking: Why AI agents are breaking Kubernetes resource planning

AI agents are changing the economics of cloud infrastructure, and autonomous orchestration is becoming the way platform teams keep up. Agentic workloads sit idle and then spike without warning. That pattern leaves static resource settings either wasteful or likely to fail. Container orchestration for AI is fast becoming the backbone of production AI, and agents […] The post Idle, then spiking: Why AI agents are breaking Kubernetes resource planning appeared first on SiliconANGLE.

LanceDB raises $57.5M to accelerate AI model training with multimodal data platform

LanceDB Inc., the developer of database technology designed to speed up artificial intelligence models, today announced it has raised $57.5 million in early-stage funding to bring a multimodal lakehouse to researchers, model builders and platform teams. Bessemer Venture Partners and Innovation Endeavors led the Series B round. Other investors in the round included Theory Ventures, […] The post LanceDB raises $57.5M to accelerate AI model training with multimodal data platform appeared first on SiliconANGLE.

Managed NVIDIA Dynamo on Amazon SageMaker HyperPod Inference

Amazon SageMaker HyperPod Inference now supports NVIDIA Dynamo for distributed inference, with multi-node and disaggregated serving, KV-aware routing, and automatic fault recovery. Serve large models across many nodes without building the orchestration layer yourself.

OneTrust’s Fall ’26 Release expands AI visibility, privacy and third-party risk tools

Governance platform provider OneTrust LLC today announced its Fall ’26 Release, a set of platform updates said to bring governance into the workflows where business decisions are made. Building on OneTrust CORIE, a shared intelligence layer for governing artificial intelligence agents introduced at the company’s TrustWeek conference in September, the release covers AI visibility, privacy, […] The post OneTrust’s Fall ’26 Release expands AI visibility, privacy and third-party risk tools appeared first on SiliconANGLE.

Reason over time-series data with OpenTSLM on Amazon SageMaker JumpStart

OpenTSLM, an open source family of time-series language models, is now available in Amazon SageMaker JumpStart. See how Nexthink and Aionic Labs apply it to proactive IT support, then deploy OpenTSLM to a real-time endpoint and fine-tune it on your own data with TimeNet and a SageMaker training job.