Microsoft Unveils A New AI Inference Accelerator Chip, Maia 200

Microsoft’s new Maia 200 inference accelerator chip enters this overheated market with a new chip that aims to cut the price ...
NextBigFuture

Distributed AI Inference Will Capture Most of the LLM Value

Using the AIs will be way more valuable than AI training. AI training – feed large amounts of data into a learning algorithm to produce a model that can make predictions. AI Training is how we make ...
Morningstar

Moreh and SGLang team up to showcase distributed inference system on AMD at AI Infra Summit 2025

SEOUL, South Korea and SANTA CLARA, Calif., Sept. 11, 2025 /PRNewswire/ -- Moreh, an AI infrastructure software company, unveiled its distributed inference system on AMD and showcased the progress of ...
VentureBeat

Pipeshift cuts GPU usage for AI inferences 75% with modular interface engine

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now DeepSeek’s release of R1 this week was a ...

New agent framework matches human-engineered AI systems — and adds zero inference cost to deploy

A new group-evolving agent framework from UC Santa Barbara matches human-engineered AI systems on SWE-bench — and adds zero ...
The Next Platform

SoC-Driven Inference Datacenters Becoming New Reality

The mighty SoC is coming for the datacenter with inference as a prime target, especially given cost and power limitations. With multiple form factors stretching from edge to server, any company that ...