Microsoft debuts multichiplet Maia 300 inference accelerator

Microsoft debuts multichiplet Maia 300 inference accelerator

Microsoft Corp. today pulled back the curtains on Maia 300, its newest internally developed artificial intelligence accelerator.

The chip is optimized for inference. Microsoft estimates that it can process 40% more tokens per megawatt than “leading GPU-based systems,” which is likely a reference to Nvidia Corp. products. The company stated the Maia chip series will become its primary source of inference capacity over time.

Maia 300 features four computing chiplets made using Taiwan…