MTIA 300 – Meta's 3rd-gen custom AI chip optimized for GenAI inference

Summary: The MTIA 300 is Meta's third-generation custom AI chip designed for efficient GenAI inference with native PyTorch integration. It enables rapid deployment of modular chips at consumer scale, accelerating Meta's silicon roadmap with an inference-first approach.

What it does

MTIA 300 powers GenAI inference cost-effectively using modular chiplets and a reusable rack design, supporting fast iteration with new chips released every six months.

Who it's for

It is intended for large-scale GenAI workloads requiring efficient inference, primarily within Meta's infrastructure.

Why it matters

It addresses the need for faster, scalable AI inference hardware beyond traditional multi-year silicon cycles.