New Companies Poised to Revolutionize AI Inference

The landscape of AI infrastructure is rapidly evolving, with two new companies emerging from UC Berkeley aiming to dominate the "Inference Stack." This signals a shift in focus from model training to efficient model serving, opening exciting new possibilities for enterprise applications. These developments mark a pivotal moment for the industry.

• •vLLM and SGLang commercial offerings are becoming key players in AI inference for enterprises.
• •Inferact secured a massive $150M seed round, valued at $800M.
• •RadixArk, spun out from SGLang, achieved a $400M valuation.