Infrastructure Scaling and Compound AI Systems with Jared Quincy Davis - #740

This article from Practical AI discusses "compound AI systems," a concept introduced by Jared Quincy Davis, the founder and CEO of Foundry. These systems leverage multiple AI models and services to create more efficient and powerful applications. The article highlights how these networks of networks can improve performance across speed, accuracy, and cost. It also touches upon practical techniques like "laconic decoding" and the importance of co-design between AI algorithms and cloud infrastructure. The episode explores the future of agentic AI and the evolving compute landscape.