Deep Learning, Transformers, and the Consequences of Scale with Oriol Vinyals - #546
Analysis
Key Takeaways
- •The podcast episode features Oriol Vinyals, a lead researcher from DeepMind.
- •The discussion covers transformer models, large language models, and DeepMind's work on StarCraft II.
- •The episode explores the implications of the increasing scale of deep learning models.
“We cover a lot of ground in our conversation with Oriol, beginning with a look at his research agenda and why the scope has remained wide even through the maturity of the field...”