AI and Compute Trends
Analysis
OpenAI's analysis highlights the exponential growth of compute used in AI training since 2012, with a 3.4-month doubling time, significantly faster than Moore's Law. This rapid increase in compute is a crucial driver of AI progress, suggesting the potential for future AI systems to far surpass current capabilities.
Key Takeaways
- •Compute used in AI training is growing exponentially.
- •The doubling time is 3.4 months, significantly faster than Moore's Law.
- •This trend suggests significant future AI advancements.
Reference
“The amount of compute used in the largest AI training runs has been increasing exponentially with a 3.4-month doubling time.”