Measuring Goodhart’s Law
Published:Apr 13, 2022 07:00
•1 min read
•OpenAI News
Analysis
The article introduces Goodhart's Law and its relevance to OpenAI's objective optimization challenges. It highlights the core concept: when a metric becomes a target, it loses its effectiveness. The article's brevity suggests it serves as an introductory note or a starting point for a deeper discussion on the topic within the context of AI development.
Key Takeaways
- •Goodhart's Law states that when a measure becomes a target, it ceases to be a good measure.
- •OpenAI faces challenges in optimizing objectives that are difficult or costly to measure, making Goodhart's Law relevant.
Reference
““When a measure becomes a target, it ceases to be a good measure.””