Are We Testing AI’s Intelligence the Wrong Way?

This article highlights a critical perspective on how we evaluate AI intelligence. Melanie Mitchell argues that current methods may be inadequate, suggesting that AI systems should be studied more like nonverbal minds, drawing inspiration from developmental and comparative psychology. The concept of "alien intelligences" is used to bridge the gap between AI and biological minds like babies and animals, emphasizing the need for better experimental methods to measure machine cognition. The article points to a potential shift in how AI research is conducted, focusing on understanding rather than simply achieving high scores on specific tasks. This approach could lead to more robust and generalizable AI systems.

• •Current AI evaluation methods may be inadequate.
• •Developmental and comparative psychology can inform AI research.
• •The concept of "alien intelligences" highlights the need for new approaches.