Dr. Walid Saba on AI Limitations and LLMs
Analysis
The article discusses Dr. Walid Saba's perspective on the book "Machines Will Never Rule The World." He acknowledges the complexity of AI, particularly in modeling mental processes and language. While skeptical of the book's absolute claim, he is impressed by the progress in large language models (LLMs). He highlights the empirical learning capabilities of current models, viewing it as a significant achievement. However, he also points out the limitations, such as brittleness and the need for more data and parameters. He expresses skepticism about semantics, pragmatics, and symbol grounding.
Key Takeaways
- •Dr. Saba is skeptical of strong AI's possibility but impressed by LLMs.
- •He highlights the empirical learning success of current models.
- •He acknowledges the limitations of current models, such as brittleness.
- •He expresses skepticism about semantics and symbol grounding in AI.
“Dr. Saba admires deep learning systems' ability to learn non-trivial aspects of language from ingesting text only, calling it an "existential proof" of language competency.”