'Results Were Fudged': Departing Meta AI Chief Confirms Llama 4 Benchmark Manipulation
Analysis
Key Takeaways
- •Meta's Llama 4 benchmark results were manipulated before release.
- •CEO Mark Zuckerberg was upset and sidelined the GenAI organization.
- •Yann LeCun is leaving Meta and is critical of LLMs for superintelligence.
“LeCun said the "results were fudged a little bit" and that the team "used different models for different benchmarks to give better results." He also stated that Zuckerberg was "really upset and basically lost confidence in everyone who was involved."”