Qodo Unveils a Groundbreaking Real-World Benchmark for AI Code Review

Qodo's new benchmark is incredibly exciting, promising to revolutionize how we measure AI's ability to review code. By injecting defects into real-world, production-grade open-source repositories, they're setting a new standard for evaluating both code correctness and quality in a realistic environment.

• •The benchmark focuses on evaluating code correctness (bug detection) and code quality (best practice enforcement) simultaneously.
• •It uses genuine, merged pull requests from active open-source repositories.
• •The benchmark includes a substantial scale of 100 PRs containing 580 issues.