Pat-DEVAL: A Novel Framework for Evaluating Legal Compliance in AI-Generated Patent Descriptions
Analysis
Key Takeaways
- •Pat-DEVAL is a multi-dimensional evaluation framework for patent description bodies.
- •It uses Chain-of-Legal-Thought (CoLT) for legally-constrained reasoning.
- •It achieves a Pearson correlation of 0.69 against expert evaluation on the Pap2Pat-EvalGold dataset.
“Leveraging the LLM-as-a-judge paradigm, Pat-DEVAL introduces Chain-of-Legal-Thought (CoLT), a legally-constrained reasoning mechanism that enforces sequential patent-law-specific analysis.”