Learning with Multi-Expert Deferral for LLMs

This paper addresses critical challenges of Large Language Models (LLMs) such as hallucinations and high inference costs. It proposes a framework for learning with multi-expert deferral, where uncertain inputs are routed to more capable experts and simpler queries to smaller models. This approach aims to improve reliability and efficiency. The paper provides theoretical guarantees and introduces new algorithms with empirical validation on benchmark datasets.