AutoThink: Adaptive Reasoning for Local LLMs

AutoThink is a novel technique that improves the performance of local LLMs by dynamically allocating computational resources based on query complexity. The core idea is to classify queries and allocate 'thinking tokens' accordingly, giving more resources to complex queries. The implementation includes steering vectors derived from Pivotal Token Search to guide reasoning patterns. The results show significant improvements on benchmarks like GPQA-Diamond, and the technique is compatible with various local models without API dependencies. The adaptive classification framework and open-source Pivotal Token Search implementation are key components.