Boosting AI Trust: Interpretable Early-Exit Networks with Attention Consistency
Analysis
This research addresses a critical limitation of early-exit neural networks – the lack of interpretability – by introducing a method to align attention mechanisms across different layers. The proposed framework, Explanation-Guided Training (EGT), has the potential to significantly enhance trust in AI systems that use early-exit architectures, especially in resource-constrained environments where efficiency is paramount.
Key Takeaways
- •The paper introduces Explanation-Guided Training (EGT), a multi-objective framework for interpretable early-exit neural networks.
- •EGT uses attention consistency loss to align attention maps across different exit points, improving interpretability.
- •Experiments show EGT achieves comparable accuracy with faster inference and enhanced attention consistency compared to baseline models.
Reference
“Experiments on a real-world image classification dataset demonstrate that EGT achieves up to 98.97% overall accuracy (matching baseline performance) with a 1.97x inference speedup through early exits, while improving attention consistency by up to 18.5% compared to baseline models.”