Unveiling Programming Language Families to Supercharge Code LLMs

This research explores the underlying relationships between programming languages to improve the training and performance of multilingual code Large Language Models (LLMs). By analyzing linguistic features and creating embeddings, the study identifies language families and leverages these insights to optimize LLM training strategies, leading to significant performance gains.