Random Subset Averaging: A Novel Ensemble Method

This paper introduces Random Subset Averaging (RSA), a new ensemble prediction method designed for high-dimensional data with correlated covariates. The method's key innovation lies in its two-round weighting scheme and its ability to automatically tune parameters via cross-validation, eliminating the need for prior knowledge of covariate relevance. The paper claims asymptotic optimality and demonstrates superior performance compared to existing methods in simulations and a financial application. This is significant because it offers a potentially more robust and efficient approach to prediction in complex datasets.