A Study on Robust Feature Selection Methods Using LASSO, LASSO Variants and Ridge Regression in Sports
摘要
Regularization tools like Lasso have made a substantial progresses in regression modelling, particularly to high-dimensional data and multicollinear data. Whereas Ridge regression uses L2regularization to address the problem of multicollinearity, Lasso uses L1 regularization to conduct regression and feature selection together. The weaknesses of Lasso under correlated predictors have inspired the creation of a number of improved variants. The present paper will do a comparative analysis of simple Lasso, Ridge and Lasso extensions like Elastic Net, Adaptive Lasso, Group Lasso and Relaxed Lasso on real-world sports data, with special focus on a new implementation of the improved Relaxed Lasso that involves three optimization strategies: systematic grid search, extended lambda sequences, and nested cross-validation structures. The comparison has been done in terms of feature selection, resistance to outliers, and prediction accuracy on Ice Hockey, Cricket, and NBA data. Various measures of errors are used to analyze models: Mean Squared Error (MSE), Root Mean Squared Error (RMSE), Mean Absolute Error (MAE) and Coefficient of Determination (R2). The results have shown that the Enhanced Relaxed Lasso performs best regarding improvements in performance especially in cricket data and still serves as a competitive data in different sporting scenarios.