Classifying the ImageNet dataset with ROS-GPU
摘要
In this paper, we introduce ROS-GPU, a novel large-scale image classification algorithm that replaces the conventional multi-layer perceptron (MLP) classification head with an ensemble of Random Oblique Stumps (ROS) trained using a GPU-optimized Multi-Class Linear Discriminant Analysis (MC-LDA). Unlike prior ROS-based approaches, the proposed algorithm unifies oblique stump construction and multi-class discrimination through a fully parallel One-Versus-All (OVA) MC-LDA formulation, specifically designed for efficient execution on modern GPU architectures. To address class imbalance in large-scale multi-class datasets, the algorithm incorporates an under-sampling strategy within the OVA scheme to improve class balance and stabilize scalable stump learning. The proposed ROS-GPU algorithm is implemented using CUDA and cuBLAS and is evaluated on the ImageNet benchmark. Experimental results demonstrate that ROS-GPU significantly reduces training time while achieving competitive classification accuracy compared to established learning methods. In particular, ROS-GPU completes ImageNet training in 5.86 min while attaining an accuracy of 89.44%. These results show the effectiveness of combining random oblique ensembles with GPU-parallel discriminant learning, offering a computationally efficient and scalable alternative to traditional deep classification heads for high-dimensional image recognition tasks.