Compact HybridConvNet: an empirical study of convolutional architectures for image classification with applications to compressed domains
摘要
This work presents a comprehensive empirical evaluation of neural network configurations for image classification, with a specific focus on compressed domain processing applications. We systematically evaluated 406 distinct configurations across two architectures: a baseline dense-layer model (SimpleDense) and a compact hybrid convolutional network (HybridConvNet) that integrates established architectural components. Our study examined activation functions, network depths, learning rates, batch sizes, and optimizers using CIFAR-10 as a primary dataset, with additional validation on the full CIFAR-100 and JPEG-compressed data. SimpleDense achieved a peak validation accuracy of 0.5120, while HybridConvNet reached 0.6900 on uncompressed data and maintained robust performance on moderately compressed images (JPEG quality 50) with an accuracy of 0.6486. Comprehensive ablation studies revealed that multi-head self-attention contributed a 9.1 absolute accuracy improvement, while depthwise separable convolutions provided a 12.3% parameter reduction. Efficiency analysis showed HybridConvNet requires 2.1M parameters and a 15.2ms inference time, making it suitable for edge deployment. Comparisons with lightweight models demonstrate competitive accuracy-efficiency trade-offs, positioning this work as an empirical systematization that provides actionable insights for developing efficient neural networks in resource-constrained environments.