<p>Cervical cancer is one of the most fatal and prevalent illnesses affecting women globally. Early detection of cervical cancer is crucial for effective treatment. Pap smear tests are commonly used, but population-based screening is time-consuming, expensive, and requires expert physicians. Computer-Aided Diagnosis (CAD) has shown promise in addressing this challenge. However, accurately predicting the disease using a single model can be difficult due to the complex data patterns involved. This research proposes a multi-stage architecture to improve cervical cancer screening. Initially, three pre-trained models are employed for image classification, after which the proposed advanced fusion technique is applied to combine the predictions. Additionally, we introduce a filtering approach in the third stage to refine the predictions. Unlike traditional fusion methods, the proposed architecture considers the confidence score of the base classifiers in making the final predictions on test samples. To enhance the performance of the models, we incorporate advanced augmentation techniques, including CutMix, CutOut, and MixUp. We assessed the performance of the proposed framework using a 5-fold cross-validation technique on two benchmark datasets. We evaluated the performance of the proposed framework through 5-fold cross-validation on two benchmark datasets. Remarkably, our framework achieved a classification accuracy of 97.62% and an F1-score of 97.64% on the SIPaKMeD dataset, demonstrating its effectiveness in accurately categorizing various cell types in the dataset.</p>