Enhancing robustness of deep learning-based malware detection against adversarial attacks
摘要
Deep learning-based malware detectors remain highly vulnerable to adversarial attacks. While individual defense mechanisms such as denoising autoencoders, adversarial training, and generative networks have been explored separately, their orchestrated integration into a unified, multi-layer defense pipeline remains an open challenge. This paper introduces DefendMal, a novel framework that synergistically combines Denoise Autoencoder with Sequence Squeezing (DA-SS), a Context-aware Adversarial Generator (CAG-AdvGAN), Projected Gradient Descent (PGD) adversarial training, and a Positive–Negative Detector with Variational Autoencoder (PNDetector-VAE) to enhance robustness against evolving adversarial threats. Unlike prior works that focus on isolated defenses, DefendMal employs a cascaded defense strategy that sequentially preprocesses inputs, generates adaptive attacks, hardens the model, and detects poisoned samples. We evaluate DefendMal on a curated malware-inspired adversarial dataset derived from image-based perturbations, serving as a reproducible proxy for malware feature space. Our results demonstrate that DefendMal achieves 97% accuracy and 98% precision under adversarial conditions, significantly outperforming state-of-the-art baselines. We further validate statistical reliability through confidence intervals derived from multiple experimental runs and ablation studies confirm the contribution of each component.