Leveraging SHAP to Advance the Robustness of Large Language Models
摘要
In the domain of natural language processing, adversarial attacks often exploit the importance of specific words to deceive models. Identifying these critical words is essential for developing robust defense mechanisms. The SHAP (SHapley Additive exPlanations) method provides a comprehensive approach to quantify feature importance in machine learning models. This paper discusses the advantages of integrating the SHAP method with the SelfDenoise technique, emphasizing how SHAP aids in pinpointing salient words that are typically targeted by attack strategies. Through this integration, we aim to enhance the model’s resilience against adversarial perturbations by reinforcing the denoising process on words deemed significant by SHAP.