Fine-Tuned Large Language Models in Software Defect Prediction
摘要
A significant advancement in Software Defect Prediction can be achieved through an innovative methodology utilizing Large Language Models (LLMs) with fine-tuning and few-shot prompting techniques. This approach differs from conventional machine learning and deep learning methodologies by utilizing the inherent knowledge embedded within LLMs, which have undergone pretraining on comprehensive codebases to improve contextual comprehension. The methodology leverages concealed patterns in extensive code repositories, where specific prompting and fine-tuning customize LLMs to the subtleties of software defect prediction, thereby improving defect identification accuracy. Our empirical analysis reveals the superior efficacy of this methodology compared to traditional approaches, yielding accuracy rates exceeding 90%, approximately 20% higher than elementary prompting strategies. This investigation makes a valuable contribution to the evolving domain of software defect prediction. The potential benefits of this approach include diminished reliance on domain-specific characteristics and enhanced detection of nuanced code defects, while significant challenges encompassed hyperparameter optimization and management of computational demands for model training.