Fine-Tuning Large Language Models for Clickbait Classification
摘要
Detecting clickbait – those headlines that attract excessive attention – remains an interesting topic in natural language processing. This paper presents an applied approach to categorizing clickbait texts by fine-tuning large-scale language models, that is, Mistral 7B and LLaMA 3.1 8B, with an algorithm of PEFT coupled with QLoRA. The approach is evaluated on the Webis Clickbait Corpus 2017 dataset. To get an overall evaluation, we also contrast our model with multiple prompting methods. The experiment demonstrates that the fine-tuning techniques not only increase the correct rate but also provide better insight into the reason why the model makes the judgment.