Unwanted emails, widely known as spam, pose a significant and persistent problem in daily digital lives. Spam can carry security risks such as phishing attacks, making effective detection crucial. While machine learning(ML) has driven advancements in spam filtering, a key challenge remains: most publicly available datasets for training these filters are outdated. These datasets do not reflect the complex mix of “ham” (legitimate) and spam emails encountered today. To address this, a current dataset was built from scratch using real Gmail data. To truly understand the effectiveness of traditional ML models, which have evolved over the years, they need to be tested against real-world scenarios. Simultaneously, recent breakthroughs in artificial intelligence, particularly with Large Language Models (LLMs), are fundamentally changing how information is interacted with. These powerful models offer new possibilities for understanding and classifying text. This paper presents a direct comparison that evaluates the performance of several established traditional ML models, including Naive Bayes, Support Vector Machines (SVM), and XGBoost. The capabilities of these models are then compared against three distinct LLMs. This work aims to provide clear insights into the capabilities of open-source LLMs in detecting spam in contemporary email environments.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Exploring Spam Classification with Open-Source Language Models and Real-World Gmail Data

  • Anahita Dinesh,
  • Robert Chun

摘要

Unwanted emails, widely known as spam, pose a significant and persistent problem in daily digital lives. Spam can carry security risks such as phishing attacks, making effective detection crucial. While machine learning(ML) has driven advancements in spam filtering, a key challenge remains: most publicly available datasets for training these filters are outdated. These datasets do not reflect the complex mix of “ham” (legitimate) and spam emails encountered today. To address this, a current dataset was built from scratch using real Gmail data. To truly understand the effectiveness of traditional ML models, which have evolved over the years, they need to be tested against real-world scenarios. Simultaneously, recent breakthroughs in artificial intelligence, particularly with Large Language Models (LLMs), are fundamentally changing how information is interacted with. These powerful models offer new possibilities for understanding and classifying text. This paper presents a direct comparison that evaluates the performance of several established traditional ML models, including Naive Bayes, Support Vector Machines (SVM), and XGBoost. The capabilities of these models are then compared against three distinct LLMs. This work aims to provide clear insights into the capabilities of open-source LLMs in detecting spam in contemporary email environments.