Exploring Algorithmic Paradigms in Message Classification: Insights from the Enron E-mail Dataset
摘要
This research focuses on message classification, specifically distinguishing between legitimate and spam messages. The paper emphasizes the importance of preprocessing textual data using vectorizers, introducing Count Vectorizer and TF-IDF Vectorizer for this purpose. These vectorizers convert text into numerical representations. Along with libraries such as scikit-learn and nltk, is used for model implementation, providing machine learning and natural language processing capabilities, each initialized with specific parameters for optimization. Data is sourced from the Enron e-mail dataset on Kaggle, comprising around 500,000 e-mail linked to Enron’s investigation by the Federal Energy Regulatory Commission. The research objectives include training models with selected algorithms to accurately categorize messages and assessing their performance using metrics. Findings reveal weak positive correlations between message characteristics and the target variable. The developed models show promising performance, emphasizing the need to consider diverse factors and techniques in message classification. The study contributes insights into the relationships between message characteristics and classification accuracy, aiding the development of effective models across various domains.