Cybersecurity Policy Clustering with LLM-Based Embeddings and Dimensionality Reduction
摘要
The clustering of cybersecurity policy documents presents a significant challenge in legal Natural Language Processing (NLP), particularly within government and defense sectors. This study evaluates the effectiveness of clustering techniques when applied to cybersecurity policies represented using BERT-based embeddings. We employ dimensionality reduction methods, including Principal Component Analysis (PCA), t-Distributed Stochastic Neighbor Embedding (t-SNE), and Uniform Manifold Approximation and Projection (UMAP), to project high-dimensional embeddings into lower-dimensional space. We then assess the performance of K-Means, DBSCAN, and Hierarchical Clustering in organizing policy documents. Our results indicate that UMAP combined with Hierarchical Clustering achieves the highest clustering performance, attaining an Adjusted Rand Index (ARI) of 0.8529. These findings demonstrate the impact of transformer-based language models on cybersecurity policy analysis and highlight the role of dimensionality reduction in improving clustering effectiveness.