Tag Dimensionality Reduction for Enhanced Movie Recommendations in the Long Tail Using Semantic Clustering
摘要
Movie recommendation systems often rely on a vast array of tags to categorize films, but the high dimensionality of these tags can complicate and reduce the effectiveness of the recommendation process. This paper explores an approach to enhance recommendation accuracy by reducing the dimensionality of the tags in the MovieLens dataset. We utilize the embeddings obtained from a sentence-transformer model to identify and merge semantically related tags using clustering approaches, thereby reducing redundancy in the tag space, thereby reducing the number of dimensions. This approach not only mitigates the challenges associated with high-dimensional data but also improves the quality and relevance of movie recommendations.