Recent experiments have uncovered several high-dimensional datasets that form different binary groupings after projecting the data to randomly chosen one-dimensional subspaces. This paper describes a probability model for the data that could explain this phenomenon. It is a simple model to serve as a proof of concept for understanding the geometry of high-dimensional data. Our construction makes it clear that one needs to make a distinction between “groupings” and “clusters” in the original space. It also highlights the need to interpret any clustering found in projected data as merely one among potentially many other groupings in a dataset. From a machine learning perspective, it provides a discrete counterpart to manifold learning and suggests ways to develop low-cost alternatives for existing classification methods.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A New Model for Natural Groupings in High-Dimensional Data

  • Mireille Boutin,
  • Evzenie Coupkova

摘要

Recent experiments have uncovered several high-dimensional datasets that form different binary groupings after projecting the data to randomly chosen one-dimensional subspaces. This paper describes a probability model for the data that could explain this phenomenon. It is a simple model to serve as a proof of concept for understanding the geometry of high-dimensional data. Our construction makes it clear that one needs to make a distinction between “groupings” and “clusters” in the original space. It also highlights the need to interpret any clustering found in projected data as merely one among potentially many other groupings in a dataset. From a machine learning perspective, it provides a discrete counterpart to manifold learning and suggests ways to develop low-cost alternatives for existing classification methods.