We discuss the problem of simultaneously classifying an entire group of data consisting of n p-variate observations, all in one shot, into one of the two given independent populations \(\Pi _1\) or \(\Pi _2\) . We assume that all observations come from the same population and thus the entire group is to be classified into either \(\Pi _1\) or \(\Pi _2\) . In practice, these populations are represented by their respective random samples. No assumption is made about their probability distributions. Various approaches using the standard distance-based metrics along with “majority rule” exhibit very disappointing performances. Thus, we rely on eigen-structures inherent in the random samples and quantify the closeness of eigen-structure of the “to be classified sample” to the respective eigen-structures of these two random samples. Such measures are based on antieigenvalues. We also consider the associated problem of feature selection, the solution to which is also provided by devising certain suitable algorithms, which also rely on eigen-structures. The generalization to more than two populations is straightforward.