Combining psychometric and machine learning approaches to select items and score responses
摘要
In short form development, researchers have traditionally used psychometric methods to reduce the number of administered items and still estimate scores that are precise and interpretable. From a machine learning perspective, short form creation could be seen as a feature selection task, where items that maximally predict a single criterion are selected and then administered. This paper proposes to combine feature selection methods and item response models to select items that predict an outcome well but that can still recover a latent variable score. Monte Carlo simulation results suggested that the composition of the measure (i.e., number of items, item categories, and the relation of the scores with the criterion) affects (1) the number of items selected, (2) the recovery of the latent variable score by the items selected, and (3) the prediction accuracy of the outcome. Finally, the proposed approach is illustrated using a mindfulness measure to predict self-control.