Multi-dimensional ability diagnosis for machine learning algorithms
摘要
We have proposed the cognitive diagnostic framework Camilla and a multi-dimensional metric Ability for providing both interpretable and reliable assessment of machine learning algorithms. To the best of our knowledge, this is the first comprehensive attempt for measuring the multifaceted strength of each machine learning algorithm by exploring the connections between the research on psychometric theories and machine learning evaluation.