“Model Cards for Model Reporting” in 2024: Reclassifying Category of Ethical Considerations in Terms of Trustworthiness and Risk Management
摘要
In 2019, the paper entitled “Model Cards for Model Reporting” introduced a new tool for documenting model performance and encouraged the practice of transparent reporting for a defined list of categories. One of the categories detailed in the 2019 paper is ethical considerations, which include the subcategories of data, human life, mitigations, risks and harms, and use cases. We propose to reclassify this category in the original model card due to the recent maturing of the field known as trustworthy AI. Our reclassification of the original model-card category known as ethical considerations involves a two-step process. First, we propose to add a new category known as trustworthiness, where the subcategories will be derived from the recent writings on trustworthy AI that we discuss in our paper. Second, instead of eliminating the subcategories of ethical considerations from the model card, we propose to maintain these subcategories under a renamed category known as risk environment and risk management, a title which we believe better captures today’s understanding of the essence of these topics. We hope that this reclassification will further the goals of the original paper and continue to prompt those releasing trained models to accompany these models with documentation that will assist in the evaluation of the algorithmic properties of the models as the ethical, regulatory, and business demands concerning these models evolve.