Generative AI tools have become increasingly accessible to the general public during the last few years, empowering users to create images with unprecedented ease. However, these tools are often trained on biased datasets, which can lead to the production of biased imagery, an underlying issue that often goes unnoticed by users. This problem is particularly concerning in the design field, where advertising agencies and other companies are progressively integrating AI-generated visuals into their workflows, resulting in inadvertently reinforcing stereotypes in visual outputs. We conducted a study involving 114 participants, to uncover how societal biases manifest when people are presented with AI-generated images of individuals from various ethnic and cultural backgrounds, seeking to uncover patterns of racial profiling and the underlying mechanisms of crime racialization, and how this can harm the creation and selection of AI-generated images in the design industry. The findings highlight a significant and pervasive issue, raising important questions about the ethics and implications of generative AI, and the potential harm this could cause to the design field. This research is of particular interest to educators, designers, AI developers, and anyone who uses or encounters AI-generated content.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Designing Against Bias: AI, Crime Racialization, and the Ethics of Image

  • Veronica Silva,
  • Hande Ayanoglu,
  • Rodrigo Hernández Ramírez

摘要

Generative AI tools have become increasingly accessible to the general public during the last few years, empowering users to create images with unprecedented ease. However, these tools are often trained on biased datasets, which can lead to the production of biased imagery, an underlying issue that often goes unnoticed by users. This problem is particularly concerning in the design field, where advertising agencies and other companies are progressively integrating AI-generated visuals into their workflows, resulting in inadvertently reinforcing stereotypes in visual outputs. We conducted a study involving 114 participants, to uncover how societal biases manifest when people are presented with AI-generated images of individuals from various ethnic and cultural backgrounds, seeking to uncover patterns of racial profiling and the underlying mechanisms of crime racialization, and how this can harm the creation and selection of AI-generated images in the design industry. The findings highlight a significant and pervasive issue, raising important questions about the ethics and implications of generative AI, and the potential harm this could cause to the design field. This research is of particular interest to educators, designers, AI developers, and anyone who uses or encounters AI-generated content.