<p class="MsoNormal" style="margin-bottom: .0001pt; line-height: normal; mso-pagination: widow-orphan;"><span style="font-size: 12.0pt; font-family: 'Times New Roman',serif; mso-fareast-font-family: 'Times New Roman'; mso-font-kerning: 0pt; mso-ligatures: none; mso-fareast-language: EN-US;">Online search engines are an essential tool for seeking information, but results returned from these search engines can contain undesirable forms of bias with respect to protected attributes such as gender or race. These biases can exist due to the word embeddings used by search engines, the design of re-ranking algorithms, the development of retrieval algorithms, or a variety of other reasons. Classical information retrieval (IR) methods, such as query recommendation or query expansion, were designed to produce the most relevant results. However, if such biases are present in the system, then these methods will also deliver biased results.</span></p><p class="MsoNormal" style="margin-bottom: .0001pt; line-height: normal; mso-pagination: widow-orphan;"><span style="font-size: 12.0pt; font-family: 'Times New Roman',serif; mso-fareast-font-family: 'Times New Roman'; mso-font-kerning: 0pt; mso-ligatures: none; mso-fareast-language: EN-US;">&#xa0;</span><span style="font-size: 12.0pt; font-family: 'Times New Roman',serif; mso-fareast-font-family: 'Times New Roman'; mso-font-kerning: 0pt; mso-ligatures: none; mso-fareast-language: EN-US;">IR systems/recommender systems also play a major role in social media algorithms, where platforms have pivoted away from friend-follow timelines to <span style="mso-ansi-language: EN-US;">“</span>for you<span style="mso-ansi-language: EN-US;">” </span></span><span style="font-size: 12.0pt; font-family: 'Times New Roman',serif; mso-fareast-font-family: 'Times New Roman'; mso-font-kerning: 0pt; mso-ligatures: none; mso-fareast-language: EN-US;">timelines containing algorithmically-selected content.&#xa0;</span><span style="font-size: 12.0pt; font-family: 'Times New Roman',serif; mso-fareast-font-family: 'Times New Roman'; mso-font-kerning: 0pt; mso-ligatures: none; mso-fareast-language: EN-US;">If these algorithms are biased (towards, say, maximizing screen time to show ads, maximizing user interaction to likes, comments), then they may push end users towards clickbait or non-mainstream trending topics.&#xa0;</span></p><p class="MsoNormal" style="margin-bottom: .0001pt; line-height: normal; mso-pagination: widow-orphan;"><span style="font-size: 12.0pt; font-family: 'Times New Roman',serif; mso-fareast-font-family: 'Times New Roman'; mso-font-kerning: 0pt; mso-ligatures: none; mso-fareast-language: EN-US;">This book presents an overview of modern IR and discusses the work done to mitigate biases in IR systems. It also examines methods for debiasing word embeddings and re-ranking search results to address group fairness, and presents a query reformulation method that analyzes bias in search results and delivers balanced results to the end user.</span></p><p class="MsoNormal" style="margin-bottom: 5.0pt; line-height: normal; mso-pagination: widow-orphan;"><span style="font-size: 12.0pt; font-family: 'Times New Roman',serif; mso-fareast-font-family: 'Times New Roman'; mso-font-kerning: 0pt; mso-ligatures: none; mso-fareast-language: EN-US;">Awareness of how information retrieval systems work, ways to mitigate bias in search results, and the tradeoffs between accuracy and bias metrics in search results will help readers understand real-world search engines.&#xa0;</span></p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Addressing Bias in Information Retrieval

  • Harshit Mishra,
  • Sucheta Soundarajan

摘要

Online search engines are an essential tool for seeking information, but results returned from these search engines can contain undesirable forms of bias with respect to protected attributes such as gender or race. These biases can exist due to the word embeddings used by search engines, the design of re-ranking algorithms, the development of retrieval algorithms, or a variety of other reasons. Classical information retrieval (IR) methods, such as query recommendation or query expansion, were designed to produce the most relevant results. However, if such biases are present in the system, then these methods will also deliver biased results.

 IR systems/recommender systems also play a major role in social media algorithms, where platforms have pivoted away from friend-follow timelines to for youtimelines containing algorithmically-selected content. If these algorithms are biased (towards, say, maximizing screen time to show ads, maximizing user interaction to likes, comments), then they may push end users towards clickbait or non-mainstream trending topics. 

This book presents an overview of modern IR and discusses the work done to mitigate biases in IR systems. It also examines methods for debiasing word embeddings and re-ranking search results to address group fairness, and presents a query reformulation method that analyzes bias in search results and delivers balanced results to the end user.

Awareness of how information retrieval systems work, ways to mitigate bias in search results, and the tradeoffs between accuracy and bias metrics in search results will help readers understand real-world search engines.