<p>People with visual impairments often face difficulties finding desired photos in their smartphone albums. To identify the needs and challenges in photo browsing, we first conducted an interview with 10 participants with visual impairments. Based on the findings, we propose <i>PhotoTalk</i>, an intelligent photo album that assists users with photo browsing tasks by making requests to an LLM-based chatbot for finding photos of specific objects (<i>e.g., ‘Find photos with flowers’</i>), visual question answering (<i>e.g., ‘What color are the flowers?</i>’) and recommendations (<i>e.g., ‘Which photo looks better for my Instagram?</i>’). As for the evaluation, we conducted another user study with 13 participants with visual impairments, which resulted in high ratings in terms of System Usability Scale. Specifically, participants perceived <i>PhotoTalk</i> as easy to use and as reducing the effort required for photo finding relative to their current practices. They also noted that it could address the challenges they previously encountered (<i>e.g.,</i> finding photos that are not well-remembered, distinguishing between similar photos). We discuss design implications for future chatbot-based assistance to enhance visual accessibility and independent photo browsing for people with visual impairments.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

PhotoTalk: an LLM-based photo album browsing assistance with chatbot for people with visual impairments

  • Yunjung Lee,
  • Sooin Moon,
  • Hwayeon Joh,
  • Sunwoo Park,
  • Uran Oh

摘要

People with visual impairments often face difficulties finding desired photos in their smartphone albums. To identify the needs and challenges in photo browsing, we first conducted an interview with 10 participants with visual impairments. Based on the findings, we propose PhotoTalk, an intelligent photo album that assists users with photo browsing tasks by making requests to an LLM-based chatbot for finding photos of specific objects (e.g., ‘Find photos with flowers’), visual question answering (e.g., ‘What color are the flowers?’) and recommendations (e.g., ‘Which photo looks better for my Instagram?’). As for the evaluation, we conducted another user study with 13 participants with visual impairments, which resulted in high ratings in terms of System Usability Scale. Specifically, participants perceived PhotoTalk as easy to use and as reducing the effort required for photo finding relative to their current practices. They also noted that it could address the challenges they previously encountered (e.g., finding photos that are not well-remembered, distinguishing between similar photos). We discuss design implications for future chatbot-based assistance to enhance visual accessibility and independent photo browsing for people with visual impairments.