<p>Speech data is foundational to advancing both speech research and technology applications. Data collection and annotation are critical processes that ensure the usability and effectiveness of speech data. Despite growing academic and industrial speech databases, persistent challenges in data collection and annotation exist, including limited experience sharing and a lack of standardized scheme design, especially for underrepresented populations or low-resource languages. Therefore, this paper first outlines the overall framework of data collection and annotation and the key components with representative methods and commonly used tools. Furthermore, this paper showcases the tools and platforms we build for collecting and annotating speech of second language acquisition, hearing-impaired children, and mental health monitoring. Finally, we discuss the emerging trends, challenges, and possible solutions in the era of big data and large models. By integrating methodological guidelines with empirical case studies, this paper provides actionable insights for constructing speech databases.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Advancing Speech Data Collection and Annotation: General Methods, Practical Experience, and Future Perspectives

  • Yingming Gao,
  • Xiaoli Feng,
  • Boxue Li,
  • Yanlu Xie,
  • Jinsong Zhang,
  • Ya Li

摘要

Speech data is foundational to advancing both speech research and technology applications. Data collection and annotation are critical processes that ensure the usability and effectiveness of speech data. Despite growing academic and industrial speech databases, persistent challenges in data collection and annotation exist, including limited experience sharing and a lack of standardized scheme design, especially for underrepresented populations or low-resource languages. Therefore, this paper first outlines the overall framework of data collection and annotation and the key components with representative methods and commonly used tools. Furthermore, this paper showcases the tools and platforms we build for collecting and annotating speech of second language acquisition, hearing-impaired children, and mental health monitoring. Finally, we discuss the emerging trends, challenges, and possible solutions in the era of big data and large models. By integrating methodological guidelines with empirical case studies, this paper provides actionable insights for constructing speech databases.