Caption Generation Using Dynamic Hand Gesture Recognition of Sign Language
摘要
In contemporary society, the persistent communication barriers faced by the deaf and hard-of-hearing community underscore the urgent need for innovative solutions to enhance accessibility and inclusivity. Traditional methods of sign language interpretation, predominantly reliant on human interpreters, inherently suffer from limitations such as restricted accessibility, potential misinterpretations, and communication constraints. This chapter addresses these critical issues by advocating for the development and implementation of automated systems proficient in accurately recognizing dynamic hand gestures inherent in sign language and subsequently generating corresponding text captions. The primary objective of this study is to design and construct a robust system specialized in the recognition of dynamic hand gestures and the generation of precise text captions, with the ultimate goal of enhancing communication experiences for individuals within the deaf and hard-of-hearing community. By facilitating more effective interaction with the wider community, our proposed system aims to bridge existing communication gaps and foster inclusivity. This research endeavor signifies a significant step forward in tackling the communication challenges faced by the deaf and hard-of-hearing community. Through the deployment of advanced technologies and methodologies, we seek to revolutionize the landscape of sign language interpretation, thereby contributing to the creation of a more accessible and inclusive environment for all individuals. By emphasizing the importance of achieving high levels of accuracy in gesture recognition and caption generation, our proposed system promises to play a pivotal role in the evolution of inclusive communication platforms. The implications of this research extend beyond mere technological advancements, encompassing broader societal benefits such as increased accessibility, improved communication outcomes, and enhanced social integration for individuals with hearing impairments. In conclusion, this chapter advocates for the development and implementation of automated systems capable of accurately recognizing dynamic hand gestures in sign language and generating corresponding text captions. By addressing the communication challenges faced by the deaf and hard-of-hearing community, our proposed system represents a significant milestone in fostering inclusivity and accessibility within contemporary society.