Human oral communication is a multi-modal process which involves facial expressions, body gestures in response to utterances of sounds and movements of speech articulators. The act of moving the lips silently in time with a pre-recorded sound to synchronize speaking and lip movements is known as lip-sync or lip-synchronization. Lip-sync solves certain social connection problems and is utilized in the entertainment industry. This research paper presents the different aspects of lip-sync such as language specificity, approach-wise task mechanics of lip-syncing with various steps from lip detection to tracking lip movement. The present study reports the status of research literature chronologically with describing approaches including AI, ML, NLP, and DL with respective classifiers used with different languages and specific tasks, data repositories, accuracy, with national and international level research for lip-sync with the phases of lip-sync from ideas to implementation and evaluation. Our findings reveal various applications of lip-sync in various fields in day-to-day life. Till now research works in lip-sync have been done in different national and international level languages. In Indic languages including Marathi, Hindi, Urdu, and a number of other languages. From our review we have concluded that for the Marathi language, the work reported is done for the first three digits. We also focused the findings on the Marathi Language at the basic level. It clearly states that there are various directions for future researchers in this domain with the Marathi language.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Language-Based Literature Review on Lip-Sync

  • Monica Sagar Dhotre,
  • Ramchandra P. Bhavsar,
  • Bhausaheb V. Pawar

摘要

Human oral communication is a multi-modal process which involves facial expressions, body gestures in response to utterances of sounds and movements of speech articulators. The act of moving the lips silently in time with a pre-recorded sound to synchronize speaking and lip movements is known as lip-sync or lip-synchronization. Lip-sync solves certain social connection problems and is utilized in the entertainment industry. This research paper presents the different aspects of lip-sync such as language specificity, approach-wise task mechanics of lip-syncing with various steps from lip detection to tracking lip movement. The present study reports the status of research literature chronologically with describing approaches including AI, ML, NLP, and DL with respective classifiers used with different languages and specific tasks, data repositories, accuracy, with national and international level research for lip-sync with the phases of lip-sync from ideas to implementation and evaluation. Our findings reveal various applications of lip-sync in various fields in day-to-day life. Till now research works in lip-sync have been done in different national and international level languages. In Indic languages including Marathi, Hindi, Urdu, and a number of other languages. From our review we have concluded that for the Marathi language, the work reported is done for the first three digits. We also focused the findings on the Marathi Language at the basic level. It clearly states that there are various directions for future researchers in this domain with the Marathi language.