Online lecture videos have become very popular after pandemic. But sometimes students and research communities instead of going through the whole video completely, focus only on the few important parts of content presented in the videos, which leads to a new research area of video segmentation. This paper focused on a novel way to find and move through specific important parts of the lecture videos. There are different methods to do lecture video segmentation. The proposed model employs the Sentence transformers with the triplet loss function for representation of video lecture‘s audio transcripts and acoustic characteristics. To find the best video partitioning, a genetic algorithm is used. The dataset used in this work consists of 334 videos, amongst which 25 videos selected are of long duration that adds to the increased complexity for video segmentation. Duration of each video is approximate 52 min. The proposed work attained a precision of 0.51, recall of 0.52 and the F1-score of 0.498 which is fairly acceptable as per the different state-of-art techniques proposed in literature.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Audio-Based Video Segmentation for Long Duration Videos Using Triplet-Loss Based Sentence Transformers and Acoustic Characteristics

  • M. Vasuki,
  • Rimjhim Padam Singh,
  • Susmitha Vekkot,
  • Vivek Venugopal

摘要

Online lecture videos have become very popular after pandemic. But sometimes students and research communities instead of going through the whole video completely, focus only on the few important parts of content presented in the videos, which leads to a new research area of video segmentation. This paper focused on a novel way to find and move through specific important parts of the lecture videos. There are different methods to do lecture video segmentation. The proposed model employs the Sentence transformers with the triplet loss function for representation of video lecture‘s audio transcripts and acoustic characteristics. To find the best video partitioning, a genetic algorithm is used. The dataset used in this work consists of 334 videos, amongst which 25 videos selected are of long duration that adds to the increased complexity for video segmentation. Duration of each video is approximate 52 min. The proposed work attained a precision of 0.51, recall of 0.52 and the F1-score of 0.498 which is fairly acceptable as per the different state-of-art techniques proposed in literature.