<p>English machine reading comprehension (MRC) is a pivotal and challenging task in the field of natural language understanding, which requires a model to comprehend a given passage and then answer corresponding questions or infer textual implications. Prevailing deep learning models typically employ word or character levels as fundamental input units. However, the simple concatenation of word and character vectors has been proven suboptimal for semantic representation. To address this limitation, this paper conducts an in-depth investigation and proposes a novel framework centered on fine-grained language unit segmentation and fusion. Our research focuses on hybrid character-word modeling to achieve a more effective mixed-granularity representation. We explore advanced fusion methods for character and word embeddings and introduce a shortlist mechanism based on word frequency filtering, which significantly enhances the training for low-frequency and out-of-vocabulary words. Furthermore, we propose leveraging subwords and specialized uncommon character embeddings to enrich word representations, all within a general subword segmentation framework. Recognizing that many leading MRC models lack genuine semantic understanding and often focus on semantically irrelevant components, we argue that the core of MRC aligns with the goal of semantic role labeling (SRL). Consequently, we innovatively integrate SRL into the MRC and reasoning pipeline to provide richer and more accurate semantic prompts. Extensive experimental evaluations demonstrate that our proposed methods consistently improve the benchmark model across a range of language understanding tasks, including natural language inference, question answering, reading comprehension, semantic similarity, and text classification, achieving competitive performance.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Research on English semantic modeling and understanding algorithm based on the SemBERT model of natural language processing

  • Ailing Zhang,
  • Yongchang Zhang,
  • Hengcan Xie,
  • Xiaodan Zhang

摘要

English machine reading comprehension (MRC) is a pivotal and challenging task in the field of natural language understanding, which requires a model to comprehend a given passage and then answer corresponding questions or infer textual implications. Prevailing deep learning models typically employ word or character levels as fundamental input units. However, the simple concatenation of word and character vectors has been proven suboptimal for semantic representation. To address this limitation, this paper conducts an in-depth investigation and proposes a novel framework centered on fine-grained language unit segmentation and fusion. Our research focuses on hybrid character-word modeling to achieve a more effective mixed-granularity representation. We explore advanced fusion methods for character and word embeddings and introduce a shortlist mechanism based on word frequency filtering, which significantly enhances the training for low-frequency and out-of-vocabulary words. Furthermore, we propose leveraging subwords and specialized uncommon character embeddings to enrich word representations, all within a general subword segmentation framework. Recognizing that many leading MRC models lack genuine semantic understanding and often focus on semantically irrelevant components, we argue that the core of MRC aligns with the goal of semantic role labeling (SRL). Consequently, we innovatively integrate SRL into the MRC and reasoning pipeline to provide richer and more accurate semantic prompts. Extensive experimental evaluations demonstrate that our proposed methods consistently improve the benchmark model across a range of language understanding tasks, including natural language inference, question answering, reading comprehension, semantic similarity, and text classification, achieving competitive performance.