This chapter evaluates transfer learning approaches in three experiments for detecting harmful content. The first focuses on fine-tuning vs. feature extraction for hate speech detection using models pretrained models (i.e., LLMs) like BERT, RoBERTa, and XLNet in Sect. 4.2. The second explores the performance of different pretrained models in feature extraction settings in Sect. 4.3. Results suggest that domain-aware configurations, like leveraging multiple pretrained layers, significantly improve results. The third experiment frames claim extraction as a sequence-to-sequence task, testing T5 and PEGASUS in zero-shot, fine-tuned, extractive, and query-based summarization settings (Sect. 4.4). Fine-tuned abstractive models perform best, indicating that output-generating models benefit more from domain-specific training. Overall, the chapter highlights the adaptability of TL for text classification and generation tasks and its power in data-scarce contexts.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Transfer Learning for Harmful Content Detection

  • Salar Mohtaj

摘要

This chapter evaluates transfer learning approaches in three experiments for detecting harmful content. The first focuses on fine-tuning vs. feature extraction for hate speech detection using models pretrained models (i.e., LLMs) like BERT, RoBERTa, and XLNet in Sect. 4.2. The second explores the performance of different pretrained models in feature extraction settings in Sect. 4.3. Results suggest that domain-aware configurations, like leveraging multiple pretrained layers, significantly improve results. The third experiment frames claim extraction as a sequence-to-sequence task, testing T5 and PEGASUS in zero-shot, fine-tuned, extractive, and query-based summarization settings (Sect. 4.4). Fine-tuned abstractive models perform best, indicating that output-generating models benefit more from domain-specific training. Overall, the chapter highlights the adaptability of TL for text classification and generation tasks and its power in data-scarce contexts.