In Chap. 8 , we introduced the basic concepts of Transfer Learning, its motivation, and related background knowledge, including RNNs, Transformer Technology, and the BERT model. This workshop focuses on putting these concepts into practice, with a particular emphasis on implementing Transformer and BERT technologies, integrating them with spaCy’s Transformer Pipeline and TensorFlow. The workshop will begin with an overview of Transformer and BERT Technologies, providing a summary of the key concepts behind these models. It will then explore the implementation of Transformer with TensorFlow, revisiting text classification using the BERT model as an example. Finally, the workshop will introduce spaCy’s Transformer Pipeline Technology and demonstrate how to use it for implementing sentiment analysis and text classification systems.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Workshop#6 Transformers with spaCy and TensorFlow (Hour 11–12)

  • Raymond Lee

摘要

In Chap. 8 , we introduced the basic concepts of Transfer Learning, its motivation, and related background knowledge, including RNNs, Transformer Technology, and the BERT model. This workshop focuses on putting these concepts into practice, with a particular emphasis on implementing Transformer and BERT technologies, integrating them with spaCy’s Transformer Pipeline and TensorFlow. The workshop will begin with an overview of Transformer and BERT Technologies, providing a summary of the key concepts behind these models. It will then explore the implementation of Transformer with TensorFlow, revisiting text classification using the BERT model as an example. Finally, the workshop will introduce spaCy’s Transformer Pipeline Technology and demonstrate how to use it for implementing sentiment analysis and text classification systems.