Workshop#6 Transformers with spaCy and TensorFlow (Hour 11–12)
摘要
In Chap. 8 , we introduced the basic concepts of Transfer Learning, its motivation, and related background knowledge, including RNNs, Transformer Technology, and the BERT model. This workshop focuses on putting these concepts into practice, with a particular emphasis on implementing Transformer and BERT technologies, integrating them with spaCy’s Transformer Pipeline and TensorFlow. The workshop will begin with an overview of Transformer and BERT Technologies, providing a summary of the key concepts behind these models. It will then explore the implementation of Transformer with TensorFlow, revisiting text classification using the BERT model as an example. Finally, the workshop will introduce spaCy’s Transformer Pipeline Technology and demonstrate how to use it for implementing sentiment analysis and text classification systems.