Workshop#6 Transformers with spaCy and TensorFlow (Hour 11–12)

In Chap. 8 , the basic concept about Transfer Learning, its motivation and related background knowledge such as Recurrent Neural Networks (RNN) with Transformer Technology and BERT model are introduced. This workshop explores how to put these concepts and theories into practice. More importantly, is to implement Transformers, BERT Technology with the integration of spaCy’s Transformer Pipeline Technology and TensorFlow. Firstly, it gives an overview and summation on Transformer and BERT Technology. Secondly, it explores Transformer implementation with TensorFlow by revisiting Text Classification using BERT model as example. Thirdly, it introduces spaCy’s Transformer Pipeline Technology and how to implement Sentiment Analysis and Text Classification system using Transformer Technology.