Please check my notes for an updated version about Transfer Learning with NLP tasks:
Irene_TransferLearning_2020Spring
A brief outline:
- Transfer Learning with word embedding
- Pre-BERT times
- BERT and its variants
- Understanding, reducing BERT
- Transfer Learning in the real world
Also, visit my A brief Introduction on Transfer Learning notes from 2019 Spring.