Transfer Learning Materials

Keep Updating….

Thesis:

Deep Learning Models for Unsupervised and Transfer Learning PhD Thesis, University of Toronto, May 2017
Transfer Learning Techniques for Deep Neural Nets , Steven Michael Gutstein, 2010
Feature-based Transfer Learning and Real-world applications, Sinno Jialin Pan

Survey:

http://www.jmlr.org/papers/volume10/taylor09a/taylor09a.pdf (with Reinforcement Learning 2009)
https://www.cse.ust.hk/~qyang/Docs/2009/tkde_transfer_learning.pdf (2009)
ijcai13.org/files/tutorial_slides/td2.pdf (applications)
https://arxiv.org/pdf/1705.04396.pdf (2017)
https://arxiv.org/pdf/1707.08114.pdf (2017) (Multi-task Learning)
https://journalofbigdata.springeropen.com/articles/10.1186/s40537-016-0043-6 (2015-2016)
http://www.umiacs.umd.edu/~pvishalm/Journal_pub/SPM_DA_v9.pdf(2015)

Theory Papers:

CV How transferable are features in deep neural networks? (NIPS,2014)
CV Deep Domain Confusion: Maximizing for Domain Invariance (2014)
NLP How Transferable are Neural Networks in NLP Applications? (2016)
Summarization A Pilot Study of Domain Adaptation Effect for Neural Abstractive Summarization (2017)

New Papers

CV Joint distribution optimal transportation for domain adaptation (NIPS 17’ poster) code
One-Sided Unsupervised Domain Mapping (NIPS 17’ poster) code (?)
CV, Adversarial Few-Shot Adversarial Domain Adaptation (NIPS 17’ poster)
CV, NLP Asymmetric Tri-training for Unsupervised Domain Adaptation (ICML 17’) code
RL DARLA: Improving Zero-Shot Transfer in Reinforcement Learning (ICML 17’)
NLP Supervised and Unsupervised Transfer Learning for Question Answering (Naacl 18’) code
CV Learning to cluster in order to transfer across domains and tasks (ICLR 18’)
NLP Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm (EMNLP 17’)

EMNLP 17

Learning to select data for transfer learning with Bayesian Optimization
Cross-Lingual Induction and Transfer of Verb Classes Based on Word Vector Space Specialisation
Cross-Lingual Transfer Learning for POS Tagging without Cross-Lingual Resources
Two-Stage Synthesis Networks for Transfer Learning in Machine Comprehension

ACL 2018

Recursive Neural Structural Correspondence Network for Cross-domain Aspect and Opinion Co-Extraction
Strong Baselines for Neural Semi-supervised Learning under Domain Shift
Domain Adaptation with Adversarial Training and Graph Embeddings paper
Two Methods for Domain Adaptation of Bilingual Tasks: Delightfully Simple and Broadly Applicable.
Domain Adapted Word Embeddings for Improved Sentiment Classification paper
Zero-Shot Transfer Learning for Event Extraction paper
Identifying Transferable Information Across Domains for Cross-domain Sentiment Classification
A Helping Hand: Transfer Learning for Deep Sentiment Analysis
Transfer Learning for Context-Aware Question Matching in Information-seeking Conversation Systems in E-commerce
Asymmetric Tri-training for Unsupervised Domain Adaptation

EMNLP 2018

TBD

Codes & Papers:

CV ADDA (Adversarial Discriminative Domain Adaptation, arXiv-17) TensorFlow
CV Return of Frustratingly Easy Domain Adaptation. (ICCV-2016, Best Paper)
CV Domain-Adversarial Training of Neural Networks (JMLR-16) TensorFlow
CV Deep Hashing Network for Unsupervised Domain (CVPR-17) Matlab
CV Correlation Alignment for Domain Adaptation Matlab
CV Zero-Shot Learning by Convex Combination of Semantic Embeddings
CV Learning Transferable Features with Deep Adaptation Networks (ICML, 2015)
NLP Transfer Learning for Speech and Language Processing (2015)
NLP Multi-task Autoencoders for Domain Generalization (ICCV-15) Keras
NLP Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation (2016)
MT Transfer Learning for Low-Resource Neural Machine Translation
NLP, recsys TransNets: Learning to Transform for Recommendation (2017)
NLP A Practitioners’ Guide to Transfer Learning for Text Classification using Convolutional Neural Networks (2018)

Earlier Papers:

Self-taught Learning: Transfer Learning from Unlabeled Data (ICML 2007)
Self-taught Clustering (ICML 2008)
How Transferable are Neural Networks in NLP Applications? (EMNLP 2016 long)

Presentation Slides and Talks

http://speech.ee.ntu.edu.tw/~tlkagk/courses/ML_2017/Lecture/transfer.pdf
https://epat2014.sciencesconf.org/conference/epat2014/pages/slides_DA_epat_17.pdf
https://simons.berkeley.edu/talks/trevor-darrell-2017-3-29 (Video)
lamda.nju.edu.cn/conf/mlss2014/content/qiangyang.pdf (2014, tutorial, Yangqiang)

Resources, materials and interesting ideas:

http://tommasit.wixsite.com/datl14tutorial/bibliography (2014, list of papers, tutorials)
Fighting Offensive Language on Social Media with Unsupervised Text Style Transfer
Deep Text Style Transfer
Multilingual embeddings (2017)
Transfer Learning in NLP (2018)

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s