Category: Theory

Prepare for the Interviews!

~ Irene ~ 2 Comments

For the past few years after my Master’s, I did many jobs, long term, short term, internship, or full-time. I also had too many interviews, some of them I failed. Together with my friends, we had collected many materials, including basic algorithms, popular questions, basic machine learning knowledge, and deep learning knowledge. Then I organized them as one huge PDF (150+ pages).

A very brief outline:

  • Sorting
  • Data structure + popular questions
  • Machine Learning 
  • SoftDev interview questions

The material covers some screenshots from other people’s lectures and books. [Some slide pages are not in English! I am too lazy to translate them..]

I went through this PDF each time before there is an interview, in the case to answer questions like “what is knn”.   I hope you may find the material useful.  Download link:

interview_beta

Recently, I am working on a new version by adding more deep learning basics.

 

Understanding Variational Graph Auto-Encoders

~ Irene ~ 2 Comments

Variational Auto-Encoders

My post about Auto-encoder.
For Variational Auto-Encoders (VAE) (from paper Auto-Encoding Variational Bayes), we actually add latent variables to the existing Autoencoders. The main idea is, we want to restrict the parameters from a known distribution. Why we want this? We wish the generative model to provide more “creative” things. If the model only sees the trained samples, it will eventually lose the ability to “create” more! So we add some “noises” to the parameters by forcing the parameters to adapt to a known distribution.

Continue reading “Understanding Variational Graph Auto-Encoders” →

TensorFlow 08: save and restore a subset of variables

~ Irene ~ Leave a comment

TensorFlow provides save and restore functions for us to save and re-use the model parameters. If you have a trained VGG model, for example, it will be helpful for you to restore the first few layers then apply them in your own networks. This may raise a problem, how do we restore a subset of the parameters? You can always check the TF official document here. In this post, I will take some code from the document and add some practical points.

Continue reading “TensorFlow 08: save and restore a subset of variables” →