First, let’s see what is regularization from a simple example. Then we will have a look at some different types of loss functions.
Reviewed the definition of regularization today from Andrew’s lecture videos. Continue reading “Deep Learning 12: Energy-Based Learning (2)–Regularization & Loss Functions”
As a part of our goals, it is absolutely important to look back and think about the loss functions we applied, for example, the cross entropy. There are other types, however, targeting on different practical problems and you will need to think about which one is suitable. Besides, the Energy-Based Models (EBMs) provides more. These are learning notes from A Tutorial on Energy-Based Learning. Continue reading “Deep Learning 11: Energy-Based Learning (1)–What is EBL?”
