First, let’s see what is regularization from a simple example. Then we will have a look at some different types of loss functions.

## Regularization

Reviewed the definition of regularization today from Andrew’s lecture videos. Continue reading

Skip to content
#
Energy-Based Learning

# Deep Learning 12: Energy-Based Learning (2)–Regularization & Loss Functions

## Regularization

# Deep Learning 11: Energy-Based Learning (1)–What is EBL?

First, let’s see what is regularization from a simple example. Then we will have a look at some different types of loss functions.

Reviewed the definition of regularization today from Andrew’s lecture videos. Continue reading

As a part of our goals, it is absolutely important to look back and think about the loss functions we applied, for example, the cross entropy. There are other types, however, targeting on different practical problems and you will need to think about which one is suitable. Besides, the Energy-Based Models (EBMs) provides more. These are learning notes from A Tutorial on Energy-Based Learning. Continue reading