Deep Learning Notes 1 – NN (Repost)

Got stuck here but I know it is a good post 😀




Neural networks are important for deep learning. A nueral network model comprises multiple layers of logistic regression models, as shown in the figure below.


In the figure above, denotes the weight from neuron i to neuron j in layer , the index i refers to a source node and j referes to a target node. denotes the number of neurons in layer .

Forward Propagation

For a given input vector ( as a bias ), which is sent to a neural network from input layer, the information will be sent and transformed layer by layer from input layer to output layer. In output layer, it yields a output variable in case of binary classification and regression (only one neuron in output layer), it yields multiple vectors in case of multiple classification (multiple neurons in output layer).

For each neuron, the process of information…

View original post 153 more words

Published by Irene

Keep calm and update blog.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: