What is Dropout?

Dropout refers to randomly turning off hidden units so that a smaller network is trained on a given pass

Read more..

What is Backpropagation? 

In Backwards Propagation, the parameters of a Neural Network (all of the weight and bias terms) are updated using a gradient descent optimization

Read more..