What are some ways to address the vanishing/exploding gradient issue?
The following are some options that have been shown to reduce the risk of experiencing a vanishing or exploding gradient
deep learning
What is the vanishing/exploding gradient problem?
The vanishing or exploding gradient is an issue often encountered in the training of deep Neural Networks.
What are some options for making Backpropagation more efficient?
In a deep network with many hidden layers, it can be very computationally intensive to compute derivatives of all of the parameters of the network.
How does Machine Learning differ from Classical Statistics and Deep Learning?
Classical statistics tends to focus more on the process of inference, or learning from data, while in Machine Learning, prediction accuracy is usually more of interest.