adam

What are some options for making Backpropagation more efficient?

In a deep network with many hidden layers, it can be very computationally intensive to compute derivatives of all of the parameters of the network.

Data Preparation (43)
- Dimensionality Reduction (9)
- General (5)
- Missing data (7)
- Standardization (6)
- Textual Data (16)
Deep Learning (23)
Machine Learning 101 (30)
Regularization (6)
Statistics 101 (38)
Supervised Learning (108)
- Classification (36)
  - Discriminant Analysis (5)
  - Naive Bayes (4)
  - Support Vector Machine (10)
- Classification & Regression Trees (CART) (23)
- Regression (46)
  - Generalized Linear Model (GLM) (9)
  - Linear Regression (27)
  - Logistic Regression (10)
Unsupervised Learning (46)
- Clustering (17)
  - Gaussian Mixture Models (5)
  - Hierarchical Clustering (4)
  - K-Means Clustering (10)