### What is Dropout?

Dropout refers to randomly turning off hidden units so that a smaller network is trained on a given pass

- Machine Learning 101 (30)
- Statistics 101 (38)
- Supervised Learning (108)
- Regression (36)
- Classification (46)
- Logistic Regression (10)
- Support Vector Machine (10)
- Naive Bayes (4)
- Discriminant Analysis (5)
- Classification Evaluations (9)

- Classification & Regression Trees (CART) (23)

- Unsupervised Learning (46)
- Clustering (17)

- Regularization (6)
- Deep Learning (23)
- Data Preparation (43)
- General (5)
- Standardization (6)
- Missing data (7)
- Textual Data (16)
- Dimensionality Reduction (9)

Dropout refers to randomly turning off hidden units so that a smaller network is trained on a given pass

Overfitting can be mitigated by collecting more training data, using regularization and so on

A model that is underfit will produce evaluation metrics that are poor on the training data alone, such as high RMSE or misclassification rate.

Overfitting occurs when a model fails to perform at a similar level of accuracy on data that was not used in the training process compared to data that it was explicitly built on.

Tuning the combination of number of trees and learning rate is a good way to ensure you are creating a model with appropriate complexity.

Find out all the ways

that you can