### What is Information Criteria (AIC, BIC)?

Information Criteria is a more modern selection measure. Measures such as AIC and BIC, attempt to balance fit and complexity

- Machine Learning 101 (30)
- Statistics 101 (38)
- Supervised Learning (108)
- Regression (36)
- Classification (46)
- Logistic Regression (10)
- Support Vector Machine (10)
- Naive Bayes (4)
- Discriminant Analysis (5)
- Classification Evaluations (9)

- Classification & Regression Trees (CART) (23)

- Unsupervised Learning (46)
- Clustering (17)

- Regularization (6)
- Deep Learning (23)
- Data Preparation (43)
- General (5)
- Standardization (6)
- Missing data (7)
- Textual Data (16)
- Dimensionality Reduction (9)

Measures of error (MSE, MAE, RMSE), or a measure of the overall variability in the model, can also be used as a goodness of fit criteria

R-squared is the classic evaluation metric in linear regression, or more precisely if there are multiple predictors, adjusted R-squared.

Global F test is the most high-level model significance measure, which simply reports if any component of the model is significant.

Find out all the ways

that you can