# Logistic Regression

### What is Logistic Regression?

Logistic Regression is a case of Generalized Linear Model used in situations where the response variable is a binary outcome.

### What is the error / loss function in logistic regression?

Logistic regression uses a logistic loss function, where the cost for a single observation is represented by:

### What are the major assumptions of logistic regression?

Logistic regression requires the following assumption: independence of observations

### What are some pros and cons of logistic regression?

Pros:Through a simple transformation, much of the interpretability and intuition of linear regression is preserved

### What is the equivalent of the overall F test in logistic regression?

The equivalent of the overall F-Test in logistic regression is Deviance.

### Why are coefficients estimated through Maximum Likelihood (MLE) instead of Least Squares?

The least squares cost function is non-convex in a binary classification setting, meaning the algorithm could get stuck in a local rather than global minimum and thus fail to optimize the loss.

### How are the coefficients in a logistic expression interpreted?

Each ? is interpreted as the change in log odds of a success for a 1-unit increase in the corresponding predictor, holding all other variables constant.

### What is the relationship between the log odds ratio and probability?

Logistic regression relates the log odds to the weighted combination of predictors and coefficients

### Why are the log odds used in the link function instead of just the regular odds ratio?

The odds, or the ratio of the probability of success to that of failure, can only take on positive values.