The website is in Maintenance mode. We are in the process of adding more features.
Any new bookmarks, comments, or user profiles made during this time will not be saved.

Machine Learning Resources

Top 50 Supervised Learning Interview Questions with detailed Answers (All free)

Bookmark this question

Supervised Learning Interview Questions

  1. What is supervised learning? What are some common algorithms used in supervised learning


  1. Explain the concept of Linear Regression
  2. What are the assumptions in a Linear Regression model?
  3. How are coefficients of linear regression estimated?
  4. How is variability measured in Linear Regression?
  5. What are the key evaluation criteria for Linear Regression model?


  1. What is classification, and discuss the different types of classification?
  2. How do you evaluate the performance of a classification model?
  3. What is a ROC curve?
  4. How do you handle imbalanced datasets in classification tasks?
  5. Explain the difference between Gini, Entropy, and Information Gain

Logistic Regression

  1. What is Logistic Regression? Describe the process of how to use logistic regression to fit data
  2. What are the major assumptions of logistic regression?
  3. What are the advantages and disadvantages of logistic regression?
  4. What is the relationship between the log odds ratio and probability?

Ensemble Learning (Decision Trees, Bagging, Random Forest, Boosting)

  1.  What is a Decision Tree? Explain the concept and working of a Decision tree model
  2.  What is Bagging? How do you perform bagging and what are its advantages?
  3.  Explain the concept and working of the Random Forest model
  4.  What is Gradient Boosting (GBM)? Describe how does the Gradient Boosting algorithm work
  5.  What is XGBoost? How does it improve upon standard GBM?
  6.  How is Gradient Boosting different from Random Forest?
  7.  What is the difference between Adaboost and Gradient boost?
  8.  Distinguish between a Weak learner and a Strong Learner
  9.  What are the key hyperparameters in a Random Forest model? 
  10.  GBM vs Random Forest: which algorithm should be used when?
  11.  What is the difference between Decision Trees, Bagging and Random Forest?
  12.  What are the advantages and disadvantages of Decision Tree model? 
  13.  What are the advantages and disadvantages of Random Forest?
  14.  What are the advantages and disadvantages of a GBM model?
  15.  How does pruning a tree work?

Suppor Vector Machine (SVM)

  1. What is the basic idea of Support Vector Machine (SVM) and Maximum Margin?
  2. What hyper-parameters are typically tuned in SVM?
  3. What are the pros/cons of using an SVM model?
  4. What are common choices to use for kernels in SVM?
  5. Describe the hinge loss function used in SVM
  6. What is the kernel trick in SVM?

Other key questions

  1. What is a Generalized Linear Model (GLM)?
  2. Briefly discuss other models that fall within the scope of GLM.
  3. What is the difference between a generative and a discriminative model?
  4. What is a naive bayes classifier? Explain how does Naive Bayes work
  5. What are the Pros/Cons of Naive Bayes? 
  6. How does discriminant analysis work at a high level?
  7. What is the difference between classification and regression in supervised learning?
  8. What is the difference between Feature Engineering and Feature Selection?
  9. What is Feature Scaling? Explain the different feature scaling techniques?
  10. What is Feature Standardization and why is it needed?
  11. What is overfitting, and how can it be prevented in supervised learning?
  12. What is underfitting and how can it be prevented?
  13. What does L1 regularization (Lasso) mean?
  14. What does L2 regularization (Ridge) mean?

Relevant articles:

Leave your Comments and Suggestions below:

Please Login or Sign Up to leave a comment

Partner Ad  

Find out all the ways
that you can

Explore Questions by Topics

Partner Ad

Learn Data Science with Travis - your AI-powered tutor |