The website is in Maintenance mode. We are in the process of adding more features.
Any new bookmarks, comments, or user profiles made during this time will not be saved.

Machine Learning Resources

What is Supervised Learning?

Bookmark this question

Supervised learning refers to the task of learning from labeled training data in order to make predictions or classify new, unseen data. In this approach, the algorithm is given a set of labeled examples (input feature vectors and its corresponding output), and the task is to learn a function that maps the input feature vectors to the correspond output. This type of learning is called “supervised” because the data used for training has already been labeled and the algorithm is guided by this “teacher.”

Supervised learning can be classified into regression and classification problems. If the outcome is continuous, the problem is solved via a regression context. And if the outcome has discrete categories, a classification approach is taken.


Regression Analysis

Maps input features to a “continued output value (numeric)”

  • Use a real-estate dataset of house selling prices to predict the estimated selling price of a new house. The dataset might contain information about the number of beds, bathrooms, square footage, year built, etc. (referred to as input features) and the corresponding selling price (referred as labeled output value). The goal is to learn a function that can accurately learn a mapping between these input features and the output value. Once such a function is learned (supervised learning), we can predict the estimated selling price of a new house by providing the corresponding input features.
  • Using a company’s financial data, predict the stock price for the next day. Since the price of a stock is a continuous value, this is a regression problem.

Classification Analysis

Maps input features to a “discrete output value (categorical)”

  • Using a company’s financial data, predict if the stock will go up or down the next day. Since we are only predicting if the stock price will go up or down (instead of predicting the actual stock price), this is a classification problem
  • Given a dataset of dog and cat images, learn a function that can correctly classify any new image into a dog or a cat image

The following infographics from Booz Allen Hamilton provides a pictorial explanation of what is supervised learning:

What is Supervised Learning? (Source: Booz Allen Hamilton A guide to how machines learn)

Video Explanation

  • In the two-set videos (Lecture 4 & 5) by Andrew Ng, he describes what is Supervised learning using examples, and how the two different types of supervised learning namely regression and classification differ from each other. (Total Runtime: 13 mins)
Supervised Learning by Prof. Andrew Ng, Stanford and DeepLearning AI
  • In the video by IBM, the speaker, Martin Keen, explains the difference between Supervised and Unsupervised Learning, and the pros and cons of each. (Runtime: 7 mins)
Supervised vs Unsupervised Learning by Martin Keen, IBM
  • If you are interested in a more technical explanation, check out the video by ‘mathematicalmonk’, who explains the concept of Supervised Learning using mathematical formulae. (Runtime: 10 mins)
Supervised Learning by mathematicalmonk Youtube channel

Leave your Comments and Suggestions below:

Please Login or Sign Up to leave a comment

Partner Ad  

Find out all the ways
that you can

Explore Questions by Topics

Partner Ad

Learn Data Science with Travis - your AI-powered tutor |