The website is in Maintenance mode. We are in the process of adding more features.
Any new bookmarks, comments, or user profiles made during this time will not be saved.

Machine Learning Resources

How does gradient descent differ from coordinate descent?

Bookmark this question

Coordinate descent does not require knowledge of or computation of the derivative of the objective function; rather, it only considers the coordinates of the function itself. Whereas gradient descent moves in the direction of steepest descent, coordinate descent searches for the minimum of the function by separately moving along the axes of its coordinates. Gradient descent can be conceptualized by picturing a ball rolling down a hill until it reaches the bottom, while coordinate descent is more like someone starting at one corner of a city and following streets arranged in a grid pattern in order to reach the other side. Coordinate descent is preferred when computation and evaluation of a function’s derivative is time consuming. 

Leave your Comments and Suggestions below:

Please Login or Sign Up to leave a comment

Partner Ad  

Find out all the ways
that you can

Explore Questions by Topics

Partner Ad

Learn Data Science with Travis - your AI-powered tutor |