The website is in Maintenance mode. We are in the process of adding more features.
Any new bookmarks, comments, or user profiles made during this time will not be saved.

AIML.com

Machine Learning Resources

What is a closed form solution, and what are the advantages of a problem having such a solution? Which algorithms have a closed form solution?

Bookmark this question

A closed form solution occurs when the optimization objective function can be derived by hand and written in an explicit form consisting of a finite number of mathematical operations. Examples of closed form solutions include the quadratic formula and normal equations in least squares regression. 

Problems that have a closed form solution can be optimized at a much faster speed than those that require numeric approximation. It is also advantageous for documentation and interpretation to be able to clearly derive the form of the solution. Linear regression (without regularization) has a closed form solution, and among classification algorithms, Discriminant Analysis and Naive Bayes are known for having solutions of such a form. 

Leave your Comments and Suggestions below:

Please Login or Sign Up to leave a comment

Partner Ad  

Find out all the ways
that you can

Explore Questions by Topics