What is a closed form solution, and what are the advantages of a problem having such a solution? Which algorithms have a closed form solution?
A closed form solution occurs when the optimization objective function can be derived by hand and written in an explicit form consisting of a finite number of mathematical operations.