What does Gradient in Gradient Boosted Trees refer to?
In Gradient Boosted Trees, the term “Gradient” refers to the gradient of the loss function being optimized. The negative gradient indicates the direction of steepest descent, which is the direction that will result in the greatest decrease in loss function.