DL Training and Optimization Quiz (Easy)

What is the primary goal of training a deep learning model?

In the context of training neural networks, what does “backpropagation” refer to?

What is the purpose of an activation function during training?

What is the purpose of data augmentation in training deep learning models?

Which method is used to combat the problem of overfitting by randomly deactivating a fraction of neurons during each training iteration?

What is early stopping in the context of training deep learning models?

What is the purpose of a learning rate in the context of training deep learning models?

What is weight initialization, and why is it important when training neural networks?

When training a deep neural network, what is the vanishing gradient problem, and how is it typically addressed?

When training a neural network, what does the term “exploding gradient” refer to?