Skip to main content Skip to footer

Home
Interview Questions
Technical Quizzes
AI Fun Games
Jobs

Home
Interview Questions
Technical Quizzes
AI Fun Games
Jobs

Explore Questions by Topics

Computer Vision (15)
Generative AI (3)
Reinforcement Learning (13)
Agentic AI (5)
Machine Learning Basics (18)
Deep Learning (78)
- DL Basics (16)
- DL Architectures (21)
  - Feedforward Network / MLP (3)
  - Sequence models (6)
  - Transformers (11)
- DL Training and Optimization (39)
Natural Language Processing (34)
- NLP Data Preparation (18)
Supervised Learning (115)
- Regression (41)
  - Linear Regression (26)
  - Generalized Linear Models (9)
  - Regularization (6)
- Classification (70)
  - Logistic Regression (10)
  - Support Vector Machine (9)
  - Ensemble Learning (24)
  - Other Classification Models (9)
  - Classification Evaluations (9)
Unsupervised Learning (64)
- Clustering (40)
  - Distance Measures (9)
  - K-Means Clustering (10)
  - Hierarchical Clustering (3)
  - Gaussian Mixture Models (5)
  - Clustering Evaluations (5)
- Dimensionality Reduction (12)
Statistics (35)
Data Preparation (35)
- Feature Engineering (30)
- Sampling Techniques (5)

DL Training and Optimization

Q. What is AutoGrad?
Q. Explain Different Approaches for Distributed Optimization
Q. How Do Residual Connections Help Neural Network Training?
Q. What are Adapters in Large Language Models (LLMs)?
Q. How is LoRA different from Adapters? And when to use which?
Q. How Learning Rate Scheduling Works (with PyTorch Examples)
Q. Explain Newton’s Method
Q. Gradient Descent and Its Variants
Q. Reinforcement Learning Based Fine-Tuning (RLHF vs. DPO)
Q. Weight Initialization in Deep Neural Networks
Q. Understanding LoRA (Low-Rank Adaptation)
Q. Adam vs AdamW: Understanding Optimizers in Deep Learning
Q. What is Kaiming Initialization?
Q. What is Xavier Initialization?
Q. Comparison of Optimization Algorithms: SGD, Adagrad, Adam and more
Q. What is Layer Normalization? How does it improve Neural Net training?
Q. Difference between Batch Normalization and Layer Normalization
Q. Batch Normalization Explained: Improve Deep Neural Network Training
Q. What is AdaGrad Optimizer in Deep Learning?
Q. What is AdaDelta Optimizer in Deep Learning?
Q. What is RMSProp Optimizer in Deep Learning?
Q. What is Momentum in Optimization for Deep Learning?
Q. What is Parameter Efficient Fine-Tuning (PEFT)?
Q. What is an activation function? What are the different types of activation functions? Discuss their pros and cons
Q. What is Rectified Linear Unit (ReLU) activation function? Discuss its advantages and disadvantages
Q. What is the “dead ReLU” problem and, why is it an issue in Neural Network training?
Q. What are some strategies to address Overfitting in Neural Networks?
Q. What is Dropout?
Q. Describe briefly the training process of a Neural Network model
Q. What do you mean by saturation in neural network training? Discuss the problems associated with saturation
Q. Explain the Vanishing and Exploding Gradient Problems in Deep Learning
Q. Why is Zero-centered output preferred for an activation function?
Q. What are the key hyper-parameters of a neural network model?
Q. What is an activation function, and what are some of the most common choices for activation functions?
Q. What are some options for making Backpropagation more efficient?
Q. Discuss Softmax activation function
Q. What is Sigmoid (logistic) activation function?
Q. Discuss TanH activation function
Q. What are some guidelines for choosing activation functions?

Partner Ad

Explore Questions by Topics

Computer Vision (15)
Generative AI (3)
Reinforcement Learning (13)
Agentic AI (5)
Machine Learning Basics (18)
Deep Learning (78)
- DL Basics (16)
- DL Architectures (21)
  - Feedforward Network / MLP (3)
  - Sequence models (6)
  - Transformers (11)
- DL Training and Optimization (39)
Natural Language Processing (34)
- NLP Data Preparation (18)
Supervised Learning (115)
- Regression (41)
  - Linear Regression (26)
  - Generalized Linear Models (9)
  - Regularization (6)
- Classification (70)
  - Logistic Regression (10)
  - Support Vector Machine (9)
  - Ensemble Learning (24)
  - Other Classification Models (9)
  - Classification Evaluations (9)
Unsupervised Learning (64)
- Clustering (40)
  - Distance Measures (9)
  - K-Means Clustering (10)
  - Hierarchical Clustering (3)
  - Gaussian Mixture Models (5)
  - Clustering Evaluations (5)
- Dimensionality Reduction (12)
Statistics (35)
Data Preparation (35)
- Feature Engineering (30)
- Sampling Techniques (5)

Search

Join us on:

Machine Learning Interview Preparation Group
@OfficialAIML

Find out all the ways that you can

Other Questions in DL Training and Optimization

What do you mean by saturation in neural network training? Discuss the problems associated with saturation
What is Jaccard Index / Distance?
Understanding WordPiece Tokenization: An Approach to Subword Units
Weight Initialization in Deep Neural Networks
RAG Architecture: A beginner’s guide
What is Simple Random Sampling?

© 2026 AIML.COM | ♥ Sunnyvale, California