Skip to main content Skip to footer

Home
Interview Questions
Technical Quizzes
AI Fun Games
Jobs

Home
Interview Questions
Technical Quizzes
AI Fun Games
Jobs

Explore Questions by Topics

Computer Vision (15)
Generative AI (3)
Reinforcement Learning (13)
Agentic AI (5)
Machine Learning Basics (18)
Deep Learning (78)
- DL Basics (16)
- DL Architectures (21)
  - Feedforward Network / MLP (3)
  - Sequence models (6)
  - Transformers (11)
- DL Training and Optimization (39)
Natural Language Processing (34)
- NLP Data Preparation (18)
Supervised Learning (115)
- Regression (41)
  - Linear Regression (26)
  - Generalized Linear Models (9)
  - Regularization (6)
- Classification (70)
  - Logistic Regression (10)
  - Support Vector Machine (9)
  - Ensemble Learning (24)
  - Other Classification Models (9)
  - Classification Evaluations (9)
Unsupervised Learning (64)
- Clustering (40)
  - Distance Measures (9)
  - K-Means Clustering (10)
  - Hierarchical Clustering (3)
  - Gaussian Mixture Models (5)
  - Clustering Evaluations (5)
- Dimensionality Reduction (12)
Statistics (35)
Data Preparation (35)
- Feature Engineering (30)
- Sampling Techniques (5)

Deep Learning

Q. Multilayer Perceptrons: Task-Specific Design and Self-Attention
Q. What is AutoGrad?
Q. Explain Different Approaches for Distributed Optimization
Q. How Do Residual Connections Help Neural Network Training?
Q. What are Adapters in Large Language Models (LLMs)?
Q. How is LoRA different from Adapters? And when to use which?
Q. How Learning Rate Scheduling Works (with PyTorch Examples)
Q. Explain Newton’s Method
Q. RAG Architecture: A beginner’s guide
Q. Gradient Descent and Its Variants
Q. Reinforcement Learning Based Fine-Tuning (RLHF vs. DPO)
Q. Weight Initialization in Deep Neural Networks
Q. Understanding LoRA (Low-Rank Adaptation)
Q. Adam vs AdamW: Understanding Optimizers in Deep Learning
Q. What is Kaiming Initialization?
Q. What is Xavier Initialization?
Q. Comparison of Optimization Algorithms: SGD, Adagrad, Adam and more
Q. What is Layer Normalization? How does it improve Neural Net training?
Q. Difference between Batch Normalization and Layer Normalization
Q. Batch Normalization Explained: Improve Deep Neural Network Training
Q. T5 Architecture Explained & Encoder-Decoder Model Comparison
Q. Compare the different Transformer-based model architectures
Q. What is AdaGrad Optimizer in Deep Learning?
Q. What is AdaDelta Optimizer in Deep Learning?
Q. What is RMSProp Optimizer in Deep Learning?
Q. What is Momentum in Optimization for Deep Learning?
Q. What is Parameter Efficient Fine-Tuning (PEFT)?
Q. What is a Vector Database and How is it used for RAG?
Q. What is Knowledge Distillation?
Q. Explain ROUGE and its importance in NLP
Q. What is Instruction Fine-Tuning
Q. What is Convolution?
Q. Explain Perplexity
Q. What is Precision@K?
Q. What is Supervised Fine-Tuning?
Q. Making Transformers Work: Scale, Access, Deployment and Ethics
Q. Top 20 Deep Learning Interview Questions with detailed Answers
Q. What is Deep Learning? Key Features, Working & Applications
Q. What are the advantages and disadvantages of Deep Learning?
Q. How does Deep Learning methods compare with traditional Machine Learning methods?
Q. Explain the basic architecture of a Neural Network, model training and key hyper-parameters
Q. What is an activation function? What are the different types of activation functions? Discuss their pros and cons
Q. What is Backpropagation?
Q. What is a Perceptron? What is the role of bias in a perceptron (or neuron)?
Q. What is a Multilayer Perceptron (MLP) or a Feedforward Neural Network (FNN)?
Q. What are Sequence Models? Discuss the key Sequence modeling algorithms and their real world applications
Q. What are the key hyper-parameters of a neural network model?
Q. Sequence Models Compared: RNNs, LSTMs, GRUs, and Transformers
Q. What is Rectified Linear Unit (ReLU) activation function? Discuss its advantages and disadvantages
Q. What do you mean by pretraining, finetuning and transfer learning?
Q. Explain the Vanishing and Exploding Gradient Problems in Deep Learning
Q. What do you mean by Sequence data? Discuss the different types
Q. What are Transformers? Discuss the evolution, advantages and major breakthroughs in transformer models
Q. Understanding the architecture of Recurrent Neural Networks (RNN)
Q. What are the advantages and disadvantages of a Recurrent Neural Network (RNN)?
Q. Explain the Transformer Architecture (with Examples and Videos)
Q. What is Long-Short Term Memory (LSTM)?
Q. What are the primary advantages of transformer models?
Q. What are the limitations of transformer models?
Q. Explain Self-Attention, and Masked Self-Attention as used in Transformers
Q. Multi-Head Attention: Why It Outperforms Single-Head Models
Q. What is the “dead ReLU” problem and, why is it an issue in Neural Network training?
Q. Explain the need for Positional Encoding in Transformer models
Q. Cross-Attention vs Self-Attention Explained
Q. Why is Zero-centered output preferred for an activation function?
Q. What is an activation function, and what are some of the most common choices for activation functions?
Q. What do you mean by saturation in neural network training? Discuss the problems associated with saturation
Q. What are some strategies to address Overfitting in Neural Networks?
Q. What is Dropout?
Q. What is the difference between Deep and Shallow networks?
Q. Describe briefly the training process of a Neural Network model
Q. What is Sigmoid (logistic) activation function?
Q. Discuss TanH activation function
Q. What are some options for making Backpropagation more efficient?
Q. What is the difference between a Batch and an Epoch?
Q. Discuss Softmax activation function
Q. What are some guidelines for choosing activation functions?
Q. How are Regression and Classification performed using multilayer perceptrons (MLP)?

Partner Ad

Explore Questions by Topics

Computer Vision (15)
Generative AI (3)
Reinforcement Learning (13)
Agentic AI (5)
Machine Learning Basics (18)
Deep Learning (78)
- DL Basics (16)
- DL Architectures (21)
  - Feedforward Network / MLP (3)
  - Sequence models (6)
  - Transformers (11)
- DL Training and Optimization (39)
Natural Language Processing (34)
- NLP Data Preparation (18)
Supervised Learning (115)
- Regression (41)
  - Linear Regression (26)
  - Generalized Linear Models (9)
  - Regularization (6)
- Classification (70)
  - Logistic Regression (10)
  - Support Vector Machine (9)
  - Ensemble Learning (24)
  - Other Classification Models (9)
  - Classification Evaluations (9)
Unsupervised Learning (64)
- Clustering (40)
  - Distance Measures (9)
  - K-Means Clustering (10)
  - Hierarchical Clustering (3)
  - Gaussian Mixture Models (5)
  - Clustering Evaluations (5)
- Dimensionality Reduction (12)
Statistics (35)
Data Preparation (35)
- Feature Engineering (30)
- Sampling Techniques (5)

Search

Join us on:

Machine Learning Interview Preparation Group
@OfficialAIML

Find out all the ways that you can

Other Questions in Deep Learning

What is the difference between Supervised and Unsupervised Learning
Describe the hinge loss function used in SVM
Understanding WordPiece Tokenization: An Approach to Subword Units
What is Exclusive Clustering?
How does K-Means ++ work?
What are the key hyper-parameters of a neural network model?

© 2026 AIML.COM | ♥ Sunnyvale, California