Attention Quiz (Easy)

What is the primary purpose of an attention mechanism in deep learning models?

Which of the following deep learning architectures commonly uses the attention mechanism?

What is positional encoding in the Transformer model, and why is it necessary?

In the context of the Transformer model, what is the primary motivation behind using multi-head self-attention?

When implementing self-attention in deep learning models, what is the purpose of the masking mechanism?

In the context of natural language processing, what is the primary difference between self-attention and cross-attention?