Question 5 (Intermediate):
In a neural network, what does the ReLU activation function return?

A) 1 / (1 + e^-x)
B) max(0, x)
C) x^2
D) e^x / (e^x + 1)

#NeuralNetworks #DeepLearning #ActivationFunctions #ReLU #AI

Question 6 (Advanced):
Which of the following attention mechanisms is used in transformers?

A) Hard Attention
B) Additive Attention
C) Self-Attention
D) Bahdanau Attention

#Transformers #NLP #DeepLearning #AttentionMechanism #AI