21 - Quiz¶

• Your name:

• Your VT email:

What is Automatic Differentiation (AD)?

• A. A numerical method using small step sizes
• B. A symbolic manipulation of expressions
• C. A method to approximate gradients using sampling
• D. A technique to compute derivatives exactly via the chain rule

What does the Jacobian represent?

• A. Second derivative
• B. A Vector product of function values
• C. A Matrix product of partial derivatives
• D. Gradient descent step

Forward mode computes:

• A. One row of the Jacobian per pass
• B. The full Jacobian in one pass
• C. One column of the Jacobian per pass
• D. Only scalar derivatives

When is reverse mode most efficient?

• A. When output dimension is large
• B. When input dimension is small
• C. When output dimension is small
• D. Never