Worked Solutions Index
This page points you to all places where worked solutions (step-by-step answers, derivations, and code) are available. Use it to check your work or to study from full solutions. Math for RL Each topic page has practice questions with full solutions in collapsible “Answer and explanation” sections: Probability & statistics — Sample mean, variance, expectation, law of large numbers, bandit-style problems. Linear algebra — Dot product, matrix-vector product, gradients, NumPy. Calculus — Derivatives, chain rule, partial derivatives, policy gradient. Every practice question includes a step-by-step derivation and a short “In RL” explanation. ...