Variance

Overall Progress 0%

Expectations, variance, sample mean, distributions, and law of large numbers — with RL motivation and practice.

Mean, variance, standard deviation, standard error, histograms, and correlation — with RL motivation and practice.

Sample mean, variance, expectation, and law of large numbers — with bandit-style problems and explained solutions.

Expected SARSA vs Q-learning; variance and learning curves.

REINFORCE for CartPole with softmax policy; note variance.