unreviewed draftNo one has checked this end to end. Treat the math, code, and citations as unverified. Source on GitHub.
Topic: Policy gradients and REINFORCE. Goes with: lecture L02. Status: planned. To be built next.
The plan: derive the policy gradient theorem; show baseline subtraction is unbiased; implement REINFORCE on CartPole (links to exercises/02-policy-gradients/).