Relevant Notes

The following links are optional reading for the highly curious; provided in addition to the readings assigned on the official course web page and slide page.

Week 0:

Week 1:

• Jan 23:
  • PID Control (relevant sections: 6.1, 6.2, 6.6)
  • The Simple Pendulum
  • How to numerically solve an ODE?
    • Python - apmoniter, blog post
    • Matlab - mathworks
• Jan 26: Dynamic Programming:
  • The Stage Coach Problem
  • Utility and MDPs (Video) (Lecture 7-10)
  • Markov Rewards and Dynamic Programming (Video)
  • Mean First Passage and Recurrence Times (Video)
  • Dynamic Programming in Robotics
• Feb 2: Utility and Decision Theory:
• Feb 6: Stochastic system models:
  • Reinforcement Learning, R. Sutton and A. Barto Chapter 1-4
  • The multi-armed bandit problem (Video)
  • Algorithms for Reinforcement Learning Chapter 2, 4.2
• Mar 16: Bounded rationality and behavioural issues:
  • The Conjunction Fallacy (Blog)
  • Base rate Neglect (Blog)
  • Prospect Theory
    • Prospect Theory (Chapter)
    • Prospect Theory (Blog)
  • Level K
    • The 11–20 Money Request Game
    • Unraveling in Guessing Games
    • A Cognitive Hierarchy Model of Games