Below, you can find links to software produced as part of my research.

Please make any comments, questions, or suggestions on the appropriate GitHub repository.


A simple Python framework for working with options in HRL projects, built with discrete environments and graph-based methods in mind.

GitHub Repository


My implementations of various discrete RL environments, built upon my SimpleOptions package.
The API used in this package is similar to that used by OpenAI gym, although Gym's Env class is not implemented directly.

GitHub Repository


A highly-customisable, procedurally generated "office building" gridworld environment for reinforcement learning agents. Built upon my SimpleOptions package.

GitHub Repository