M

markovianbandit

This repository contains a python library to compute whittle or indices for finite-state Markovian bandit problems.