A C++ implementation of the Value Iteration algorithm for Markov Decision Process. It is tuned to handle a special class of MDPs. This class of problems is described in the report.
- Recent compiler. For mac, this can be installed by
brew install gcc
. - Boost library. For mac, this can be installed by
brew install boost
.
- Clone repository, i.e., go to folder location and type
git clone https://github.com/markkvdb/mdpsolver
in terminal. - Go to this new folder and run makefile, that is,
cd mdpsolver
andmake
.
Following the instructions above will create an executable mdpsolver
. Run this executable by the command ./mdpsolver
.
- Design interface to set parameters of the system.
- Automatic graphical output.