This repository contains an implementation of exemplar models for the purpose of approximate density estimation.
The model is detailed in the following paper:
EX2: Exploration with Exemplar Models for Deep Reinforcement Learning
Justin Fu*, John D. Co-Reyes*, Sergey Levine. NIPS 2017
This library requires Numpy, Scipy, Tensorflow, and Matplotlib.
To run the demo code, simply run the following script:
python scripts/twod_example.py
This will save a series of images taken over the course of training into the data folder. The model's estimates are shown in the left panel, and the ground truth data is shown on the right.
Iteration 1000:
Iteration 10000:
Iteration 20000:
Iteration 30000:
