This is a report on the implementation of the paper Neural Turing Machines. The paper presents the idea of Neural Turing Machines (NTM) and the results of using NTM on a few tasks. However, it does not provide the reader with the necessary details to reproduce the results presented in the paper. In this report we tried to fill in those gaps and provide an analysis over the experiments we performed to implement NTM. Note that we chose to only implement the NTM on the copy task.
There are two files presented here that are titled as follows:
- Neural Turing Machines: Implementation
- Neural Turing Machines: Reports and Discussions
We highly suggest skipping the file Neural Turing Machines: Implementation on the first read of this report, since this section could be considered as the "behind the scene" section of our report and it is not really needed to understand the results, discussions and analysis presented in the other sections. However, it would be useful to take a look at this section in order to get a feeling about the codes or to be able to reproduce what is done in our report.