OCR Engine for mathematical expression to latex translation using CNN with AI approach
In this project, includes source code of a neural network for single character recognition and code for train network using keras api. For translation of image to latex form, few steps are required
- Preprocess of whole image
- Seperate single character using contour
- Recognize characters using CNN model
- Translate to Latex with information of their position
Additionally, for application using this engine, we made "Calcuator for Comfort".
Here is demo link: https://www.youtube.com/watch?v=vi6pRBC3YW8
- Python: 3.7.7
- Keras: 2.3.1
- Tensorflow: 2.1.0
CNN model for single character classification. Modified from vgg16.
Used handwritting mathematic symbol data for train this model.
Pretrained-model: https://drive.google.com/file/d/1476mU1ycv5WUfJBnjWzImeOrfqoiHOUF/view?usp=sharing
Data link: https://www.kaggle.com/xainano/handwrittenmathsymbols