rvente / texnet

im2latex solution: Transcribe mathematical expressions from screenshots using machine learning.

The prospect of accurately transcribing mathematical expression into a markup representation is enticing because it opens the doors for bringing new life to old mathematical texts or those for which the source code is unavailable.

We make that dream a reality with this project, where we build on Sumeet Singh's work porting the model to Python3 and bringing our own dataset of 170,000 examples.

Dynamic Content

Sumeet S. Singh's Project Site

Static Content

Complete Dataset

Research Paper

Team

Directory Structure

TEXNET
│   
│      
│
└───data -> has to be made by the user (extract data folder in there)
│   │   
│   │   
│   │
│   └───formula_images
│       │   *.png    
│   
└───src -> main directory of where model will be ran
│   │   
│   │   
│   │
│   └───tools
│   │   │   prepareData.py -> run first when images are placed in inference folder
│   │   │   predict.py -> run this script after running the model based on the script outputted from prepareData.py
│   │   │   predictions.csv -> outputted csv with filenames and LaTeX predictions
│   │   
│   │   
│   │
│   └───tb_metrics -> main logging directory where logs from model training will be stored
│   │
│   │
│   │  run.py -> main file that runs the model, has settable hyperparameters and variables that need to be specified based on the training machine
|
└───predictions
│   │   
│   │   
│   │
│   └───formula_images -> paste images to perform inference on here before running inference scripts

texnet's Issues

Need of model parameters!

Hey, @rvente I've been working on this project referenced to Im2latex for 4 months but because of lack of computational power I'm unable to train it properly, so this is my humble request can you provide me the data reflecting your model, a naive one will also work. I just need to show it to my professors and classmates.