allenai / figureseer

FigureSeer: Parsing Result-Figures in Research Papers

NB: FigureSeer is no longer being actively maintained. Code is provided for informational purposes only. If you're interested in taking over maintenance, please contact [email protected].

Introduction

FigureSeer is a system for parsing result-figures in research papers. It automatically localizes figures, classifies them, and analyses their content.

Citing FigureSeer

If you find FigureSeer useful in your research, please consider citing:

@inproceedings{siegelnECCV16figureseer,
    Author = {Noah Siegel and Zachary Horvitz and Roie Levin and Santosh Divvala and Ali Farhadi},
    Title = {FigureSeer: Parsing Result-Figures in Research Papers},
    Booktitle = {European Conference on Computer Vision ({ECCV})},
    Year = {2016}
}

Requirements: Software

1. Caffe and its Matlab interface (http://caffe.berkeleyvision.org/installation.html)
2. JSONlab (https://www.mathworks.com/matlabcentral/fileexchange/33381-jsonlab--a-toolbox-to-encode-decode-json-files)

Installation

1. Clone the repo with git clone --recursive https://github.com/allenai/figureseer
2. Download model weights from https://drive.google.com/corp/drive/folders/18oQ6LZbxVTH7qgEY9tj7YdstdRpr0HV_ and save them to data/models/neural-networks/.
3. Compile pdffigures (included in the dependencies directory)
4. In setConf.m, edit 'conf.caffeRoot' to point to your Caffe installation.
5. Run 'main.m'

To run on your own PDFs, simply add them to figureseer/data/pdfs and run main.

Data

Data used for training models is available at the project webpage: http://allenai.org/plato/figureseer/.

License

FigureSeer is released under the GPLv2 License.

figureseer's Issues

Installation problems - best configuration

During installation, I've faced many problems, and one is that I can't collect Caffee's Matlab interface. Seems like it's Matlab bug and MacOS problems. Could you please as the developer recommend me the configuration which
you know for sure should work? I have MacOS 10.15 Catalina, Windows 7,
Linux Gentoo kernel version 4.19. I'd really appreciate it if you can
give me advice on the best combination of the platform, Matlab
version, and compiler, also as specify valid versions of packages so
that Figureseer can be collected and run properly?

Model weights cannot be downloaded

Hello,
I have been trying to run aws s3 cp --recursive s3://ai2-website/data/figureseer/neural-networks/ data/models/neural-networks/. However, I keep getting this error.

fatal error: An error occurred (AccessDenied) when calling the ListObjects operation: Access Denied

Although aws configure was set as below, this error does not solve.

• AWS AccessKey ID [None]: which was created when IAM user generating.
• AWS Secret Access Key [None]: which was created when IAM user generating.
• Default region name [None]: us-east-1
• Default output format [None]: json

Can I tell me how to go around this issue?

Figureseer installation problems - compilation of pdffigures

I failed here as pdffigures requires poppler, and poppler was recently updated so that
the code in pdffigures is no longer valid. I fixed "PDFUtils.cpp" and
"TextUtils.cpp", but there were still new errors. Are you going to
update the code? Is better solution to install old version of poppler?
Which should work then and what versions of other libraries are
appropriate for Figureseer?