Curve-Text-Detector

Released on December 06, 2017

Description

Curve text are very common in our real-world. For examples, text in most kinds of columnar objects (bottles, stone piles, etc.), spherical objects, plicated plane (clothes, streamer, etc.), coins, logos, signboard and so on. Current datasets have very little curve text, and it is defective to label such text with quadrangle let alone rectangle. Curve bounding box has three remarkable advantages:

Avoid needless overlap
Less background noise
Avoid multiple text lines

We introduce our dataset and our CTD method at our paper (https://arxiv.org/abs/1712.02170).

Clone the Curve-Text-Detector repository

git clone https://github.com/Yuliang-Liu/Curve-Text-Detector.git --recursive

Getting Started

Dataset

The SCUT-CTW1500 dataset can be downloaded through the following link:

(https://pan.baidu.com/s/1eSvpq7o PASSWORD: fatf) (Size = 842Mb).

unzip the file in ROOT/data/

Dataset Information

a) Train - It contains 1000 images.

b) Test - It contains 500 images.

c) Each image contains at least 1 curve text.

The visualization of the annotated images can be downloaded through the following link:

(https://pan.baidu.com/s/1eR641zG PASSWORD: 5xei) (Size = 696 Mb).

Pre-trained model and our trained model

We use resnet-50 model as our pre-trained model, which can be download through the following link:

(https://pan.baidu.com/s/1eSJBL5K PASSWORD: mcic) (Size = 102Mb).

put model in ROOT/data/imagenet_models/

Our model trained with SCUT-CTW1500 training set can be download through the following link:

(https://pan.baidu.com/s/1gfs5vH5 PASSWORD: 1700) (Size = 114Mb).

put model in ROOT/output/

test.sh After downloading the dataset and our ctd_tloc.caffemodel, simply run the this file can evaluate our method on the SCUT-CTW1500 test set. Uncommend --vis to visualize the detecting results.
my_train.sh This file shows how to train on the SCUT-CTW1500 dataset. After downloading the dataset and resnet-50 pre-trained model, simply running my_train.sh to start.

Both train and test require less than 4GB video memory.

demo.py (cd tools/) then (python demo.py). This file easily shows how to test other images. With provided model, it can produce like

Comparing smooth effect by TLOC

Train and test files are put under (model/ctd/smooth_effect/), and both the training and testing procedures are the same as above.

To visulize the ctd+tloc, simply uncomment ctd in the last of the test.prototxt, vice versa. Below are the first three images in our test set:

If you are insterested in it, you can train your own model to test. Because training doesn't require so much time, we don't upload our own model (Of course, you can email me for it).

Long side interpolation (LSI)

Visualization of LSI. By LSI, our CTD can be easily trained with rectangular or quadrilater bounding boxes without extra manual efforts. Based on our recent research, the stronger supervision can also effectively improve the performance.

Detecting Results

More details can be found on our paper (https://arxiv.org/abs/1712.02170).

Citation

If you find our method or the dataset useful for your research, please cite

@article{yuliang2017detecting,
  title     = {Detecting Curve Text in the Wild: New Dataset and New Solution},
  author    = {Yuliang, Liu and Lianwen, Jin and Shuaitao Zhang and Sheng, Zhang},
  jurnal    = {arXiv preprint arXiv:1712.02170},
  year      = {2017}
}

Requirement

Clone this repository. ROOT is the directory where you clone.
cd ROOT/caffe/ and use your own Makefile.config to compile (make all && make pycaffe). If you are using ubuntu 14.04, you may need to modify Makefile line 181 (hdf5_serial_hl hdf5_serial) to (hdf5 hdf5_hl).
cd ROOT/lib make (based on python2)
pip install shapely. (Enable computing polygon intersection.)

Feedback

Suggestions and opinions of this dataset (both positive and negative) are greatly welcome. Please contact the authors by sending email to [email protected].

Copyright

The SCUT-CTW1500 database is free to the academic community for research purpose usage only.

For commercial purpose usage, please contact Dr. Lianwen Jin: [email protected]

twinsyssy1018 / curve-text-detector Goto Github PK