aoi-hosizora / ctpn-crnn-backend

Use Flask for CTPN & CRNN backend for Biji_Baibuti

CTPN_CRNN_BackEnd

• Use CTPN (tf) to detect text regions of image
• Use CRNN (torch) to recognize text
• Use Flask to make restful api response

Environment

• Colaboratory
• CTPN
  • tensorflow 1.14.0
  • cv2 3.4.3
  • others see requirements.txt
• CRNN
  • pytorch 1.1.0
  • lmdb 0.96
  • others see code
• Server
  • Flask 1.0.2
  • flask_cors 3.0.8
  • werkzeug 0.14.1

API

• Document see readme.md
• Front-End(Android) see OCRActivity.java

Build

• CTPN
  • Clone text-detection-ctpn repo into CTPN/ and rename it to ctpn_repo/
  • Download the ckpt file(from official repo[https://github.com/eragonruan/text-detection-ctpn] backup) from google drive or baidu yun, Unzip checkpoints_mlt.zip at ctpn_repo/
  • Build cython lib

cd CTPN/
git clone https://github.com/eragonruan/text-detection-ctpn.git
mv text-detection-ctpn/ ctpn_repo/

cd ctpn_repo/
# download checkpoints_mlt.zip
unzip checkpoints_mlt.zip

cd utils/bbox
chmod +x make.sh
./make.sh

• CRNN

  • Download pretrained model(from chineseocr repo) from google drive, move two pth files into CRNN/models/
• Structure

   .
   ├─assets/
   ├─CRNN/
   │  ├─data/
   │  └─models/
   ├─CTPN/
   │  └─ctpn_repo/
   │     ├─checkpoints_mlt/
   │     ├─data/
   │     │  ├─demo/
   │     │  ├─readme/
   │     │  ├─res/
   │     │  └─res_oriented/
   │     ├─main/
   │     ├─nets/
   │     └─utils/
   │         ├─bbox/
   │         ├─dataset/
   │         ├─prepare/
   │         ├─rpn_msr/
   │         └─text_connector/
   ├─Server/
   │  ├─Controllers/
   │  ├─Middleware/
   │  ├─Models/
   │  ├─Routes/
   │  └─Utils/
   │      └─Exception/
   └─tmp/
   

Run Server

# After build and get model data
cd CTPN_CRNN_BackEnd/
python3 listen.py # Listen 0.0.0.0:1627

Screenshot

References

• chineseocr
• text-detection-ctpn
• crnn.pytorch

ctpn-crnn-backend's Issues

"message": "Not Found", "detail": "404 Not Found: The requested URL was not found on the server. If you entered the URL manually please check your spelling and try again." }

{ "message": "Internal Server Error", "detail": "500 Internal Server Error: The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application." }