lorenzo-rovigatti / bookshelf

@Zhengli

Zhengli---Catalogue and organize your book collection based off images shot from your camera. We are offering an API service that uses data science to automatically detect and recognize books that it finds in user submitted images of bookshelves.

Future Features: Organize books by genre and categories.

How to use Zhengli

git clone https://github.com/dingchaoz/bookshelf.git
docker build -t zhengli .
docker run --rm -p 5000:8080 zhengli 

then send a book shelf image to the service

curl -X POST -H 'content-type: application/json' --data '{"file":"IMG_20190904_155939359.jpg"}' http://127.0.0.1:5000/api

sample information returned about the books from the shelf image

ddc is 793.9 and best match book is {'title': 'Warcraft Ii: Beyond The Dark Portal: Official Secrets And Solutions (secrets Of The Games Series)', 'image': 'https://images.isbndb.com/covers/78/71/9780761507871.jpg', 'title_long': 'Warcraft Ii: Beyond The Dark Portal: Official Secrets And Solutions (secrets Of The Games Series)', 'date_published': '1996', 'publisher': 'Prima Games', 'synopsys': 'With This Expansion Disk To Warcraft Ii: Tides Of Darkness, Players Can Extend Their Warcraft Experience As They Delve Into The Orcs Homeland For The First Time To Experience An Entirely New Set Of Challenges. Players Can Compete In Head-to-head Battles Against As Many As Eight Players.', 'authors': ['Mark Walker'], 'isbn13': '9780761507871', 'msrp': '14.99', 'publish_date': '1996', 'binding': 'Paperback', 'isbn': '0761507876'}

How does Zhengli work?

At a high level, Zhengli uses a combination of computer vision, image processing, and natural language processing to detect books in images of bookshelves. Breaking it down a little further, these are the main steps involved. A more detailed description of each step in the algorithm is presented in the following sections.

Zhengli's algorithm:

• Detect all instances of book shapes in the image
• Split books into individual one by its spine
• Detect all instances of text in each book image
• Spell correct text detected
• Extract book title, publisher, author from detected text associated with a book
• Perform a search on the book, titile and publisher for a match on open library API
• Validate the book using its original camera image and its image on open library website
• Get the ISBN number from the book
• Get the Deway Decimal number and other
• Return the following information about the books: title, author, publisher, publishing date, ISBN, deway decimal number.

Authors

Sarah Hudspeth, Dingchao Zhang

Contributing

Contributions, issues and feature requests are welcome. Feel free to check issues page if you want to contribute. Check the contributing guide.