templeblock / ios_camera_object_detection

Realtime mobile visualize based Object Detection based on TensorFlow and YOLO model

Realtime iOS Object Detection with TensorFlow

This Repository contains all the file to build a YOLO based object detection app except the tensorflow frozon model file, you can download the model file here.

This app is derived from Google's TensorFlow iOS Camera Example. Thanks to the YOLO_tensorflow project by gliese581gg, I took the tiny model implementation and do some like modification, mainly about merge as much as possible operation to the graph of tensorflow, include the proprocessing (resize the image and normalize each pixel) and result interpreting. Then froze the checkpoint data from glese581gg with the GraphDef to the pb file, and use it in the app.

Build

• follow the instruction of the tensorflow buildin ios_example, to comile the protobuf and tensorflow core static library

• Clone this repository under the tensorflow/contrib/ios_example at same level of the offical camera project

• download the graph file and decompress it to data folder

• now you can open the Xcode project file and compile, run it on your real device.

##Disclame

Despite I have already use YOLO tiny model, at runtime it still require around 850M memory, so only iPhone 6s or later which get no smaller than 2GB of memory can make it running, otherwise it will be killed immediately when loading the model.

##Froze the model by yourself

• clone my fork of YOLO_tensorflow, download the weights checkpoint file provide by gliese581gg and put it into the weights folder

• in ipython

from YOLO_tiny_tf import YOLO_TF

yolo=YOLO_TF()
with open("weights/tiny_model.pb","wb") as f:
    f.write(yolo.sess.graph_def.SerializeToString())

• follow this tutoral to build the tensorflow frozen tools

python -m tensorflow.python.tools.freeze_graph \
--input_graph=tiny_model.pb\ 
--input_checkpoint=YOLO_tiny.ckpt\
--output_graph=frozen_tiny.pb\
--output_node_names=classes_prob,classes_arg,boxes\ --input_binary=1

the output of frozen_tiny.pb then you can use it in the app.