michalharakal / flagsam

Flag Sam is fun game for children based on flag semaphore signals

Flag Sam

Flag Sam is a fun game for children based on flag semaphore signals

Let us introduce Sam first. Sam is the main character of the game. He or she is helping kids (or adults) to learn the flag alphabet first. Then they can use it in the game to get points or compete with one another.

The app will recognize the position of the person from a live camera picture and detect the signal. Ideally it should work without flags too. Recognition is done with a help of a pose estimation vision model.

The app will use simple cartoon drawings and animations to show detected movement of the person (instead of showing the real camera preview picture). Player can choose from various personas.

Img1	Img2	Img3

Development

[

flagsam's Issues

App landing page

Something like https://blackrockdigital.github.io/startbootstrap-new-age/

MVP First running prototype

1. one scren with live image from a camera
2. pose recognised
3. stickman painted according pose
4. chanracter recognition should work for "clear" poses

Implement pipeline pattern for processing chain

Add support for GPU

See original posenet for setup Tensorflow posenet sample

Rework initial camera code to Camera X

https://developer.android.com/training/camerax

Select game rendering engine

Current candidates

1. libGDX https://github.com/libktx/ktx
   1. https://www.youtube.com/watch?v=kDxerDYelLs
   2. https://stackoverflow.com/questions/10894601/how-to-add-libgdx-as-a-sub-view-in-android
2. cocos-x https://github.com/cocos2d/cocos2d-x
   1. https://github.com/intmainreturn00/CocoSlice
   2. https://medium.com/@intmainreturn00/cocos2dx-sliced-3f2434226b87
3. box2d https://box2d.org/