jeguzzi / ai_sail

Image streamer for AI-Deck and some more.

AI-SAIL

This repository contains code that extends the streaming example provided by Bitcraze with

• an application-level UART protocol to exchange structured messages (and logging) between Crazyflie and GAP. GAP can also log to UART and Crazyflie can pass dynamic parameters to GAP;
• dynamic configurations for the most important camera parameters, like format, fps, exposure and cropping;
• streaming RAW images too, which works generally better than the default JPEG encoder, despite the higher bandwidth (> x15). For instance, it allows you to capture and stream 160 x 90 at about 60 fps;
• streaming over JTAG and named pipes, which is much slower (1/6) than WiFi but convenient for debugging and in case you don't have NINA packaged with a GAP.
• a client that accepts RAW images too and another that republishes the stream to ROS.

The repository is divided into 5 parts:

• [Video-stream] client (Python3),
• crazyflie: just the aideck.c driver and the autogenerated protocol to include in the firmware tree,
• gap: the complete firmware for GAP8,
• nina: the complete firmware for NINA,
• protocol: a Python3 script to generate C-code using Jinjia templates.

Please refer to the related READMEs for documentation and follow the instruction to install the different toolchains, to build, and to run the software.

The Crazyflie code works the latest firmware, the GAP code with the latest GAP SDK (3.6), and the NINA code with ESP_IDF 3.3.1.

The name is an homage to the fantastic AI-DECK, to which we just add a sail to navigate better and faster to perilous sees of robotics and machine learning research.

ai_sail's Issues

Is `pi_camera_reg_set16` correctly implemented?

Hey!

I was browsing through this project (btw., really cool stuff!) hoping it'll help me figure out how to force a specific exposure setting on himax in my code. While doing that, I've seen that in pi_camera_reg_set16 function (which, as I understand, should be setting a parameter):

ai_sail/gap/streamer/himax_utils.c

Line 146 in 0c6894f

return pi_camera_reg_get(camera, reg_addr_h, v+1);

the low byte is being set, but for the high one, the get function is being used. Am I missing something or it's a mistake?