esp-cpp / camera-display Goto Github PK

Is your feature request related to a problem? Please describe.

Right now the TCP image stream works well once TCP adjusts to the existing WiFi network conditions, but it suffers any time the camera / display move relative to each other or when something else causes a chance to the network conditions. This shows up as a lag spike / stuttering.

This would also enable visualization solutions on computers / phones through the use of gstreamer, vlc, etc.

Describe the solution you'd like

Move to a real-time UDP based solution for streaming the data which prioritizes minimizing lag and maximizing quality of service.

This is the client side implementation for the media stream, the server side implementation is tracked in the camera-streamer app

Describe alternatives you've considered

Doing pure UDP (no additional control streams or QoS mechanisms) for data streaming.

Additional context

Some useful references:

• https://en.wikipedia.org/wiki/Real_Time_Streaming_Protocol
• https://en.wikipedia.org/wiki/Real-time_Transport_Protocol
• https://en.wikipedia.org/wiki/RTP_Control_Protocol
• https://en.wikipedia.org/wiki/Real-Time_Messaging_Protocol
• https://github.com/geeksville/Micro-RTSP
• https://github.com/rzeldent/esp32cam-rtsp
• https://github.com/arkhipenko/esp32-cam-mjpeg-multiclient
• https://github.com/enesbcs/ESP32_RTSP_Cam/tree/master/lib/Micro-RTSP-Multi