lixiangwuxian / maidxmr

MaiDXMR

Work in progress.

Aim to support hand tracking as input in quest.

Since this project uses OpenXR, it should be easy to port to other headset with hand tracking.

Currently not very playable due to high latency in encoding.

With lantecy adjustment it's able to achieve 80% acc on a lv9 map.

After import alvr server code as encoder the latency goes to about 0.7s. I may have to read poph264 code later to understand why.

Use assets from MaiDXR.

This front-end part just does receive h264 stream and send input back to the computer.

Uses PopH264 to decode h264 stream.

Build

1. Install Unity Editor 2022.3.16 LTS
2. Import PopH264 Package
3. Modify IP addr in Assets/Scripts/io/UDPClient.cs to your computer
4. Build & Run

Require MaiDXMR_backend runs in computer after sinmai.exe started

TODO:

• find the pc IP address automatically
• sync to pc on frame send