keijiro / akvj

Demo project for Akvfx (Azure Kinect plugin for Unity)

Akvj

Akvj is a demo project for the Akvfx plugin (Azure Kinect integration for Unity VFX Graph).

System requirements

• DirectX 11 compatible Windows System
• Azure Kinect DK device

How to run the demo

Akvj runs in a "fire-and-forget" fashion. Once you start it, it runs automatically without any user interaction (excepting the camera input).

At first, Akvj shows the adjustment screen.

The Depth Threshold slider changes the maximum distance of the points. You can remove the background by tweaking it to make the background points excluded.

The red rectangle indicates the sweet spot of the depth camera. Adjust the device position and angle to place the main object (your upper body and face) inside the rectangle.

The Camera Offset slider changes the distance between the camera and the object. Adjust it to make the object penetrating the rectangle (see the screenshot above).

Press the space key to close the adjustment screen and start the performance mode. You can reopen the adjustment screen by pressing the space key again.

akvj's Issues

Changing camera mode / field of view

Looking for a way to set the Azure Kinect to 120 degree FOV, found this bit here:

new DeviceConfiguration
{ ColorFormat = ImageFormat.ColorBGRA32,
ColorResolution = ColorResolution.R1536p, // 2048 x 1536 (4:3)
DepthMode = DepthMode.NFOV_Unbinned, // 640x576
SynchronizedImagesOnly = true });

Along with these settings here:

public static int ImageWidth => 640;
public static int ImageHeight => 576;

When I try to match what should be the WFOV_2x2Binned or WFOV_Unbinned settings with the ImageWidth and ImageHeight I either get a device error or it will start up but I get some pretty bad lines across the VFX graph effects.

I guess my question is are there more settings that I haven't found yet, or is there another way to set this?

Mesh from point cloud

Hi @keijiro

Thank you for sharing the project.

I wonder if you could suggest ways to generate mesh from the point cloud based on this project?

Best Regards,
Chang