https://developer.apple.com/documentation/corenfc/adding_support_for_background_tag_reading

Packages/com.holoi.xr.holokit/Runtime/Assets/Scripts/MultipeerConnectivityTransport.cs(19,18): error CS0534: 'MultipeerConnectivityTransport' does not implement inherited abstract member 'NetworkTransport.Initialize(NetworkManager)'

• Make sure it is compatible with ARFoundation

https://github.com/YannisDC/Vision-Hand-Pose

• Understand how MRTK for Quest works https://github.com/provencher/MRTK-Quest
• Understand how Leap Motion on MRTK works.
  https://microsoft.github.io/MixedRealityToolkit-Unity/Documentation/CrossPlatform/LeapMotionMRTK.html
• Write our own MRTK adapter
  Similiar to https://github.com/provencher/MRTK-Quest/tree/master/Assets/MRTK.ThirdParty

Everything was perfect on mac but the subsystem was unable to load on iOS.

Bazel 4.0 will fail the compilation.
We need to downgrade it to 3.7.2 by

  brew unlink bazel
  wget https://raw.githubusercontent.com/Homebrew/homebrew-core/e30dc66cf73b120e72f337115ec9bb83cef0000a/Formula/bazel.rb
  brew install --formula bazel.rb

Go to
https://github.com/holoi/mediapipe

bazel build  --linkopt=""  -c opt --verbose_failures --objc_enable_binary_stripping=true --features=dead_strip --strip=always --config=ios_arm64 mediapipe/iosdc:HandTracker

unzip the framework to SDK folder.

unzip -o bazel-bin/mediapipe/iosdc/HandTracker.zip -d ../../../holokit/sdk/third_party/

• Build skeleton of Unity XR SDK and make sure it's compatible with ARFoundation and ARKit with XRManager
  https://github.com/holoi/HoloKitSDK/tree/master/xr-plugin/com.unity.xr.holokit
• Test it over TestUnityHoloKit
  https://github.com/holoi/HoloKitSDK/tree/master/test-projects/TestUnityHoloKit

• Understand https://docs.unity3d.com/ScriptReference/XR.Hand.html
• Write HandTracking on https://github.com/holoi/HoloKitSDK/blob/730caa22e1c5facd434eafe57f052b7c5e92b93b/sdk/unity/xr_dummy/input.cc#L114

• Understand single-pass rendering on Unity
  https://docs.unity3d.com/Manual/SinglePassStereoRendering.html

UnityStereoScreenSpaceUVAdjust(uv, sb) 
UnityStereoTransformScreenSpaceTex(uv)
UnityStereoClamp(uv, sb)

• Understand XR SDK API
  https://github.com/googlevr/cardboard/blob/4382d959a62196405ab75a237b5c39094a137c6e/third_party/unity_plugin_api/IUnityXRDisplay.h#L181

• Understand How Google Cardboard did XR SDK rendering
  https://github.com/googlevr/cardboard/blob/4382d959a62196405ab75a237b5c39094a137c6e/sdk/unity/xr_provider/display.cc#L127

• Write single-pass rendering in HoloKit XR SDK

https://developer.apple.com/app-clips/

https://github.com/holoi/HoloKitSDK/blob/master/test-headtracking2/Renderer.swift

We have bug on Depth-Z

Someone talked about it.
google-ai-edge/mediapipe#742
google-ai-edge/mediapipe#156

NearBy Interaction requires

permerssion:

NSNearbyInteractionAllowOnceUsageDescription
NSLocalNetworkUsageDescription
NSCameraUsageDescription
NSBonjourServices
_holokit._udp
_holokit._udp

where holokit = serviceType

Planning hand-tracking feature development.

Our goal is to have hand tracking SDK working with HoloKit and compatible with MRTK.

Roadmap:

• Use Mediapipe Handtracking as a library in your native DOE.
• Port Handtracking into Unity XR SDK.
• Write an adapter for MRTK.
  Similiar to https://github.com/provencher/MRTK-Quest/tree/master/Assets/MRTK.ThirdParty

• Reading Paper
  http://av.dfki.de/~pagani/papers/Rambach2017a_ISMAR.pdf
• Porting Ceres on Native DOE app
• Porting Low Latency tracking

• Understand the Unity version code of HoloKit SDK to see how to parameterize the rendering model (holokit model, and different iphone model)
  https://github.com/holoi/HoloKitSDK-Unity
• Understand how Google Cardboard did the rendering for stereoscopic rendering.
  https://github.com/googlevr/cardboard
• Understand our rendering swift code.
  https://github.com/holoi/HoloKitSDK/blob/master/test-headtracking2/Renderer.swift
• Understand how Metal to implement the single-pass rendering
  setVertexAmplificationCount(2, viewMappings: nil)
• Write a native DOE stereo rendering code for verify your research for future design purpose.

We will develop

1. the core SDK library
2. a series of testing native apps (DOE)
3. Unity XR SDK
   at the same time.

v0.1 features

• HoloKit XR SDK Skeleton
  • #16 Build the first runnable skeleton of Unity XR SDK and testing Unity project
    • Build the skeleton of xr-plugin com.unity.xr.holokit and make sure it's compatible with ARFoundation and ARKit with XRManager
    • Test it over TestUnityHoloKit test-projects/TestUnityHoloKit
    • #18 Write a copy script for holokit naive sdk to Unity Build folder to skip Unity compile process
    • Make the dummy display provider
    • Make the dummy input provider
• Display provider
  • #4 Single-pass Stereoscopic rendering on Native DOE
  • Multi-pass Stereoscopic rendering on XR SDK by Metal
  • Single-pass Stereoscopic rendering on XR SDK by Metal
  • Rendering Widget to switch between Monocular and Stereoscopic
• Input provider
  • Use camera's position as Center Position on XR SDK
• Hand tracking
  • #7 Mediapipe Hand tracking on Native DOE
  • #5 Link mediapipe library into XR SDK (disable bitcode and compile process)
  • #9 Porting Mediapipe hand tracking to XR SDK
  • #8 Mediapipe Hand Tracking Adapter on Unity InputSystem for MRTK
  • Solve hand tracking z-depth calculation problem

v0.2 features

• Low Latency Tracking

• #11
• #10

• ATW

• #14
• Study how to make Reprojection happens in Unity
• #15

• NFC authorization

• #13
• #2

v0.3 features

• App extension (NFC authorization, User information including IPD(interpupil distance))
  #12
• Multipeer Connectivity
• UWB
  https://developer.apple.com/documentation/nearbyinteraction