Hands tracking in 2D context


I try to use the hands tracking to interact with a 2D app (like Edge) on HoloLens.

I would like to know if it's possible to get the hands position programmatically just with a 2D XAML app ?

Thanks in advance


  • dbarrettdbarrett ✭✭✭

    Honestly, I've haven't really tried doing anything like this. Have you tried implementing the ISourceStateHandler?

    You can get position inside of there by doing something like this in the OnSourceDetected method:

    Vector3 position; eventData.InputSource.TryGetPointerPosition(eventData.SourceId, out position);

    AR Developer

  • @dbarrett,
    Thanks for your quick answer.
    I tried your suggestion, but to use those functions I need the MixedRealityToolkit and it seems not to work with a windowed app ?
    Sorry, i'm fairly new to HoloLens development.

  • dbarrettdbarrett ✭✭✭

    I've never made a XAML app so I had no idea whether or not it would work. Sorry, if you can't use the MRTK then I don't think it is possible. However, there is a prefab in the MRTK to make an occluded window sort of similar to the view you would get with an XAML app except you wouldn't be on the HoloShell and instead just be inside a D3D app. You may try looking into that?

    AR Developer

Sign In or Register to comment.