Hello everyone.

We have decided to phase out the Mixed Reality Forums over the next few months in favor of other ways to connect with us.

The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.

The plan between now and the beginning of May is to clean up old, unanswered questions that are no longer relevant. The forums will remain open and usable.

On May 1st we will be locking the forums to new posts and replies. They will remain available for another three months for the purposes of searching them, and then they will be closed altogether on August 1st.

So, where does that leave our awesome community to ask questions? Well, there are a few places we want to engage with you. For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality. If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers. And always feel free to hit us up on Twitter @MxdRealityDev.

HoloLens Hand Tracking

edited September 2016 in Discussion

Hello,
We are developing a HoloLens App to Try-On Jewelry and Rings. We need to track the hand, like Kinect does. I understand the HoloLens tracks the environment spatially, and looks for gesture input. Is there a way to switch the Spatial/Gesture Tracking to Hand Tracking?

Answers

  • @spinteractive the topic of Hand Tracking has been covered a fair bit in a number of threads. Here are a few examples that might interest you:

    To answer your specific question about switch from spatial/gesture tracking to hand tracking, the answer would be no. See the section on Hand Recognition from the docs where it explains the concept of "Gesture Frame".

    Windows Holographic User Group Redmond

    WinHUGR.org - - - - - - - - - - - - - - - - - - @WinHUGR
    WinHUGR YouTube Channel -- live streamed meetings

  • @HoloSheep I found the info below... so we are going to have to get creative. Any plans to support the type of functionality I need in future release of HoloLens?


    With the current version of the HoloLens the optimal user experience is achieved with holograms being about 2 meters from the user. Placing holograms less than 1.25 meters is possible but not recommended. So unless your users have unusually long arms :smiley:

    You may find this thread of interest where the topic is similar.

    Currently there is no support for specifically tracking the hand location that would lend itself directly to placing holograms in the user's hands. You would probably need to employ some computer vision logic on the Locatable Camera output or some other creative approach to achieve that goal.

    Keep in mind that the gesture frame and the display frame are somewhat different and that the hand detection is based on movement deltas from previously detected positions in the gesture frame (aka relative position) and not a specified position in view frame tracking.

  • @spinteractive they (as in Microsoft or the HoloLens team) do not tend to discuss or share future technology decisions as they often say.

    So for now we have to make the best of what is available.
    So yes, getting creative is a good idea.

    Did you see the threads that discussed the idea of working with a Kinect (or Leap Motion) connected to a PC?

    Also just for reference Microsoft Research continues to publish research on topics like Precise Interactive Hand Tracking so it is reasonable to think that we will see such things make their way into product in the future.

    Windows Holographic User Group Redmond

    WinHUGR.org - - - - - - - - - - - - - - - - - - @WinHUGR
    WinHUGR YouTube Channel -- live streamed meetings

  • @HoloSheep Yes we know we can use a Realsense or Kinect to track hands but the client does not want to do that. Thanks for the tip though :)

  • @spinteractive unfortunately if your client wants that kind of hand tracking from the HoloLens alone they are out of luck because it is not available from the current version of the HoloLens device. So as mentioned above the answer to you original question

    Is there a way to switch the Spatial/Gesture Tracking to Hand Tracking?

    would be "no".

    Windows Holographic User Group Redmond

    WinHUGR.org - - - - - - - - - - - - - - - - - - @WinHUGR
    WinHUGR YouTube Channel -- live streamed meetings

Sign In or Register to comment.