Hello everyone.

The Mixed Reality Forums here are no longer being used or maintained.

There are a few other places we would like to direct you to for support, both from Microsoft and from the community.

The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.

For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality.

If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers, or in our Microsoft Tech Communities forums at https://techcommunity.microsoft.com/t5/mixed-reality/ct-p/MicrosoftMixedReality.

And always feel free to hit us up on Twitter @MxdRealityDev.
Options

How would I change what the Hololens thinks is my hand?

PolyBionicsPolyBionics ✭
in Questions And Answers

Hi. I would like to change what the Hololens thinks is my hand and I would like to use a different object to be detected as a hand.

Thanks Nicholas @PolyBionics

Tagged:

Answers

  • Options
    mark_grossnicklemark_grossnickle ✭✭✭

    I don't believe this is possible natively. Perhaps you could use leap motion?

    Taqtile

  • Options
    stepan_stulovstepan_stulov ✭✭✭
    edited November 2017

    Hey, @PolyBionics

    I believe HoloLens is designed with a hand in mind. While you're free to choose which hand you use (and even your sneaky colleague can do a gesture from behind your back for you) and while HoloLens has a certain tolerance to how exactly you perform the gestures it's still just that - a limited set of gestures performed by hands.

    I believe what you want is these two functionalities.

    First. You want to detect a certain id of a tool you're wielding. HoloLens has nothing of that sort. Neither will it reliably continue to recognize your gestures with your hands occupied. Solutions that come to my mind are bluetooth beacons with unique IDs that you could let the HoloLens detect. Alternatively you could supplement your tool with a marker that Hololens could detect visually (Vuforia maybe?) and get the tool ID from the marker ID. You could also try to build a second mobile phone app where there is a tool selection menu and networking with the HoloLens app to report which tool is in use. Your phone can recognize spatial gestures from the gyroscope and accelerometer data by the way. That could be reported back to Hololens vie network as well. I think there has been some Harry Potter app with magic spell gestures. You could always slap a custom case in form of a sword onto your phone. Finally you could simply ask the user: what tool are you wielding?

    Second. You want to perform some gestures with the tool wielded. As already mentioned, HoloLens only does hands so you will have to utilise side technologies for that. One suggestion, like @mark_grossnickle kindly provided, is to use Leap Motion. I'm not informed enough about it especially in conjunction with HoloLens. Another alternative is to pair HoloLens with some VR rig, HTC Vive or Oculus Rift, that both have outstanding tracing of controllers and even standalone beacons to slap on weapons etc. This is of course not such a mobile installation as HoloLens alone anymore. I guess one could also look in the direction of Microsoft Kinnect, but I'm not informed about that topic as well. Finally, as I mentioned before, you could do the gesture learning and recognition on your mobile phone and simply send this info vie network. Why not! Your knight equipment: a helmet (HoloLens) and a weapon (iPhone).

    There have been discussions about opening up HoloLens's low-level internals for developing custom gestures but I believe they weren't met with enthusiasm on Microsoft team side just yet.

    Hope this helps.

    PS: Sorry, game developer background, might have drifted into fantasy a little bit.

    Building the future of holographic navigation. We're hiring.

Sign In or Register to comment.