The Mixed Reality Forums here are no longer being used or maintained.
There are a few other places we would like to direct you to for support, both from Microsoft and from the community.
The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.
For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality.
If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers, or in our Microsoft Tech Communities forums at https://techcommunity.microsoft.com/t5/mixed-reality/ct-p/MicrosoftMixedReality.
And always feel free to hit us up on Twitter @MxdRealityDev.
Tracking Keyboard Buttons with Windows MR Headset on
Hello! I would like to know if there are any applications created utilizing the infra red sensors of the Windows MR headsets to track your keyboard/mouse location and buttons on it without removing the headset? I'm currently not looking for further visualization of surroundings, but solving this issue would be a great enabler to enable efficient working with headsets on.
Br,
Joonas
Best Answer
-
Akira_Chen mod
Hi Joonas
In order to be tracked by the infrared sensors, your devices have to emit signals through infrared LEDs like the motion controllers do.
Currently, the infrared sensors on the Windows MR headset is used for motion controller tracking only, and they cannot track your keyboard and mouse.
However, Unity offers APIs to track mouse position and keyboard buttons. Please refer to the page here.
Also if you want to present the users with a virtual scenario of them typing and using a mouse, you may be interested in the following article: Logitech is experimenting with a keyboard built for virtual reality.Hope my answer helps.
Best regards,
Akira Chen5
Answers
Hi Joonas
In order to be tracked by the infrared sensors, your devices have to emit signals through infrared LEDs like the motion controllers do.
Currently, the infrared sensors on the Windows MR headset is used for motion controller tracking only, and they cannot track your keyboard and mouse.
However, Unity offers APIs to track mouse position and keyboard buttons. Please refer to the page here.
Also if you want to present the users with a virtual scenario of them typing and using a mouse, you may be interested in the following article: Logitech is experimenting with a keyboard built for virtual reality.
Hope my answer helps.
Best regards,
Akira Chen
Hello again
Is there a way to visualize what button is being pressed i.e. highlighting the button pressed on physical keyboard on the virtual keyboard in MR Home? This could be a first easy step to manage without pass-through video or Unity.
Br,
Joonas
Hello,
Anyone has experience about how to visualize physical buttons pressed on the virtual keyboard in MR Home? And if you can pin the virtual keyboard even if you are typing with physical keyboard?