Hello everyone.

The Mixed Reality Forums here are no longer being used or maintained.

There are a few other places we would like to direct you to for support, both from Microsoft and from the community.

The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.

For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality.

If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers, or in our Microsoft Tech Communities forums at https://techcommunity.microsoft.com/t5/mixed-reality/ct-p/MicrosoftMixedReality.

And always feel free to hit us up on Twitter @MxdRealityDev.
Options

Suggestion. Improve WMR controllers tracking using webcam

When controllers are out of sight of headset cameras, they loose position tracking.
But hey! A lot of people have web-cams on there computers. Why don’t use this cameras to help system to track WMR controllers when they out of headset sight? Is there any fundamental obstacle to use user web-cams for this? We don’t need 100% accuracy, because any accuracy is better than nothing. And I’m pretty sure, system can calibrate itself just looking on user using controllers for several minutes. And if use two cameras, tracking can be as precise as HTC Vive’s!
Of course, user needs additional setup for this. That contradicts with the “inside-out, no additional setups" ideology, but this feature absolutely optional, just to make experience smoother and better.
(Let me be honest: tracking issues is the only thing I don’t like about my WMR headset)

Comments

  • Options

    Webcam on laptop/PC are varied in quality and it will consume a part of CPU power for images processing, not to mention the latency and depth recognition issues too.

    I think of the use Kinect as an additional sensor for the WMR. Kinect has precision issue in the past, but WMR can handle all the precision issue and Kinect can provide addition data when the controller is out of range.

    Moreover, these 2 seem to have similar technologies. It should be easier to combine their data together.

Sign In or Register to comment.