Hello everyone.

The Mixed Reality Forums here are no longer being used or maintained.

There are a few other places we would like to direct you to for support, both from Microsoft and from the community.

The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.

For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality.

If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers, or in our Microsoft Tech Communities forums at https://techcommunity.microsoft.com/t5/mixed-reality/ct-p/MicrosoftMixedReality.

And always feel free to hit us up on Twitter @MxdRealityDev.

Image processing in placement algorithm

Hi!
I'm currently doing my degree project to get my masters degree:)

My project is about how placement of virtual objects can be done in relation to both the volumetric data and a photometric representation. I picture myself a future where we have a shared focus between virtual and real content and thus we need a way to identify where we can place virtual objects. Image analysis is done with OpenCV and development in Unity.

However I'm open for all suggestions on how to accomplish this. I have been digging a lot into the HoloToolkit for unity and also the HoloToolKit. At the moment I have a scanning scene that works with the spatialMapping components and Computer vision parts that take in a texture2D. However How to get these textures from the Voxels is a problem I'm been struggling with for weeks and thus I would like to get some advice.

Here you can see a screenshot of a scanned wall. reconstructed in unity.

I had an idea to move into the SpatialUnderstandingMesh but due to the issue#520 in HolotoolkitUnity and issue#73 I found out that to be problematic.

Any ideas how to get each triangles texture?
Good to know is that no time costraints applies but would be nice with a somewhat efficent solution, however I believe that it would take a some time:p

/Calle
If you have any questions about my project I'm glad to answer them.

Answers

  • Hi Calle, unfortunately I don't really know how to solve your problem, but I've one question: do your process live images from the main camera? I'm trying to some tracking application (typically a red laser on a white screen) but when I access the WebCamTexture in unity, the framerate drops to 6 fps, which makes the hololens impossible to use..
    Thanks in advance!

Sign In or Register to comment.