Hello everyone.

The Mixed Reality Forums here are no longer being used or maintained.

There are a few other places we would like to direct you to for support, both from Microsoft and from the community.

The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.

For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality.

If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers, or in our Microsoft Tech Communities forums at https://techcommunity.microsoft.com/t5/mixed-reality/ct-p/MicrosoftMixedReality.

And always feel free to hit us up on Twitter @MxdRealityDev.

Post-process Hololens photo

Hi,
I am developing a Hololens app that have photo Capture & video recording functionality. I can acquire photo and video with holograms, I followed this link : https://developer.microsoft.com/en-us/windows/mixed-reality/locatable_camera_in_unity.

My question are:
Is it possible to remove the hologram from the photo after the picture is taken?
For example, is possible to save the realty (PV camera) and the Hologram in different 'layers'?

Thanks
Osvaldo

Answers

  • Hey, @Osvaldo.

    I believe with the PhotoCapture API you can either capture the reality, or the reality with the holograms superimposed. That means that only the reality part can be separated, not the holograms. You could of course take one with and one without and apply some kind of image extraction. But the result might be dirty. Also there will be a delay between taking the captures so you will end up with two slightly different pictures.

    What you could do is take a hologram-free capture and simultaneously render your Untiy camera into a PNG with transparent background. Then you still have to solve two problems: first is to make sure both really happen at the same time, and second is to transform camera render to match the photo capture since their view ports are different. There is a Locatable camera article that describes that transformation.

    Hope this helps.

    Building the future of holographic navigation. We're hiring.

  • When you create your PhotoCapture object using the CreateAsync method, there is a parameter called showHolograms. You feed it false if you don't want to show holograms or true if you want to show them.

    https://docs.unity3d.com/ScriptReference/XR.WSA.WebCam.PhotoCapture.CreateAsync.html

    As far as creating layers, you would need to dive deeper into the PhotoCapture class to double check, but I don't believe that would be possible. The way around it though might be to take two photos almost simultaneously, one with Holograms and the other without them.

    AR Developer

Sign In or Register to comment.