Hello everyone.

We have decided to phase out the Mixed Reality Forums over the next few months in favor of other ways to connect with us.

The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.

The plan between now and the beginning of May is to clean up old, unanswered questions that are no longer relevant. The forums will remain open and usable.

On May 1st we will be locking the forums to new posts and replies. They will remain available for another three months for the purposes of searching them, and then they will be closed altogether on August 1st.

So, where does that leave our awesome community to ask questions? Well, there are a few places we want to engage with you. For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality. If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers. And always feel free to hit us up on Twitter @MxdRealityDev.

Post-process Hololens photo

Hi,
I am developing a Hololens app that have photo Capture & video recording functionality. I can acquire photo and video with holograms, I followed this link : https://developer.microsoft.com/en-us/windows/mixed-reality/locatable_camera_in_unity.

My question are:
Is it possible to remove the hologram from the photo after the picture is taken?
For example, is possible to save the realty (PV camera) and the Hologram in different 'layers'?

Thanks
Osvaldo

Answers

  • Hey, @Osvaldo.

    I believe with the PhotoCapture API you can either capture the reality, or the reality with the holograms superimposed. That means that only the reality part can be separated, not the holograms. You could of course take one with and one without and apply some kind of image extraction. But the result might be dirty. Also there will be a delay between taking the captures so you will end up with two slightly different pictures.

    What you could do is take a hologram-free capture and simultaneously render your Untiy camera into a PNG with transparent background. Then you still have to solve two problems: first is to make sure both really happen at the same time, and second is to transform camera render to match the photo capture since their view ports are different. There is a Locatable camera article that describes that transformation.

    Hope this helps.

    Building the future of holographic navigation. We're hiring.

  • When you create your PhotoCapture object using the CreateAsync method, there is a parameter called showHolograms. You feed it false if you don't want to show holograms or true if you want to show them.

    https://docs.unity3d.com/ScriptReference/XR.WSA.WebCam.PhotoCapture.CreateAsync.html

    As far as creating layers, you would need to dive deeper into the PhotoCapture class to double check, but I don't believe that would be possible. The way around it though might be to take two photos almost simultaneously, one with Holograms and the other without them.

    AR Developer

Sign In or Register to comment.