The Mixed Reality Forums here are no longer being used or maintained.
There are a few other places we would like to direct you to for support, both from Microsoft and from the community.
The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.
For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality.
If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers, or in our Microsoft Tech Communities forums at https://techcommunity.microsoft.com/t5/mixed-reality/ct-p/MicrosoftMixedReality.
And always feel free to hit us up on Twitter @MxdRealityDev.
Is it possible to "see" other apps and use their information for my own?
Hey guys,
I've a question concerning some kind of inter-application communication. Is it possible, that I write an app that analyses the current content of my view and shows additional information next to it?
Simple example: Imagine there is an app showing a QR code (e.g: Edge, Foto app). Could I kind of "see" the QR-Code in my app as i would see it with the camera if it would be real? And then perform some action based on the code (e.g: Overlap it with an image)?
Hope you can answer my question!
Cheers,
Gernerillo
Best Answer
-
Options
Jackson
mod
This is possible with the UnityEngine.VR.WSA.WebCam API
If you download the 5.4b10 documentation from here:
http://unity3d.com/pages/windows/hololensYou can find their documentation for this namespace, including some sample code to get images from the camera on the HoloLens.
Once you install the documentation, it will be in the install directory of Unity under "Data/Documentation/en/ScriptReference/VR.WSA.WebCam.PhotoCapture.html"
Once you have the image from your camera, you can do image processing on it to read the QR code and react accordingly.
5
Answers
This is possible with the UnityEngine.VR.WSA.WebCam API
If you download the 5.4b10 documentation from here:
http://unity3d.com/pages/windows/hololens
You can find their documentation for this namespace, including some sample code to get images from the camera on the HoloLens.
Once you install the documentation, it will be in the install directory of Unity under "Data/Documentation/en/ScriptReference/VR.WSA.WebCam.PhotoCapture.html"
Once you have the image from your camera, you can do image processing on it to read the QR code and react accordingly.
But my camera just sees things which are really in front of me, but not the other holograms, right? If that's the case, the recommended solution would not work.
Edit: I can find a "Mixed reality capture" in the sensors section of the HoloLens documentation. I think thats the functionality which is needed for my purpose, right?
When you create your PhotoCapture Object, pass true in for showHolograms, then any camera frames you get will have holograms in them.