Hello everyone.

We have decided to phase out the Mixed Reality Forums over the next few months in favor of other ways to connect with us.

The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.

The plan between now and the beginning of May is to clean up old, unanswered questions that are no longer relevant. The forums will remain open and usable.

On May 1st we will be locking the forums to new posts and replies. They will remain available for another three months for the purposes of searching them, and then they will be closed altogether on August 1st.

So, where does that leave our awesome community to ask questions? Well, there are a few places we want to engage with you. For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality. If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers. And always feel free to hit us up on Twitter @MxdRealityDev.

HoloLens Live Stream to Unity in non-local network

How can i stream, what the HoloLens is seeing (without Holograms), to unity on a remote Win10 device through a non-local network. The delay should be less than 2 seconds.
Any Idea?

Answers

  • Hi @vale,

    Short answer is no, there isn't a way.

    Here's the longer answer:

    You'd have to create a custom remoting tool using the remoting apis and then figure out how to re-stream it from the cloud - and even then it's not really guaranteed to work.

    It's basically a very big problem that would take a really good engineering team with C++ expertise to figure out, and then you'd also need to be able to hook into the Unity IDE, which may not let you anyways.

    James Ashley
    VS 2017 v5.3.3, Unity 2017.3.0f3, MRTK 2017.1.2, W10 17063
    Microsoft MVP, Freelance HoloLens/MR Developer
    www.imaginativeuniversal.com

  • valevale
    edited December 2016

    Hi @james_ashley

    thanks for the quick answer.

    I tried to send Live Pictures from the HoloLens Webcam to my remote PC by using the WebCamTexture in Unity. This works but it's extremly slow, because it sends too big data over the network-connection.

    But there must be a solution, i mean Skype got it right.

    1) Maybe compress the WebCam data as good as you can? Or is that the wrong direction? How does Skype archieve this?

    2) Maybe use an existing Streaming service? But how do i include this in my App?

  • @vale,

    You can always try starting here if you don't mind the extra work: https://developer.microsoft.com/en-us/windows/holographic/mixed_reality_capture_for_developers

    There are instructions at the end of the article on rolling your own.

    James Ashley
    VS 2017 v5.3.3, Unity 2017.3.0f3, MRTK 2017.1.2, W10 17063
    Microsoft MVP, Freelance HoloLens/MR Developer
    www.imaginativeuniversal.com

  • if you look at the forums you will that using UnityWebCamTexture performs terribly on the Hololens. So the first problem is devising custom code to get the camera frame since the Unity Apis save the video stream only to disk.
    The next problem is using a network service for sending the image over. You could use WebRTC and adapt it to Hololens or the Photon library.
    Be advised that the existing video chat/network plugin in the unity store are NOT UWP compatible. They dont state it but they are not. And one of them who is uses WebCamTexture. I tried them all.

  • Can do:

    https://www.assetstore.unity3d.com/en/#!/content/7447

    Just disable (Do Not Process) LANParty.dll for UWP.
Sign In or Register to comment.