Hello everyone.

The Mixed Reality Forums here are no longer being used or maintained.

There are a few other places we would like to direct you to for support, both from Microsoft and from the community.

The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.

For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality.

If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers, or in our Microsoft Tech Communities forums at https://techcommunity.microsoft.com/t5/mixed-reality/ct-p/MicrosoftMixedReality.

And always feel free to hit us up on Twitter @MxdRealityDev.
Options

HoloLens Live Stream to Unity in non-local network

valevale ✭
in Questions And Answers

How can i stream, what the HoloLens is seeing (without Holograms), to unity on a remote Win10 device through a non-local network. The delay should be less than 2 seconds.
Any Idea?

Tagged:

Answers

  • Options
    james_ashleyjames_ashley ✭✭✭✭

    Hi @vale,

    Short answer is no, there isn't a way.

    Here's the longer answer:

    You'd have to create a custom remoting tool using the remoting apis and then figure out how to re-stream it from the cloud - and even then it's not really guaranteed to work.

    It's basically a very big problem that would take a really good engineering team with C++ expertise to figure out, and then you'd also need to be able to hook into the Unity IDE, which may not let you anyways.

    James Ashley
    VS 2017 v5.3.3, Unity 2017.3.0f3, MRTK 2017.1.2, W10 17063
    Microsoft MVP, Freelance HoloLens/MR Developer
    www.imaginativeuniversal.com

  • Options
    valevale ✭
    edited December 2016

    Hi @james_ashley

    thanks for the quick answer.

    I tried to send Live Pictures from the HoloLens Webcam to my remote PC by using the WebCamTexture in Unity. This works but it's extremly slow, because it sends too big data over the network-connection.

    But there must be a solution, i mean Skype got it right.

    1) Maybe compress the WebCam data as good as you can? Or is that the wrong direction? How does Skype archieve this?

    2) Maybe use an existing Streaming service? But how do i include this in my App?

  • Options
    james_ashleyjames_ashley ✭✭✭✭

    @vale,

    You can always try starting here if you don't mind the extra work: https://developer.microsoft.com/en-us/windows/holographic/mixed_reality_capture_for_developers

    There are instructions at the end of the article on rolling your own.

    James Ashley
    VS 2017 v5.3.3, Unity 2017.3.0f3, MRTK 2017.1.2, W10 17063
    Microsoft MVP, Freelance HoloLens/MR Developer
    www.imaginativeuniversal.com

  • Options
    christopchristop ✭

    if you look at the forums you will that using UnityWebCamTexture performs terribly on the Hololens. So the first problem is devising custom code to get the camera frame since the Unity Apis save the video stream only to disk.
    The next problem is using a network service for sending the image over. You could use WebRTC and adapt it to Hololens or the Photon library.
    Be advised that the existing video chat/network plugin in the unity store are NOT UWP compatible. They dont state it but they are not. And one of them who is uses WebCamTexture. I tried them all.

  • Options
    MidnightStatusMidnightStatus ✭
    Can do:

    https://www.assetstore.unity3d.com/en/#!/content/7447

    Just disable (Do Not Process) LANParty.dll for UWP.
Sign In or Register to comment.