Hello everyone.

The Mixed Reality Forums here are no longer being used or maintained.

There are a few other places we would like to direct you to for support, both from Microsoft and from the community.

The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.

For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality.

If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers, or in our Microsoft Tech Communities forums at https://techcommunity.microsoft.com/t5/mixed-reality/ct-p/MicrosoftMixedReality.

And always feel free to hit us up on Twitter @MxdRealityDev.
Options

Stream stereo pair to HoloLens

I'm interested in streaming a stereo pair, JPEG sequence to the HoloLens for prototyping purposes. @neerajwadhwa mentioned that this may already have been done before. I'm curious if anyone can provide code samples or a more general HOW TO?

My ideal would be to have a light weight application on the HoloLens that simply displays a left and right image in full screen. At the moment I don't think I'm too concerned with performance, I would just like to experiment with off device rendering.

Seems possibly related to this user's question: https://forums.hololens.com/discussion/comment/6023?

Answers

  • Options
    AlexDAlexD ✭✭✭

    I don't think controlling the individual displays is possible on the HoloLens. The process of separating the display outputs for each lens is done internally and likely not available for developers.

  • Options

    @jvanderdoes streaming JPEG to HoloLens is possible but I have not tried this myself and don't have any public samples to share at this moment.
    As @AlexD mentioned, you don't have access to left and right eye cameras.

  • Options
    CurvSurfCurvSurf ✭✭
    edited July 2016

    @neerajwadhwa
    I like to go the way in reversed direction: Recording stereo video from HoloLens.

    Seeing the video "HoloLens Spatial Mapping Points - Sphere Extraction", we can notice that the right eye video is being recorded.

    Or, as the video "Improvements by Google Project Tango", the neutral central view is OK.

  • Options

    @AlexD perhaps the best way to do this would be either a DirectX or Unity app with texture mapped image planes. Sound about right?

  • Options
    edited July 2016

    In unity I would agree, but then again I'm not sure about if you could do it with a custom shader in Unity., However, in DirectX it's totally possible. Unless I'm doing something extremely wrong and I've hacked my way into this... You CAN display different images to different eyes in Hololens, however you have to use DirectX - C++, and create your own pixel and vertex shaders. I found this out by accident trying to display 3D Words on the screen, see this post here

    You can control stereoscopic views which you noticed in the Recording software as noted above.

    I'll create a post about this later.

    Caveat... the experience in my oppinion gives a headache which I would expect over prolonged use due to the strain on 1 eye vs another. So be careful.

    Dwight Goins
    CAO & Founder| Independent Architect | Trainer and Consultant | Sr. Enterprise Architect
    MVP | MCT | MCSD | MCPD | SharePoint TS | MS Virtual TS |Windows 8 App Store Developer | Linux Gentoo Geek | Raspberry Pi Owner | Micro .Net Developer | Kinect For Windows Device Developer
    http://dgoins.wordpress.com

  • Options

    @Dwight_Goins_EE_MVP that looks really promising. Do you have any code you're willing to share?

  • Options

    Dwight Goins
    CAO & Founder| Independent Architect | Trainer and Consultant | Sr. Enterprise Architect
    MVP | MCT | MCSD | MCPD | SharePoint TS | MS Virtual TS |Windows 8 App Store Developer | Linux Gentoo Geek | Raspberry Pi Owner | Micro .Net Developer | Kinect For Windows Device Developer
    http://dgoins.wordpress.com

Sign In or Register to comment.