Hello everyone.

The Mixed Reality Forums here are no longer being used or maintained.

There are a few other places we would like to direct you to for support, both from Microsoft and from the community.

The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.

For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality.

If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers, or in our Microsoft Tech Communities forums at https://techcommunity.microsoft.com/t5/mixed-reality/ct-p/MicrosoftMixedReality.

And always feel free to hit us up on Twitter @MxdRealityDev.

3D or 4D CT Scanning with HoloLense Emulator

Folks,
I hope this mail finds you well.

I would like to build an App on HoloLens Emulator for converting a 3D or 4D CT Scanning to run on HoloLense emulator. or converting any X-Ray files to run on hololens. how can i do that? appreciating your support to provide any links to start with, as I didn;t deal with Unity before,

Answers

  • Hi Yousri

    As I understand a CT scan is volumetric data, right? What I mean by this is that it has some data for every point in the volume, not just for a surface?

    Modern graphics is heavily geared towards rendering surfaces vs volumes, but there is work being done on that field. If you can get your data rendering in Unity, it should also render in Hololens - but keep in mind that performance will quite likely be an issue!

    There are some projects out there that show volumetric rendering in unity - this thread is as good a place to start as any.

    http://forum.unity3d.com/threads/3d-volume-rendering-using-raymarching-demo.120780/

  • Hi Yousri,

    Another approach you can consider is to render it on a desktop as a texture, and stream that texture to the HoloLens.

    I recognize it's not an ideal setup, but the power of a desktop GPU can be brought to bear in this situation.

    Nice to see another medical imaging topic get some HoloLens attention!

    Adam

  • Thanks MrSteveT, I will try it and keep you updated.

  • Hello Adam, I didn't get your point. What I have is DICOM file generated from CT device, what I have done; is converting this DICOM to .OBJ. is that possible to render the OBJ in HoloLense Emulator and How? from the other side, is there an automatic converdion from DICOM directly to be rendered in HoloLense. thanks in advance.

  • @MrSteveT @Adam @Yousri DICOM volume rendering on Hololens - CT scan of the abdominal area.. mind you its just a rough proof of concept.

    https://www.youtube.com/watch?v=TogSmPaVoOc

    Healthcare IT professional by day - Indie GameDev for UWP and mobile platforms by night

  • Great project! I think a STL or FBX convertion would be more useful for a surgeon, and would save cpu processing! Our surgical team does preoperative CT scan mesh rendering in mimics and simplification for Hololens...

    I think remote desktop can do this better, but if you could make a proper CT FBX generator for hololens cpu capabilities it would be awesome!

    https://www.youtube.com/watch?v=zC5097mA9f4

    https://www.facebook.com/henrique.lampert.3/videos/1285648761492289/

  • DanglingNeuronDanglingNeuron ✭✭✭
    edited October 2016

    @DrLampert You are right that a conversion to FBX/STL will definitely help with HoloLens rendering.. since graphics cards are in general way better with surface rendering than volume rendering.. but my thinking is that RAW DICOM data and the operations on top of them are valuable for radiologists and surgeons. I mean; wont riangulation, simplification, smoothing etc lose critical data in RAW DICOM. Even though, now that I think about it.. we could potentially have a technique that "replicates" those operations on a triangulated model as well. hmmm... I will have to think some more. But again.. a software like mimics needs manual processing (human intervention)... I was thinking more on the lines of provider's HoloLens directly connects to the PACS system and you could basically pull any patients dicom imagery, 3D or 4D for pre-op discussion, planning etc Maybe there could be a plugin for PACS that triangulates DICOMS automatically in the background and keeps a separate repository per patient .. but yeh its a big project. Also, not sure what you mean by remote desktop in this scenario.. but my objective in bringing this to HoloLens is to actually see 3D data in 3D.. and not on a 2D screen..
    But again, you are the surgeon.. so maybe my thinking is completely wrong :)

    Healthcare IT professional by day - Indie GameDev for UWP and mobile platforms by night

  • Working on same kind of project but i'm not skilled on DICOM file format. Some help on how to convert DICOM files to OBJ or FBX would be appreciated.

  • anyone who has succeeded to view DICOM MRI 3D on hololens contact me please
    I am here to search for people want to share us such business
    we can commercialize and go ahead offer a big opportunity
    all we look for is to stream from workstation to hololens realtime the 3D DICOM MRI for brain specifically to the hololens while the workstation is doing the control and final rendering
    another project is to export FBX 3D model from the workstation export it to hololens and then interact with the FBX for educational purposes
    anyone who has experienc

  • I am Dr. Mohamed Mekky
    the chief technology officer at Exceptional 3D Inc.

  • DanglingNeuron I know you are Imran Shafiq let me know how to contact you
    I am Dr. Mohamed Mekky
    the CTO of Exceptional 3D Inc.

  • @Adam said:
    Hi Yousri,

    Another approach you can consider is to render it on a desktop as a texture, and stream that texture to the HoloLens.

    I recognize it's not an ideal setup, but the power of a desktop GPU can be brought to bear in this situation.

    Nice to see another medical imaging topic get some HoloLens attention!

    Adam

    Hi Adam,
    Can you please advice me on how to stream the texture to the hololens

Sign In or Register to comment.