Hello everyone.

The Mixed Reality Forums here are no longer being used or maintained.

There are a few other places we would like to direct you to for support, both from Microsoft and from the community.

The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.

For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality.

If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers, or in our Microsoft Tech Communities forums at https://techcommunity.microsoft.com/t5/mixed-reality/ct-p/MicrosoftMixedReality.

And always feel free to hit us up on Twitter @MxdRealityDev.
Options

Streaming files to HoloLens - DICOM viewer

I am in healthcare IT and just started a proof of concept DICOM viewer for HoloLens. I would ideally like to enumerate folders in one drive and then when a folder is chosen, stream all dicom image set to render on hololens. FilePicker currently only allows to pick 1 file as I understand. Should I use the REST api for onedrive to work around that limitation?

Healthcare IT professional by day - Indie GameDev for UWP and mobile platforms by night

Answers

  • Options
    ContextVRContextVR ✭✭✭

    @DanglingNeuron HoloLens App Model document might help, it talks about FileOpenPicker and FileSavePicker contracts being supported by OneDrive application, which is a separate install.

    https://developer.microsoft.com/en-us/windows/holographic/app_model#file_pickers

    If you install the OneDrive app, it should come up when you open a file picker.
    Here's some UWP-specific sample code to do that.

    https://code.msdn.microsoft.com/File-Picker-in-Windows-10-846c2116

    The you can read contents of the file and process the data as you like.

  • Options

    DICOM image set contains tens or hundreds of images. As far as I understand, OneDrive filepicker contract will only allow use to select 1 file at a time. I need a folder picker so the app can enumerate all files in it and stream them. FolderPicker is not supported as far as I know. i could probably use the OneDrive REST API to hack something... but will know more when I actually try it.

    Healthcare IT professional by day - Indie GameDev for UWP and mobile platforms by night

  • Options
    ContextVRContextVR ✭✭✭

    @DanglingNeuron I see where you're coming from. I see several ways to go about this:

    1) See if OneDrive handles FolderPicker contract, which could let you pick a folder. App models talks about special folders, but it would be a question for the Microsoft team if FolderPicker is supported on HoloLens.

    https://msdn.microsoft.com/library/windows/apps/br207881

    2) Create an archive of your DICOM image set and put it on OneDrive. This is probably the easiest way to work around your issue without writing custom code.

    3) Implement your own FileOpenPicker, but the first file picker installed will be used, so it would probably be a complication for other apps.

    https://developer.microsoft.com/en-us/windows/holographic/app_model#file_pickers

  • Options

    @ContextVR said:
    3) Implement your own FileOpenPicker, but the first file picker installed will be used, so it would probably be a complication for other apps.

    https://developer.microsoft.com/en-us/windows/holographic/app_model#file_pickers

    I'm almost seriously considering doing this, as the "Can only use one FilePicker-capable app" is a retarded limitation IMHO.

    My idea is to figure out how to enumerate other filepickers and offer a menu to choose from them, though I'm not sure how to do that. Is this a pipe dream?

  • Options

    @Tsaukpaetra Sounds like AirDrop on iOS and its equivalent on Android, which are powerful ways to share files between apps, while not making them dependent on each other.

  • Options

    Hi, @DanglingNeuron . I'm following you. I'm dealing with the same case you have. And trying to perform operations over DICOM in Hololens visualization 3D images.
    Any news, I'll share here. And I hope you'll get success too.

  • Options

    I have tried a few shaders for volume visualization of DICOM data, but they are awfully slow ... and so far I have been able to only visualize static data i.e. dicom sequences that are built into the unity app (assets folder) - no dynamic loading for now.

    Healthcare IT professional by day - Indie GameDev for UWP and mobile platforms by night

  • Options

    @DanglingNeuron volumetric medical data is challenging.

    One approach I have tried in the past with medical imaging data was to produce a particle cloud. I sampled the data files individually- extracted the 2D imaging data and positioned the third axis according to slice position. I then placed an appropriately colored particle at this location. I put in some optimizations (dark areas in m y data set which would be invisible/see-through on Hololens anyway, I simply discarded) - performance isn't great but by changing my sampling parameters, particle size, and particle transparency I was able to get some usable results.

    I used this to help me generate the particle clouds:

    http://catlikecoding.com/unity/tutorials/graphs/

  • Options

    @mavasher @Jason @Tiagoooliveira

    DICOM volume rendering on Hololens - CT scan of abdomin - rough proof of concept.

    https://www.youtube.com/watch?v=TogSmPaVoOc

    Healthcare IT professional by day - Indie GameDev for UWP and mobile platforms by night

  • Options
    JasonJason ✭✭
    edited October 2016

    @DanglingNeuron This is great, where do you plan on taking it next? What solution did you use for your filepicker for loading an enumerated image set containing multiple images?

  • Options

    @DanglingNeuron wow! Great job!
    Have you created a custom filepicker for loading the enumerated image?

  • Options

    For now, they are imported into unity. But I am working on loading them from OneDrive

    Healthcare IT professional by day - Indie GameDev for UWP and mobile platforms by night

  • Options

    @DanglingNeuron have you made any progress on dynamically loading DICOM files or folders? I am also working on a medical app.

  • Options

    @yena yes it works but its slow.

    Healthcare IT professional by day - Indie GameDev for UWP and mobile platforms by night

  • Options
    Jimbohalo10Jimbohalo10 ✭✭✭
    edited December 2016

    hi @DanglingNeuron @yena This medical scan program might be of help 3D medical imaging reconstruction software -invesalius3 on GitHub.
    The video of program running is here and Wikipedia his here

    Its written in Python so may on be of use on PC, but may give you some inspiration

Sign In or Register to comment.