The Mixed Reality Forums here are no longer being used or maintained.
There are a few other places we would like to direct you to for support, both from Microsoft and from the community.
The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.
For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality.
If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers, or in our Microsoft Tech Communities forums at https://techcommunity.microsoft.com/t5/mixed-reality/ct-p/MicrosoftMixedReality.
And always feel free to hit us up on Twitter @MxdRealityDev.
How do I merge 3 JPEGs to create a 3D image that I can manipulate with Hololens
I am a medical student working with a plastic surgeon mentor who would like to use 3D images captured with Canfield Vectra 3D cameras in Hololens. I have 3 JPEGs of the front and two side views of a face that I would like to merge to make a single 3D image. I also have a colorless .OBJ file that the Vectra produced. I would like to make a colored 3D image from the JPEGs. Any suggestions for how I can do that? Which software should I be using? Thanks!
Best Answer
-
Options
HoloSheep
mod
@HTheDream looking at the Canfield site it is hard to tell for sure, but it looks like their system creates a 3D model through photogrammetry.
If that is the case, the results are typically a 3D volumetric model not a 3D image. I am not sure what 3D image means in the context that you are using it, but it is sometimes use to describe Stereograms or it might be a way that someone would describe a 360 degree panoramic image. My point however is that with photogrammetry, images are used as inputs and the output is a 3D model of some sort.
Perhaps the .OBJ file that you have is the 3D model output or perhaps not. Taking the images and producing jpgs is the easy part, it is the calculations (the photogrammetry) that requires the work. There is a pretty good chance that Canfield protects their output format and may not provide you full fidelity 3D output and textures, but you could ask them about documentation of their output formats and see what they say.
If you open the OBJ in a 3D application what do you get? You mention that it is Colorless, do you mean monochrome? Can you provide a screen shot as an example?
If the jpgs that you have are in fact all of the full high res captures from the device it would require some work but you might be able to use some of the available photogrammetry software applications to process the images into a 3D model on your own, but my guess would be that the jpgs output from the Canfield are not likely the source images used for the computation.
Windows Holographic User Group Redmond
WinHUGR.org - - - - - - - - - - - - - - - - - - @WinHUGR
WinHUGR YouTube Channel -- live streamed meetings5
Answers
@HTheDream I would suggest using the Adobe suite, a combination of Photoshop and their other products. I've used to make 3D models before and there are plenty of tutorials out there.
@HTheDream looking at the Canfield site it is hard to tell for sure, but it looks like their system creates a 3D model through photogrammetry.
If that is the case, the results are typically a 3D volumetric model not a 3D image. I am not sure what 3D image means in the context that you are using it, but it is sometimes use to describe Stereograms or it might be a way that someone would describe a 360 degree panoramic image. My point however is that with photogrammetry, images are used as inputs and the output is a 3D model of some sort.
Perhaps the .OBJ file that you have is the 3D model output or perhaps not. Taking the images and producing jpgs is the easy part, it is the calculations (the photogrammetry) that requires the work. There is a pretty good chance that Canfield protects their output format and may not provide you full fidelity 3D output and textures, but you could ask them about documentation of their output formats and see what they say.
If you open the OBJ in a 3D application what do you get? You mention that it is Colorless, do you mean monochrome? Can you provide a screen shot as an example?
If the jpgs that you have are in fact all of the full high res captures from the device it would require some work but you might be able to use some of the available photogrammetry software applications to process the images into a 3D model on your own, but my guess would be that the jpgs output from the Canfield are not likely the source images used for the computation.
Windows Holographic User Group Redmond
WinHUGR.org - - - - - - - - - - - - - - - - - - @WinHUGR
WinHUGR YouTube Channel -- live streamed meetings