Hello everyone.
The Mixed Reality Forums here are no longer being used or maintained.
There are a few other places we would like to direct you to for support, both from Microsoft and from the community.
The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.
For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality.
If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers, or in our Microsoft Tech Communities forums at https://techcommunity.microsoft.com/t5/mixed-reality/ct-p/MicrosoftMixedReality.
And always feel free to hit us up on Twitter @MxdRealityDev.
The Mixed Reality Forums here are no longer being used or maintained.
There are a few other places we would like to direct you to for support, both from Microsoft and from the community.
The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.
For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality.
If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers, or in our Microsoft Tech Communities forums at https://techcommunity.microsoft.com/t5/mixed-reality/ct-p/MicrosoftMixedReality.
And always feel free to hit us up on Twitter @MxdRealityDev.
Options
Can we do facial recognition from hololens ?
Hi all,
My purpose is to develop an application that makes facial recognition from hololens.
I thought using microsoft's cognitive services to store friend's pictures, their personal information and retrieve this information in case the person was identified.
Is it possible to do it from hololens? If so, where can I find information on this topic? Do you have any advice to give me ?
Thank you
Tagged:
0
Best Answer
-
Optionsdbarrett ✭✭✭
I wouldn't know. I haven't used the Cognitive Services with the HoloLens.
AR Developer
4
Answers
@AlMck I have gotten facial recognition to work with the HoloLens using OpenCV. However, I have not used it to check against known faces. Just detecting faces in general. There are some outdated tutorials that show you how to get the DLLs into your project but, once you have the OpenCV DLLs it is a matter of knowing your way around OpenCV. As well as doing a lot of optimization for using on the HoloLens otherwise you will only get like 1 FPS if you don't restrict it.
What you are talking about doing is a really big project. There isn't going to be really any tutorials for something like that. However, this should give you a little bit of a head start.
You can use this Nuget package to get the DLLs to import into Unity.
https://www.nuget.org/packages/OpenCV-Hololens/
You can follow this sort of tutorial here that talks about face detection:
http://thomasmountainborn.com/2017/03/05/unity-and-opencv-part-three-passing-detection-data-to-unity/
AR Developer
I find an article very interesting for me https://www.hackster.io/RONDAGDAG/hololens-cognitive-services-object-recognition-870bae
Do you know if we can finding the code source ?
I wouldn't know. I haven't used the Cognitive Services with the HoloLens.
AR Developer
I made my project, I can use the API vision cons I can not use the API Face. Do you have an idea of how to use it? I do not know how to pass in parameter of the method identify the array idFace that I recover from the method detect and the id group. This is the code used to get the Json with API vision
IEnumerator RunVision(byte[] image)
{
string myKey= "*********";
string myEndPoint = "https://westus.api.cognitive.microsoft.com/vision/v1.0/analyze?visualFeatures=Tags,Faces";
var headers = new Dictionary<string, string>() {
{ "Ocp-Apim-Subscription-Key", myKey},
{ "Content-Type", "application/octet-stream" }
};
WWW www = new WWW(myEndPoint, image, headers);
yield return www;
var myObject = JsonUtility.FromJson(www.text);
}
The documentation of Face API
https://westcentralus.dev.cognitive.microsoft.com/docs/services/563879b61984550e40cbbe8d/operations/563879b61984550f30395239
Thanks you for your help
Check out this GitHub project, might get you close to what you are looking for - https://github.com/misslivirose/unity-cognitive-services-demos/tree/master/unity-emotion-demo
Thanks you.
I was able to implement the features, I managed to do the facial recognition against it only works when browsing the code step by step. The error is "Object reference not set to an instance of an object". I make 3 requests one with the method detect the other with the method identify and finally the get to recover the person. do you know where the mistake might come from