Hello everyone.

The Mixed Reality Forums here are no longer being used or maintained.

There are a few other places we would like to direct you to for support, both from Microsoft and from the community.

The first way we want to connect with you is our mixed reality developer program, which you can sign up for at https://aka.ms/IWantMR.

For technical questions, please use Stack Overflow, and tag your questions using either hololens or windows-mixed-reality.

If you want to join in discussions, please do so in the HoloDevelopers Slack, which you can join by going to https://aka.ms/holodevelopers, or in our Microsoft Tech Communities forums at https://techcommunity.microsoft.com/t5/mixed-reality/ct-p/MicrosoftMixedReality.

And always feel free to hit us up on Twitter @MxdRealityDev.

To send Hololens microphone-input sound to a PC

nadianadia
edited March 2018 in Questions And Answers

Hello,
I plan a voice conversation in Hololens, but the language to use is not English.
So I plan to send the voice input sound(file or stream) from the microphone of Hololens to the PC(Windows or Linux),
and After processing the speech recognition of my language through Google API,
try to send back the corresponding answer to Hololens.
Can the voice input into the microphone of Hololens be delivered to the PC(Windows or Linux) by UDP socket communication?
And is it the best way?
I’m a beginner in development,
Even a little advice would be of great help to me.
Thanks.

Tagged:

Answers

  • dbarrettdbarrett ✭✭✭

    Why not send the speech to the Google API from the HoloLens? Why do you have to send it to a PC that then in turn sends it to the Google API? I would try to find a solution that cuts out the middle man.

    AR Developer

  • As you said, sending it from Hololens to GoogleAPI is another way. However, in order to use NLP, I have to send it to a PC, anyway.
    1. Hololens -(voice)-> PC -> GoogleAPI -> get Text(in PC)
    2. Hololens -(voice)-> GoogleAPI -> get Text(in Hololens) -(text)-> PC
    I don’t mind either, but I thought the former(1) would be less burdensome on the Hololens. And there may be a problem with getting and sending text because Hololens does not support my language.

  • dbarrettdbarrett ✭✭✭

    If your end goal is to get it on the PC then why do you need a HoloLens at all? All you really need is a microphone hooked up to a PC.

    AR Developer

  • My end goal is a voice conversation in Hololens. So it is necessary to get a voice input from Hololens.
    As you said, I can attach a extra microphone to Hololens, if it is unavoidable. But if I could use Hololens microphone input, it would be simpler to do so.

  • I have this exact same problem! would love to know when you get it working

  • dbarrettdbarrett ✭✭✭

    @mumblefish Try taking a look at the MicrophoneReciever and MicrophoneTransmitter scripts in the MRTK maybe that will help you out.

    AR Developer

Sign In or Register to comment.