An idea for a movable courser for the HoloLens via a Eyetracker
I would like to propose an idea for implementing an eyetracker into the HoloLens,
Since i cant contact anyone from the Hololens team directly, i decided to post here.
So here is my idea,
since the hololens is effectively a binocular HUD with a fixed position courser, i thought that adding a eye tracker that uses the HUD beamsplitters to view the eyes might be a good way of moving the courser to wherever the person is looking, instead of where the person is pointing their head.
My idea works based on either polarizing (option 1) or Dichromatic beamspitters (option 2) inserted just before the HUD beamsplitter. (though there is probably another beamsplitter type i haven't thought of yet, the operating principle stays the same though).
In option 1, the camera views the eye either in the visible light spectrum, via the second beamsplitter, thus allowing for the lens to have more working distance to the eye. The light from the normal HUD would be polarized, resulting in only a small loss of luminosity. The camera can then use the opposite polarization to view the eye, also with minimal loss of light intensity. The problem with this method is however that the illumination of the eye is done mostly by ambient light. so using it in the dark is not easily done, this is solved with option 2.
Option 2 would be to use a Dichromatic mirror to a view the eye in the near infrared part of the light spectrum. This allows for a few benefits, lower light loss of the HUD screen, and the ability to directly illuminate the eye. This can be done in a few ways, such as Retro illumination and or Direct LED illumination (LED's at an angle, relative to the center line of the HUD Beamsplitter. This works, since the human eye can not pickup Infraread light in any meaningful way, thus using Infrared light would not produce glare, thus allowing for a better user experience.
The only thing i have not yet found a good solution to, is discarding random eye movement, and only registering the actual position the user wants to look at. It would be very distracting for the curse to be flying about the the HUD all the time. Once this problem is also solved, i believe this would be a good addition to the functionality and usability of the Hololens.
In addition, the optical system needed for this eyetracker shouldn't add too much bulk to the hololens. (if a small sensor is used). Though i am unsure about the processing resources, the eyetracking might need to be done on a separate SOC, as to not bog down the main SOC with processing the eyetracker as well. Though this might not be necessary, i don't know enough about the HoloLens SOC and its utilization to make that judgement.
If anyone wants an illustration of my concept, just say so, and ill sketch it.