Hand or depth camera API? Getting hand or individual finger position?

anandx

I'd like to explore creating some of my own gestures (ie, scrolling by flicking your hand), finger based pointing, etc.

Is there anyway I can get the hand or positions aside from using a manipulation gesture?

Something with the richness of the LeapMotion api would be amazing.

Short of that, is there anyway to access the depth camera data to try and infer it yourself?

HoloSheep

Hi @Anandx, the question has been asked and discussed (a lot) in previous threads.
Search the forums on terms like "custom gestures" or check out this thread as a good example of the discussion.

Bottom line, no advanced custom gesture support is not currently supported.

HoloSheep

Hi @Anandx, the question has been asked and discussed (a lot) in previous threads.
Search the forums on terms like "custom gestures" or check out this thread as a good example of the discussion.

Bottom line, no advanced custom gesture support is not currently supported.

anandx

That link is very helpful, thanks! I didn't see it on my initial search.

It seems that InteractionSourceState in HandsManager.cs mentioned here could be useful but I can't seem to find documentation on it anywhere. Don't suppose you have any pointers?

HoloSheep

@anandx HandsManager.cs can be found in the HoloToolkit under:
Input | Scripts
the online docs on github simply say:

HandsManager.cs

Keeps track of when the user's hand has been detected in the ready position.

krishna_chaithanya31

@HoloSheep is there any api so that we can get each and every joint as in kinnect or leap device.

HoloSheep

@krishna_chaithanya31

As for the skeleton and body tracking question the current version of HoloLens does not expose any skeleton or body tracking api (related to either the device user or other people the environment) but it has been mentioned that you could set up an environment that includes a Kinect and use its skeleton and body tracking capability.