Hand Landmark from Google Mediapipe validated for Unity Sentis (Version 1.4.0-pre.3*)

*Version 1.3.0 Sentis files are not compatible with Sentis 1.4.0 and need to be recreated/downloaded

This is the Hand Landmark model from Google in the Sentis format.

The model detects 3D markers on a hand centered in an image. You could use these markers, for example, to control a bone rig.

IMPORTANT: The hands needs to be centered and cropped to fit the image. For images with hands not in the center or for multiple hands, you will need another model to detect hands, and crop them before feeding them into this model. For example you could use Blaze Palm to detect them (but this model only works with open palms).

How to Use

• Create a new scene in Unity 2023
• Install com.unity.sentis version 1.4.0-pre.3 from the package manager
• Add the c# file to the Main Camera
• Drag the hand_landmark.sentis file in asset field
• Put a video in the Assets/StreamingAssets folder and set videoName variable to the video name
• Create a RawImage and place it in your scene. Link to this image in the previewUI field.

Preview

If you get it working it should look like this (original image from pexels.com):

License

All Google Mediapipe models are open source under the Apache 2.0 license. The accompanying C# source code we provide can be used in your applications for commercial purposes.