1. StretchSense Knowledge Base
  2. Merge Recorded Hand and Body Data

Unity - Retargeting and Merging Pre-Recorded Hand Data Animation with Body Data Animation (DOC-5041)

This document will take you through the steps of merging Hand Engine FBX Data (Full Body FBX) with Body FBX Data in Unity.

Requirements

Process

Setting up the Character Rig
  1. Open Unity Project with Starter Assets

  2. For this example, we will use the Unity Robot Character Prefab

  3. The Full Body FBX from Hand Engine comes in rigged as Generic and has to be rigged as Humanoid. Apply these changes and then press the Configure button

    How to record Hands on a Skeleton FBX (Full Body) or Hand Only FBX in Hand Engine (DOC-5044)


    Please note: If you want to edit the animation length, firstly select the imported FBX file, go to the inspector panel and select animation (see image below). From here you can crop the animation using the slide bars or by setting the frame start and stop values. Note unlike the other platforms you cannot extend the animation this way (i.e. add extra keys), you can can only remove keys.

     

  4. The bones of the skeleton are auto-populated. For the hands you will need to manually update the bones because the Unity hand rig doesn't have metacarpal bones. See below images for the correct mapping of joints for the body and the left hand. Make sure to also update the Right hand bones.

Blending Animation Layers
  1. Create an Animator controller on your target character or create a new one. It will have a base layer

    The PlayerArmature prefab has a default Base Animation Layer below.

     

  2. Create a new animation layer for the hand. You can call it “Hand Layer”. Right click and add a new empty state then add the animation recorded in Hand Engine to this new state.

     

  3. Right Click in the Project Window and Create an Avatar Mask. You can call it “Hand Mask”. Set only the hands to be active.

    In the Inspector edit the mask from the default to only the Hands being active (green)

  4. Return to the Animator Controller. Within settings for Hand Layer set Hand Mask and set the Weight from 0 to to 1

     

  5. Play scene and animation for Body and Hands should play together


Disclaimer, Intellectual Property, and Licensing

Revision Summary

Revision

Date

Notes

3

2022.11.10

Removed broken link.

2

2021.11.01

Updated links for HS

1

2020.08.23

Initial version