1. StretchSense Knowledge Base
  2. Streaming to Other Software

Streaming from Hand Engine to MotionBuilder (DOC-5014)

This document will take you through the steps of connecting to MotionBuilder with a Hand Engine data stream.

Requirements

Setting up your MotionBuilder Project

  1. Download and Install the StretchSense Hand Engine and MotionBuilder
    NOTE: for this example, we are using version MoBu2019

  2. Launch Hand Engine and setup hand

    See Hand Engine User Guide (DOC-5046) for glove calibration instructions

  3. Once the hand is trained,  in the Streaming box on the left of the screen, enter your TCP Port number and set the switch to On. Check that the Streaming Status light in the Performer pane title bar (the right traffic light indicator) has turned green.

     

     

     

     

     

  4. Next, we need to add the most up-to-date plugin to MotionBuilder. To do this, first ensure MotionBuilder is closed. Then navigate to the Plugins folder you have downloaded from your http://www.stretchsense.com/my-account , and then navigate to the HE Mobu folder to find the plugin corresponding to your version of MotionBuilder (eg. HandEngineMobu18_150321_1.dll corresponds to MotionBuilder 2018).

     

  5. Copy the DLL matching your version of MotionBuilder (i.e. HandEngineMobuXX, where XX refers to the version of Mobu) to the directory:

    <MotionBuilder Install Directory>\Autodesk\MotionBuilder 20XX\bin\x64\plugins\

  6. The plugin is now installed in MotionBuilder, to test you can open the Hands asset. The Hands asset can be found in the Downloads Section of your StretchSense Account at http://www.stretchsense.com/my-account. The download is titled StretchSense FBX Files.

     

  7. In Resources > Asset Browser > Templates > Devices find the device OR - HandEngine Link and drag this into the scene.

     

  8. In the Navigator > Devices find the new OR - HandEngine Link device and then set the IP Address and TCP Port settings as specified in Hand Engine

    NOTE: The default value for Address is 127.0.0.1 (= localhost), i.e., you are running Hand Engine on the same PC that you are running MoBu. If you have bound Hand Engine to a different IP address (e.g. if you are running Hand Engine and MoBu on different computers on the same LAN), use this IP address instead for Host.

    NOTE: this is the step you need to repeat if you turn Streaming to Off in Hand Engine as previously described.



  9. Press the online button and you should see the icon turn green and the sample(s)/s value increase signifying data arriving at Mobu.

     

     

  10. From the model binding dropdown select hand_l (note if Right Hand is selected in Hand Engine, the binding option will swap to hand_r).



  11. The hand in the scene should now move as you move your hand.

     

  12. To record animation in MotionBuilder:
    a. First right click on the Action timeline and select Time → Show as timecode,
    b. Ensure Recording is ticked in the Stretchsense HandLink Device,
    c. Click the Record button in the MoBu Transport Controls and create/overwrite a take.
    d. Click the Play button in the MoBu Transport Controls to begin recording.

    NOTE: Starting to record a take in MoBu will trigger Hand Engine to begin recording raw data simultaneously. The take name from MoBu will be sent to Hand Engine and the raw data file recorded by Hand Engine will be recorded in a new folder that follows the <take name>_<date>_<time> format.

    NOTE: To replay the take in MoBu, ensure Live is unticked, right-click on the Action timeline and select Time → Frame Take, then click Play

Disclaimer, Intellectual Property, and Licensing

Revision Summary

Revision

Date

Notes

9

2021.11.01

Updated links for HS

8

2021.10.04

Updated images for HE 1.4

7

2021.07.27

Updated images for HE 1.2.1.

6

2021.03.24

Updated for Hand Engine 1.1.0

5

2021.03.08

Updated for Hand Engine 1.0.1

4

2020.10.02

Update for Beta4

3

2020.09.21

Update for Beta3.5

2

2020.08.21

Update for Beta3

1

2020.07.21

Initial version