In-App Motion Capture Recording

***Read through this guide at least once before putting the steps into action.***

With this option, you will need at least 2 web cameras connected to your machine.

Pre-Marionette: Before You Begin

1. Calibration Pattern

  • Locate the file “Marionette_data/StreamingAssets/CalibrateExtrinsics.png” (or download it here)
  • Print the file as large as possible on a sheet of A3 white paper (or two pieces of A4 put together to form an A3 size).

Marionette: Launch Marionette

  • The very first time you open Marionette you will need to enter a license key, after which you will see this window.
  • Open the recording panel by pressing the red circle in the bottom right side of the Timeline preview.

1. Select Cameras to record

  • Select the cameras you would like to record with (toggle), as well as a microphone (dropdown).

2. Adjust Camera’s Settings

  • Press the settings button (cogwheel icon).
  • In “Camera Control” make sure auto-focus and auto-exposure are disabled. 
  • Set exposure to the lowest value you can in your lighting conditions (prevents motion blur and improves mocap)
  • Do this for each camera you have selected.

3. Lens Calibration

  • Provide lens calibrations for the selected cameras  (dropdown)
  • If your camera is not one of the default presets, you will need to create a new preset (top right button).
  • For help with creating a new preset see the Lens Calibration guide.

4. Position Calibration

  • Use the “Preview Cameras” button to see your selected cameras.
  • Lay out the printed calibration pattern on the floor so that it is visible by all cameras.
  • Press the “Position calibration” button, which opens previews of all selected cameras and tries to detect the printed calibration pattern.
  • If all cameras can see the pattern, the process will finish, otherwise try and move the pattern around, so that it is visible by your cameras. 
  • Once this is done, do NOT move the cameras. If you do you must rerun the position calibration!

5. Begin Recording

  • Make sure the rest of the settings are correct/desired, before you press the record button. (If using auto-sync it is recommended to start the recording session with 3 claps of your hands.)
  • You will again see a preview of your cameras and can perform the motions you would like to convert to motion.
  • When finished with the recording, press stop.

6. Recording Succeded

  • If everything went without an issue, you should see a take with the recorded videos on the left side of the screen.
  • Common issues:
    • Camera is in use by another application
    • Detected wrong GPU (make sure toggle is correct)
    • Camera does not support selected settings
  • If the problem is not part of common issues, please report the error here.

7. Prepare Take

  • In this recording, cameras were sideways to cover more vertical space. In such a case, use the take settings to re-orient the videos.
  • On some devices, the recorded videos could end up with a small offset. Use the “Sync Videos” button to open the “Sync Timeline” and synchronize the videos. 

8. Convert To Clip

  • Drag the take to convert it to a clip and position it on the timeline.

9. Render Motion

  • With the clip on the timeline, you can use in and outs (default shortcut “I” and “O”) to specify an area of the timeline to render motion from.
  • Press the “Render” button to generate motion

10. SUCCESS!

  • You can now preview your motion on the default marionette or can import your own model!

EXPORT NOTE:

  • When you review your exported animation, please be aware that Marionette adds to the model’s animation. Therefore, you will see additional animation clips.
  • Select the additional clips to review your exported animation.
  • If you do not see an additional clip, please report the error here.
Marionette ApS
Maglebjergvej 6
2800 Kongens Lyngby
CVR: 39989603
pilotprogram@marionettexr.com