Three Simple Steps

Scan a set of expressions to train your personalized avatar for tracking.

Capture a performance with realtime feed­back, and optionally improve the accuracy in a postprocessing stage.

Animate virtual avatars in faceshift and export the animation to your favorite 3D animation software, or connect to your existing animation pipeline.

Tracking

  • Expressions
  • Gaze Tracking
  • Head Pose Tracking
  • Realtime Tracking
  • Offline Refinement
  • 30fps

Excellent tracking is the core of faceshift. We can track with high accuracy, because we learn your personalized avatar. The avatar is created from a few training expressions, and the resulting tracking is very stable, accurate and expressive. We are tracking 48 blendshape parameters, which allows us to capture even small emotions.

We also track the eye gaze and head pose, brining the characters alive. And we do all of this in realtime, giving you the possibility to adapt your acting on the fly. For the final result, we offer an offline refinement and editing stage which further increases the tracking accuracy.

Integration

  • File Based
    • Animation Export (fbx)
    • Blendshape Curves Export
      (fbx,bvh,ascii)
    • Virtual Marker Export
      (bvh,ascii)
  • Plugin Based
    • Maya
    • Motion Builder
    • TCP/IP streaming via open format

All excellence at tracking is useless, if it is not easy to get the results onto your own rigs, in your own workflow. There are four ways of using faceshift:

– export the animation on one of our predefined rigs or personalized avatars as a fbx file, which can be imported in every major animation software.

– work directly within your animation package with our maya or motion builder plugins.

– integrate with existing marker based pipelines. No more need to place the markers accurately on the actor, you define them once and export as bvh or c3d for every take.

faceshift integrates well with all major animation packages

– and for the real geeks we offer a TCP/IP streaming protocol which gives you access to all the tracking data in real time, allowing you to come up with your very own workflows and applications.

Avatars

  • Custom Avatar Creation
  • Fully Rigged
  • Gaze Tracking

We did not set out to make an avatar creation software, but the result is pretty cool. As a byproduct of using faceshift you get a fully rigged, expressive avatar, which you can export to use in your own applications, and which you can drive with faceshift.

And people are coming up with very creative uses for this, from sliced wooden head sculptures to surreal fashion photography.

sliced wooden head

Hardware

  • Runs with
    • PrimeSense Carmine 1.09*
    • Asus Xtion Live Pro
    • Microsoft Kinect
  • Runs on
    • Mac
    • Windows
    • Linux [not yet released]

We support all major operating systems and the affordable RGBD cameras from PrimeSense, Asus, or Microsoft. And we made sure that our software is efficient such that you can run faceshift and your animation software simultaneously even on current laptops.

* for studio use we recommend the Asus XTion Live Pro using OpenNI 2 Drivers

faceshift capture setup using the asus xtion live pro

Support

  • Video Tutorials
  • Documentation
  • Forums
  • Responsive support
  • Affordable support agreements

We know that not everything goes smooth all the time. This is why we are proud to offer a responsive support and extensive self help material. If something is unclear, drop us a mail or visit our support page