Motion Capture in 3D Animation
Edward Tse
Motion Capture as a Tool
Motion capture (MOCAP) is an effective 3D animation tool for realistically capturing human motion
Outline
Rotoscoping The MOCAP Pipeline Limitations of MOCAP The Future of MOCAP
By the Power of Appendix B!!
Rotoscoping
History
Captured Video
Johnston, et al., 1995
Rotoscoping
History
Tracing
Johnston, et al., 1995
Rotoscoping
Post Processing
Johnston, et al., 1995
The MOCAP Pipeline
Calibration Capture 3D Position Reconstruction Fitting to the Skeleton Post Processing
Capture
Optical
Magnetic Transmitter
Infra Red LEDs
Magnetic
Mechanical
Potentiometers
Costa-Sousa, M., 2004
Calibration
Image Space World Space
(X,Y) (X,Y) (X,Y)
(X,Y,Z) (X,Y,Z) (X,Y,Z)
3D Position Reconstruction (Utopia)
C k I k I C C C C1 k1 1 1 I C P C 1 k 1 I I 1 CC1 C Ck k 2 C2 C 2 C k 2 I I C 2 k 2I I2 CC C P k I C k 2 C
1x 1 1x 1x 2x 2 2x 2x 1y 1z 1 1y 1y 2y 2 2y 2y 1 1z 1z 2z 2 2z 2z
3D Position Reconstruction (Reality)
Multiple Markers
For small number of markers: Size Occlusions are a problem C2 Multiple Hypothesis Tracking
C1
Ringer, et al., 2002
Multiple Markers
Mechanical Optical Hybrids
http://www.animazoo.com/services/gypsyHybrid.htm
Fitting to the Skeleton
Utopian approach
– 10 – 20% length changes
Markers on both sides Joint Displacement Use Rotation Angles Only
Post Processing
Motion Editing
– Cut, Copy, Paste
Motion Warping
– Speed up or Slow Down – Rotate, Scale or Translate
Motion Signal Processing
– Smoother Motions
Limitations of MOCAP
Subject to data inaccuracy Expensive
Device
Mechanical Electromagnetic Optical
Cost for Body capture (USD)
$20’000 – $30’000 $100’000 – $120’000 $90’000 – $210’000
Limitations of MOCAP
Only realistic motion captured
– Cartoony Animations not possible
WYSIWYG (what you see is what you get)
– Can’t add more expression – Continally need to recapture motion
Robertson, B., 2001
The Future of MOCAP
Markerless MOCAP Cheaper MOCAP MOCAP as Input to Large Displays
Bregler Ngan, hollywoodjesus.com et al., 2002 S., 2004
Conclusion
Motion capture (MOCAP) is an effective 3D animation tool for realistically capturing human motion
Questions?
References
Johnston, O., Thomas, F., (1995) The Illusion of Life: Disney Animation, Disney Editions, ISBN: 0786860707 Costa-Sousa, M. (2004) Motion Synthesis, Powerpoint Presentation Parent, R. (2002) Computer Animation: Algorithms and Techniques, Morgan Kaufmann Publishing Ringer, M., Lasenby, J. (2002) Multiple Hypothesis Tracking for Automatic Optical Motion Capture, European Conference on Computer Vision (ECCV ’02) Robertson, B. (2001) Medieval Magic, Computer Graphics World, April 2001. Tse, E. (2004) The Single Display Groupware Toolkit, MSc Thesis, University of Calgary, Ab, Canada Bregler, C., Loeb, L., Chuang, E., Deshpande, H., (2002) Turning to the Masters: Motion Capturing Cartoons, Proceedings of ACM Siggraph 2002 pp 399 – 407. vicon.com, inition.co.uk, polhemus.com, wikipedia.org, animazoo.com, hollywoodjesus.com
Bonus Slides
Stuff that’s too cool for you!
Stats
Input Device Frame Rate Range (hz) 60-240 Position Accuracy .03in RMS static 0.00015in at 12in range Orientation Accuracy .15° RMS static 0.0012° at 12in range Latency & range 3.5ms 5 ft Maximum Points tracked 16 Use in Movies Cost Range (USD) $8’495 $21’925 Polhemus (Magnetic) Woody and Hamm in Toy Story, The Chandelier in Beauty and the Beast Sony, Nintendo, Microsoft, Boeing,
Vicon (Optical)
166-10’000
1/117’600in or 0.02 of a Pixel up to 4MP 0.08cm RMS at 1.52m range No Absolute position 0.5° RMS at 1.52m range 1°
No camera limit
500
$89’170 $209’920
Ascension ReActor 2 (Magnetic) Gypsy (Mechanical) wireless possible
100
4.11m x 4.11m area 200m
30
$99,410 $102’315 $20’000 $27’000
12-120
42
Calibration
θ
1
θ
2
Outline
History Motion Capture Pipeline Limitations Future Work