How do I realistically match sprite animations to a video?

I've embedded an example, below. Here are some cool effects I notice:

  • the animations are matched with the shaking camera shots, frame-by-frame.
  • some shots have the animations changing in focus to match the camera shots
  • some shots mask the animations to make them look like they're moving behind things in the video



So, how is this done? What software tools are used? What are the different effects called?

sort by: active | newest | oldest
SplineGod says: Jan 30, 2009. 8:44 PM
It can be done using a combination of 2d and 3d software. The 2d software can be something like after effects, fusion, nuke etc and can be used to track the video as well as do compositing (make the items appear to move behind parts of the video). 3D or other 2d animation software can be used to create the actual animations. You can also use additional software to do motion tracking for use with your 3d software like voodoo tracker which is free.
omnibot says: Mar 9, 2009. 1:08 AM
If I was doing this I'd do the animations in 2D separately and add them frame-by-frame to the video THEN I'd add the shaking as an after-effect to make it all seem more 3D.
Sandisk1duo says: Jan 30, 2009. 6:44 PM
that video is awesome!
mg0930mg in reply to Sandisk1duoFeb 11, 2009. 5:04 PM
I liked it too... haha. I wish I could edit videos, I'm still learning though.
omnibot in reply to mg0930mgMar 9, 2009. 1:06 AM
Yeah .. someone's been smoking something.
fungus amungus says: Jan 29, 2009. 4:54 PM
The first one is tracking. One way to do this is to make a green square with a few black x's on it. Identify the x's in the software and it can track the movement of the box in the frame and adjust the video for it. Have seen it in Motion.
nagutron (author) in reply to fungus amungusJan 29, 2009. 6:14 PM
So, the green square is something I make in real life and put in the camera shot?
fungus amungus in reply to nagutronJan 29, 2009. 6:16 PM
Yeah, that's one example. You can also track other items in the scene as well. You can probably get away with a white rock or a stick (which would work for that whale). After Effects is likely the software you want for lots of fun stuff.
Pro

Get More Out of Instructables

Already have an Account?

close

PDF Downloads
As a Pro member, you will gain access to download any Instructable in the PDF format. You also have the ability to customize your PDF download.

Upgrade to Pro today!