Instructables

How do I realistically match sprite animations to a video?

I've embedded an example, below. Here are some cool effects I notice:

  • the animations are matched with the shaking camera shots, frame-by-frame.
  • some shots have the animations changing in focus to match the camera shots
  • some shots mask the animations to make them look like they're moving behind things in the video



So, how is this done? What software tools are used? What are the different effects called?

SplineGod5 years ago
It can be done using a combination of 2d and 3d software. The 2d software can be something like after effects, fusion, nuke etc and can be used to track the video as well as do compositing (make the items appear to move behind parts of the video). 3D or other 2d animation software can be used to create the actual animations. You can also use additional software to do motion tracking for use with your 3d software like voodoo tracker which is free.
omnibot5 years ago
If I was doing this I'd do the animations in 2D separately and add them frame-by-frame to the video THEN I'd add the shaking as an after-effect to make it all seem more 3D.
Sandisk1duo5 years ago
that video is awesome!
I liked it too... haha. I wish I could edit videos, I'm still learning though.
Yeah .. someone's been smoking something.
The first one is tracking. One way to do this is to make a green square with a few black x's on it. Identify the x's in the software and it can track the movement of the box in the frame and adjust the video for it. Have seen it in Motion.
nagutron (author)  fungus amungus5 years ago
So, the green square is something I make in real life and put in the camera shot?
Yeah, that's one example. You can also track other items in the scene as well. You can probably get away with a white rock or a stick (which would work for that whale). After Effects is likely the software you want for lots of fun stuff.
Pro

Get More Out of Instructables

Already have an Account?

close

PDF Downloads
As a Pro member, you will gain access to download any Instructable in the PDF format. You also have the ability to customize your PDF download.

Upgrade to Pro today!