Introduction: How to Enter the Ghetto Matrix (DIY Bullet Time)
Peep the vid at the resolution of the proletariat (below):
Or see how the higher-res live here.
Before we even get started I'd like to throw out some shout outs to PIPS:lab, Pikapika and Picasso/Man Ray for their inspiration on this project. Humbly, all the GRL did was create a tool that would enable the director Dan Melamid to remake the Matrix with Neo as a rapper from Yonkers, NY surrounded by the best graf writers in the city using a mash-up of several existing light-drawing techniques and their own hand-styles.
This project started for us when Dan called and asked if we wanted to get involved in a project combining light, graffiti, bullet time, Brooklyn, and rappers on a small budget to create a video for Styles P's the Hardest. Dan explained that to rent a bullet time or time slicing rig in NYC, it could cost as much as $100,000 per day. Luckily for him graffiti writers and graffiti engineers work for coffee and snickers bars. So we all worked together to make a system that only costs $5000-$8000 and takes just two days to make.
For photos of the video shoot travel here.
Big thanks to Dan for inviting us in and allowing us to open source the process in this tutorial.
(More thanks, credits, and shout outs in Step 14... )
The GRL is a F.A.T. Lab Production.
Now let's jack into the Ghetto Matrix...
Step 1: Tools & Materials
The Ghetto Matrix can be divided into two main components: 1) the camera rig, and 2) camera control box.
Tools For Camera Rig:
- Jig saw
- Drill
- Crescent wrench
Materials for Camera Rig:
- (24) Digital Cameras w/ remote cable shutter control:
Olympus SP-510 UZ - $299.99 / each or less
This is not the only camera that will work and 24 is not a magic number. This is the camera that worked best for us and 24 is how many cameras we could afford on our budget. If you have more cameras you can make a larger matrix and you can place the cameras closer together. This will result in a more fluid animation covering a larger area. The most important thing you will need to check before purchasing thousands of dollars worth of cameras is that they have a remote cable shutter release. If you want to create the light effect like we did in the video, you will also need a camera that has a has a bulb setting (meaning that when the shutter is pressed it stays open until it is released). This enables you to hold the shutter open to make light drawings.
- 1/2" - 3/4" Plywood:
This will be used to create a wooden platform for the cameras. The amount of wood to complete the arc will depend on the radius of the desired system (see Step 2). Most likely (2) 8' x 4' sheets will suffice. You can find plywood at your local lumber yard and it should cost less than $40 dollars for two lower grade pieces of plywood. It aint gotta be pretty.
- (4) Compact Light Stand:
$ 53.50 / each.
We had these on hand so we used them and they worked well. Any tripod system will work however, so if you are looking to save money there are cheaper alternatives.
- (4) Steel Pipe Flange:
Make sure to get a flange with threading capable of accommodating a short pipe section (mentioned below) and at least four-hole mounting pattern. You can get this at home depot or your local hardware store in the plumbing section for ~ $3 dollars.
- (4) Steel ~2in long and ~1in O.D. Pipe Sections (threaded at atleat one end)
This Pipe section should be able to crew into the pipe flange (above). You will insert the top of the tripod stand into this pipe section to support the platform. You may need to modify the pipe section by drilling a hole into the side of the pipe opposite the thread and tap it. You can use a thumbscrew to act as a set screw on the tripod stand to make a more secure connection. You can get threaded pipe at your local hardware store or home depot for about $2 dollars.
- (24) Bolts - 1" Length, 1/4" diameter, 20 thread-count:
Most 35mm camera bodies accept a 1/4" diameter, 20 thread-count screw, but check this before going to the hardware store. These will be used to attach your camera to the wooden platform. A perhaps better alternative to bolts (which don't allow you to accurately adjust the cameras pan or tilt) would be some heavy duty velcro. This connection is strictly for stabilization purposes so it doesn't need to be anything fancy or industrial. A more flexible, but expensive way to do this is use the swivel on an exiting tripod. This will let you fully (though possibly not accurately) adjust the pan, tilt and yaw of the camera. These bolts are commonly available at your local hardware store and cost about ~$3 - $4 dollars for a box of 100.
Tools for Control Box:
- Soldering iron w/ flux and solder
- wire cutters / strippers
- Phillips head screw driver
- needle nose pliers
- drill with drill bits
- wire ties
- wire anchors
- liquid flux
Most of these tools can be found at your local hardware store or radio shack or have been sourced via online catalog companies.
Materials for Control Box:
I have linked to Radio Shack component because of their omnipresence, but you can beat Radio Shack prices at Digikey, Jameco, etc.
- (3) Spools of Stranded, Insulated, 26-22 AWG Wire - $5.99
- (24) Remote Cable Release (RM-UC1) - $56.99 / each (You will need one of these per camera)
- (1) Project Enclosure (8x6x3") - $6.99
- (25) SPST High-Current Mini Toggle Switch - $2.99 each (single pull single throw will work fine)
- (1) Universal Component PC Board - $3.49
- (4) 6-Position European-Style Terminal Strip - $2.89 / each
Step 2: Dimension
The shape of the arc you will need to cut depends on the kind of shot and the amount of rotation around the subject you wish to achieve. As mentioned in Step 1, our plan was to create a 180 degree rotation around a subject that will be in the frame primarily from the waist up. Keep in mind when deciding on the amount of rotation you desire that at some point, some of your camera cameras will be able to see your rig in the shot (at 180 degrees for example the two end cameras will be faced directly at each other). There are ways to minimize and mask this but it is worth considering when designing your platform.
Because the focal length of camera lenses will vary it is best not cut your rig to specific pre-scripted dimensions but rather test on your cameras to find the desired shot. Have a subject stand at a distance from one of your cameras (make sure the camera is zoomed all the way out). When you have the desired framing in the lens then measure the distance of the camera to the subject. This will be the radius of your camera arc. Keep in mind that you are not limited to an arc and if you have rigging material more flexible then wood you could even reshape the rig to fit the needs of a specific shoot (see the real matrix for demonstration). We went with wood because it was cheap, fast to build, and readily available.
The radius we chose was roughly 5'. To draw the arc we took a 2x4 and drilled a hole in each end. Put sheets of plywood large enough to accommodate your rig down on the floor. In one end of the 2x4 put a pen and anchor the other end temporarily at the center point of the arc. Swing the arm around and draw a nice arc on the plywood (there are probably easier ways to do this involving wire or string). Once you have an arc drawn on the plywood get your cameras and space them evenly around the perimeter. Turn them on and see what it looks like. Put an object in the center of the cameras and adjust them so that they are all centered on the same object. Take a test shot on all the cameras. Make sure you are happy with the range of motion between frames and the proportions and position of the subject to the frame. This is one of the most important elements in getting a good shot in the end and it is one that is hard to adjust once you get the jig saw out, so get it right.
Initially, we made a smaller matrix rig, used velcro to mount the camera and had a session of shots to test the size and spacing. Afterward, we decided to expand the size of the matrix and created a larger platform and increased the spacing between the cameras.
Step 3: Cut Wood
Once you have all of the cameras placed and spaced properly trace the camera positions w/ a magic marker directly onto the ply wood. At this point you have all the necessary guidelines drawn that you need to cut the wood. Use the jig saw to cut out the arc. Make the width of the arc deep enough to comfortably mount all of your cameras and equipment. You may need to use two pieces of plywood to create your full arc. You can connect two pieces together by "sandwiching" the two (or three if its big enough) section of the arc between two pieces of plywood and securing them with large industrial clamps. Ours was roughly 9" deep. Be careful not so set the cameras so far back that the edge of the wood shows up in the bottom of the frame.
Step 4: Drill Holes
There are numerous ways to secure a camera to wooden surface, we used bolts. Based on the outlines you traced from the camera position, drill a hole in the location of the cameras tripod mount connection matching the width of the connection (typically 1/4"). Drill one for each camera. This is not the most accurate method for aligning the cameras, but its close enough for rap.
Step 5: Stand Connections
You will need to come up with a system for elevating your ghetto matrix off the ground. This could be done in many ways (including chairs, saw horses, stolen police barricades, etc), although keep in mind that you are dealing with a rather odd shape (one that is not quite as simple as a table top). Because we were looking for something that would be easy to transport between sets and something that would be fast and easy to adjust height and tilt we ended up using (4) compact light stands.
To connect these stands to our wooden arc we needed to buy 4 pipe flanges and 4 short pipe sections that where threaded on one end and were the right diameter and pitch to screw into the pipe flanges and also to accommodate the top tubular portion of our light stands. The spacing on these legs is not as important as the spacing of the cameras, so when you are deciding where to mount your flanges to the bottom side of the arc make sure that they are not interfering w/ the locations you plan to put the camera bolts. We had to drill and tap the pipe section (on the end opposite the thread) so we could use a set screw (a thumbscrew actually) to preload into the portion of the light stand that fits inside the pipe section. This allowed us to make a more secure connection between the platform and the light stands. Here is a drill and tap chart that will help you decide what size drill to use in order to create a nice tap.
(see the photo notes for more details on how to do this. Its dumb simple and easy to pictorially depict)
Once you are ready, you can drill your mounting holes and screw the flanges into place. Screw in your pipe section
Step 6: Shutter Cable Hack
The next step is control. We need to be able to fire all the cameras at the same time and control each one individually. Luckily, the Olympus SP-510 UZ was chosen in part because it has an optional external shutter release cable that allows you to trigger the shutter, hold it open and close it all through the USB port. But to make this cable work in the matrix you need to:
1. hack the cable
2. extend the length of the cable
To Hack the Cable:
Open the the plastic casing on the remote cable release with a small phillips screwdriver. You will see three spring steel metal "fingers" stacked above one another with a small offset between each one. These fingers are conductive. Each finger has a single conductor connected to it. When you presh the button a plastic feature applies a pre-load on the spring fingers, which in turn bend to touch one another in series; First the top finger touches the middle, then the middle and top fingers both make a connection with the lowest finger. This action corresponds to three states of action in the camera: (1)Open circuit -- when the fingers are not touching, the camera is asleep (or awake if you recently took a photo, but the camera is inactive); (2) Half-trigger -- when you partially depress the button, the top finger touches the middle one and triggers the half-release mode; (this allows you to trigger auto-focus or wake the cameras from sleep without taking a photo) and (3) when you fully depress the switch you open the shutter and begin taking a flick. When you release the button the shutter closes and the camera is ready for another photo.
so this means:
- The top conductor is the half-trigger control wire.
- the middle conductor is power (a multimeter confirms).
- The bottom conductor is full-trigger control wire (i.e. take a photo dog!).
Now label those conductors and cut cut em. You can toss the plastic housing right in the landfill. Don't cut the small usb connector on the opposite end of the cable. We need that.
For our purposes we can connect the half-trigger and the full-trigger release leads together.
We will control the camera by "pulling up" the half/full trigger wire(s) to the power bus (which is 5VDC provided by the USB port of the camera).
You can still use the half-trigger function by quickly closing and opening the circuit from the control box. There is a ~1 second lag between flipping a switch on the control box and the actual triggering of the camera.
(see drawing below for more detail on the inside of the cable release housing.)
Extend the Cable:
I used a 24 AWG twisted pair of stranded conductors in a single insulated cable for each camera.
To solder this together I used:
- a Weller soldering irona
- wire stripper
- wire cutter
- pliers
- solder
- liquid flux
- shrink tube
- electrical tape
- wire ties
These parts all commonly available in a hardware store or a radio shack (see materials list in step 1 for links).
This next part of a pain in the ass (cuz the insulation on most consumer equipment is cheap and not heat resistant and the conductor are typically small):
1. strip the half trigger and full trigger leads
2. twist the the half trigger and full trigger conductors together, flux and solder them.
3. solder the half/full trigger bundle to the one of the twisted conductors.
4. strip, tin and solder the power lead to the other twisted conductor in the cable
5. Use shrink tube and tape to add strain release on both wires. Use wire ties to create a "service loop" for strain release.
6. cut back the cable insulation and expose the two conductors on the opposite side of the cable. You can strip the wires as they will need to fit into a screw-down terminals.
7. Repeat for N number of cameras. This gets real old real fast.
ON the other end of the cable you will have two leads: camera control (thats the half/full trigger bundle we soldered together) and camera power. I soldered all the camera power leads together in a big solder ball, with a single wire jumper i could plug into the box, the i covered it all with electrical tape. Bad form right, but i had some people breathing over my shoulder. The camera control leads will plug into the control box and the screw-down terminals. Label these cables with tape and a sharpie now and save yourself a little grief.
Step 7: The Control Box
Now to make the brain of the matrix. Its real simple like a dinosaurs brain but needs to be pretty robust if you are going to take it in the field.
The control box will have a grid of switches, one for each camera. It will also have 1 master switch to rule them all. In most scenarios you will have the individual camera switches in the on position, and then toggle the master switch on and off to take photos. Putting a switch on each camera makes it easier to debugging problems and can be used in a number of new ways to create content.... and it makes your control box look really... intense. In addition to the switches, the control box will need two kinds of terminals that will allow you to quickly plug in the camera cables.
To make the box you will need:
- a drill
- a soldering iron
- solder
- liquid flux
- (25) SPST switches
- (2) power terminals
- (4) 6 channel screw down terminal blocks
- a large plastic enclosure
- stranded wire 24 AWG
- wire ties
- wire anchors
- tape
These parts can be found in your local hardware store or radio shack. See Materials List in Step 1 for links to parts.
( see the scan of a hand-drawn [.:.:.] schematic for the detailed circuit and control logic table in the images below)
Step 1:
Drill all of the holes needed in the box to mount the switches. We used 4 rows of 6 switches on the top face of the enclosure, and one master on the front side. We mounted two 6 channel terminal blocks on each side of the box (for a total of 24). To feed the connections from the terminal blocks to the switches we drilled 12 small holes on each side of the box. Finally we drilled two large holes on the side of the box for the power terminals.
Step 2:
Mount the switches using the mounting hardware they come with, including the master switch. Use the washer they provide with the switch and drill a very small hole to utilize the small tab on the washer. This will keep the orientation of the switch consistent so you know what's up from down.
Step 3:
Mount 2 terminals on each side of the enclosure, using the self-tapping screws provided. You can screw them directly into the plastic. Drill a small hole above each terminal for you to pass conductor inside the enclosure.
Step 4:
Solder a stranded wire to one contact on each SPST switch, then feed the other end of the wire through the corresponding hole leading to the terminal blocks. Cut the wire to length, strip it and screw it into each channel of the screw down terminal blocks on the side of the enclosure (See photo below).
Step 5:
Solder a stranded wire to other contact on each SPST switch, then solder the other end of the wire to a single continuous bus (camera control bus) on the component or perf board. You are connecting all the of the control cables from the camera together.
Step 6:
Solder a wire on one contact of the master switch. The other end of this wire can be connected to the camera control bus on the perf board. Solder 2 wires to the other contact on the SPST and the solder (or attach via terminals) the wires to both of the two power terminals on each side of the enclosure. You can mount you perf board on the lid of the enclosure or just cram it into the box. You already know which one we did.
Step 7:
At this point your brains should be online and ready to go. Label the terminals and each switch with a label maker, tape + a sharpee or a paint pen.
Step 8: Setting Up the Rig
At this point it's just a matter of setting it all up. Once you have a location picked out just screw the light stands into the platform. Screw down the cameras. A level is helpful in order to get the entire system even, however, in the end as long as it looks good through the view finders you are ok. Repeat the same steps you used when first positioning the cameras: put a person or object at the position where the action will be taking place, and adjust the pan and height of the cameras as needed.
Look through the cameras at the end of the arc and determine how much of the rig is visible in the frame. To avoid seeing the actual rig in the shot cut a black sheet that will cover the rig from the top to the floor. Tape the sheet to the rig and pull it over the cameras letting it hang down to the floor. Cut holes for every camera you intend to cover and pull the lenses through. Make sure you are not covering any auto-focusing elements of the cameras if you plan to use auto-focus (See photos below).
Step 9: Connecting All the Cameras
Make sure the cameras are loaded up with empty SD cards and if possible manually set the camera to start numbering files from 0. This will help tremendously in the editing process when you are trying to piece all the footage back together.
Check the settings on the cameras to ensure that they are all powered on, set to bulb, w/ no zoom, and all have the same settings (eg. ISO, exposure, etc.). Plug in all of the remote cable releases into the corresponding cameras via the usb connector and attach the camera release cables to the control box. First connect the camera control conductor from each cable to the corresponding screw-down terminal. Make sure when you are making the cables to use a label maker or tape and a sharpee to label each cable and the screw-down terminal blocks if you intend to trigger each camera separately. Next attach the power bundle from all the release cables to the power connector on the control box. Test the system by quickly triggering all the cameras to wake them up and take a photo with each camera individually to make sure they are connected in order and properly functioning. Check each camera to make sure it is in the correct mode and has the proper bulb and lighting settings.
Step 10: Pick Your Spot!
Don't be chained to your studio. Go outside and play. One advantage of the Ghetto Matrix is that it is portable and quick to set up. We were able to sneak the entire system through holes in fences and onto government property to do entire shoots in less then an hour without anybody knowing. Take advantage of this portability to find interesting and new locations. If you didn't climb a fence you didn't do an honest days work. This is something the Non-Ghetto Matrix can't do, so exploit it. If you plan to create light drawings you need to find a spot with low ambient light.
Step 11: Ghetto Matrix Operations Quick-Start Guide
Because we were experimenting with open shutter photography ambient lighting was kept to a minimum. Operationally, we used the camera as follows:
Step 1:
Get everything set in place (eg. subject is on the mark, camera trigger person is ready, and graf writers are standing by with light writing implements).
Step 2:
Turn off all of the lights so that it is as close to pitch black as possible. The person on the Ghettro Matrix control box gives a count down to zero and then opens the master switch so that the shutters on all of the cameras open.
Step 3:
The subject (aka person on film you want to see) stands very still in the dark as the people doing the light writing draw imagery and trace the subject using anything ranging from LED Throwies to flashlights.
NOTE: LED Throwie Mod #374
Most of the writing done in our shoot was done with a modified LED Throwie. Make a Throwie and leave one of the LED legs loose (by putting tape underneath the leg creating an offset, but leaving an exposed area on the battery contact surface under the raised LED leg) so that when pinched the LED turns on. You can easily craft something that works using electrical tape. This allows the graffiti writers to quickly and easily turn the LED on and off when writing.
Step 4:
Once the graffiti writers have completed writing they quickly exit the frame and yell "we out hackers".
Step 5:
Before the camera shutters are closed the subject is hit with a single flash from a strobe or camera flash, exposing the subject. If you want to emphasize the light writing instead of the people then minimize or skip the flash all together.
Step 6:
Flip the switch on the control box closing all of the camera shutters. The entire process from Step 2 to Step 6 should only take about 5 - 20 seconds (depending on the amount of ambient light and desired result).
Step 7:
Look at camera display of resulting shot. Based on the preview image you should be able to adjust the writing, exposure time, subject position, and lighting quickly and re-shoot.
Step 8:
Repeat till dope!
Step 12: Act a Fool Son!
You know what to do. Just relax and let nature take its course.
Because we were just shooting photos (and not using memory intensive video) we just keep shooting till the SD cards filled up or the camera batteries ran out. The only reason not to shoot a ton of footage is to save yourself some time in the post production process, but it is always a good rule to shoot more then to shoot less. Experiment with positioning the subject at different distances to the camera rig and with leaving the shutter open for varying amounts of time. It's a good idea to preview all of your shots in the camera view finders as you are shooting so that there are no surprises once you begin editing the footage.
Light drawing is just one way to use the Ghetto Matrix. With the controller you can trigger each camera separately and play around with time lapse in 3D, record live video from all angles, use the flash to catch high-speed 180 action...
By hacking the controller cable and combining it with an A/V out cable and a usb download cable to create a system where you could preview the frame using the A/V out into a monitor (and record it) and/or connect the camera to a computer, what called tethering, so you shoot directly to the hard drive or use an automated script (or existing software) to download the contents from each camera after a photo is taken. In this way the whole process could be automated. I don't know the limitations of multiple camera tethering via USB hubs and could find little info on it, but someone out there in the internetz does. Make it so hacker.
Our next experiments will be in creating a modular rig that can be combined to create different shapes.
Step 13: Post Production
I'm no expert in post production work, so there might be better ways of doing this. Below are the steps I took for combining all the individual frames into an animation:
Step 1:
Dump all of the footage from your cameras SD cards onto your HD. If the frames are all named properly you should be able to easily group them into folders. Be careful not to overwrite files with matching names. Once you have identified which shot you want to animate find all of the images and put them into one folder (renaming files as necessary). You should have one image per camera.
Step 2:
Launch Premiere and start a new project (other video editing programs such as Final Cut Pro will work similarly, we aren't doing anything fancy here). In the end I am going to create a 640 x 480 video, but it is a good idea to work at a slightly higher resolution in order to have some room around the edges of the shot to account for differences in camera angles. Set the width and height of the new project to 800 x 600, 30 fps, square pixels.
Step 3:
Go to Edit -> Preferences -> General. Change the value Still Image Default Duration to 5 frames. This will set every image equal to 5 frames in length upon import.
Step 4:
Go to File -> Import and select all of the images in the sequence.
Step 5:
Drag all of the image from the Project resource list into the timeline. Because the images are still at full resolution we will need to match them to the 800x600 dimensions of our project. Select all of the clips in the timeline. Right click anywhere in the selection and go to Scale To Frame Size.
Step 6:
Reorder all of the images so that they play in the proper order.
Step 7:
No matter how careful you are in setting up all of the cameras chances are that you will still need to do some aligning between frames. Locate an object closest to the center of your shot. In this example I will be aligning based on the position of XP's eyes. In the timeline drag one frame onto a layer above the preceding frame. Set the opacity of the top image to 30%. Zoom in to 100% in the program window and drag the top image until the position of the eyes line up with the image below it. Once it is in place set the opacity back to 100% and move the clip back into place. Repeat this for every frame in the animation.
Step 8:
If you scrub through the animation quickly at this point it should look fairly smooth. When played back at slower speed, however, you will still notice the jumps between frames. To eliminate this go to Video Transitions -> Dissolves -> Cross Dissolve. Drag the Cross Dissolve icon directly in between frame 1 and frame 2. Repeat this for every frame.
Step 9:
Export this sequence at 800 x 600 resolution.
Step 10:
Because we moved around some of the frames in order to align them we are left with some frames containing black edges. To fix this open up a new project and set the width and height dimensions to 640 x 480. Import the 800x600 video and re-position it masking out any sections where the edges are black.
Step 11:
Export this movie and 640x480 and you are done.
To view screen shots and all of the full resolution images in the sequence we used for this example go to:
- http://fffff.at/fuckflickr/index.php?dir=data%2FGHETTO_MATRIX_HOW_2%2F
Step 14: Fin
The potential of this particular system appears to be pretty robust. We done a few other experiments including a game of four-sqaure in the Matrix using live video in the two cameras on the end. Ill try to upload an example... but we've just scratched the surface.
To view an example of the animations created for the video go here:
Or on Vimeo here:
You can see how Dan used this system in the Styles P video on Yo MTV Raps or by clicking [here:http://videos.onsmash.com/v/4jylXUGElxGgycqg here]
So go ahead, take the red pill, use ubuntu, share torrents, contribute your idea to this technology, listen to rap. Hip hop saves lives. Repeat after me: "I got an open spirit hacker period!"
Shout outs from the GRL:
Big ups to Dan, Al and Bob who had the idea for and made most of the rig, 2esae for art directing most of the writing, Donna for shooting a lot of these photographs. Team G.R.L. ->Fi5e, Q-Branch, Borna, Bennett, West Coast Evan, Nate Nasty, Chris H, All City Crew, and especially Large Pro, who besides being hella cool and giving Borna the hat off his head, came back a month later to help raise money for 2esae's legal troubles, Styles P for letting us get involved in his business, Eyebeam for unknowingly allowing us to film portions of the video in the building and Brooklyn for being the original Ghetto Matrix. Free Every Graffiti Writer IN NYC. Peace.
Participated in the
The Instructables Book Contest
