The Carnegie Mellon HCI gang is at it again, this time taking on the serious assignment of making a thing for PLAY. The Royal Play that is. The thing that makes life worth living.

This time, we've combined our nerd-ness to bring some of your favorite movie sound effects to life. The " Augmented Hyper-Reality Glove" uses flex and tilt sensors to send signals to a Wave Shield from Adafruit Industries. The Wave Shield lets you trigger uncompressed sound files directly with Arduino, eliminating the need to call files from your computer.

When you punch with the glove you get a "punch" sound, when you make a pistol shape, a "gunfire" sound, etc. The possibilities are limited only to your imagination, and your world will be augmented by the sounds you normally only hear in your head or make yourself (legitimizing those embarrassing moments when other people hear you doing it).

Team: Becca Chen, Zack Jacobson-Weaver, Jimmy Krahe & Spencer Sugarman from Activating Objects with Eric Paulos and developed at CodeLab.

Let's get started...

Step 1: What You'll Need

Tools: Soldering Equipment, Wire Cutters, Scissors, Needle and Thread, Arduino board (here's a link for everything you need to use it), Lady Ada Wave Shield for Arduino, Solderless Breadboard, Hot Glue Gun, SD Card Formatter with one SD Card, your favorite Mac or PC.

Materials: One Glove, Solder (and some skills, the Wave Shield is a marathon soldering session), Conductive Thread, Electrical Tape, Anti-Static Sheeting, Regular Sewing Thread and a Needle (and a thimble for you sensitive types), Aluminum or Copper Foil Tape, Electrical Wire ( there are two kinds used here: Solid and Stranded. You'll see why later), Velcro and Velcro Straps, Hot Glue Sticks.
Do you know some material to replace Velostat?
this is awesome guys.
I made these as you described, but they don't seem to work at all :(
And I'm talking about the flexsensors here.
Hmm. Maybe I can help you debug. Something simple is causing a problem. I say this not because I don't believe you. Only because we've used these same sensors at my lab for the past 4 months and if they're made and wired correctly, they're great. Can you tell me how you made them? And how are you reading them? Through Arduino? And how are they wired into the circuit?
Well after a few hours and scouting the internet for other methods, I got some working. However, I ended up not using the anti-static bags at all - I think it is because none of mine are actually conductive. I used conductive foam that ICs get jammed into during transport. I also found that electrical tape does not hold it together well enough and there are contact gaps, so I used duct tape. <br>And since I was getting really jumpy readings with conductive thread (I suspect that a single strand can get disconnected at random times), I used multistranded copper wire. <br><br>Sooo I guess I kind of changed everything, but thanks anyways!
Awesome. That's the spirit. What are you making?
Also a glove, but planning to control my robot with it. Kind of feel like pretending I have superpowers or something by waving my hands around and making gestures :D I'm also planning to add accelerometers to it.
Cool. I'll be watching for it. <br><br>I'm currently setting up a processing program to control the screen with invisible forces (or photo resistor values). Superpowers, indeed.<br><br>Good luck.
could you hook this up to a USB cable, and use this on a video-game?
You could! It would be a fairly complex hack but (I'm guessing here) you could probably:<br><br>Break down your video game controller and literally find out, of all the wires going from the controller to the console, (this is assuming you're using a wired controller. Do they even make those anymore?) which one is assigned to what button, lever motion, tilt etc. You would have to do this by providing power to the controller and grounding it as well. It would be akin to measuring analog input on Arduino. <br><br>If you look at my only other Instructable, you can see how we used analog input to turn stuff on and off. That's also what the glove does. That also what a WIRED video game controller does. Otherwise it is a digital input which, for most purposes, works (outputs) the same way.<br><br>Then comes the real challenge. You have to &quot;map&quot; the output of the glove to the output of the controller. So, for instance, lets say you have a &quot;B&quot; button on your controller. You could hard wire your index finger to the B wire of the controller and it could then send signals (switch on/ switch off) to the game console. Etc, etc. etc.<br><br>What I'm not explaining here is exactly what it means to sort out these wires, power them, and &quot;map&quot; one controller (the one that came with your game system) to a new controller (like the glove). For me that would be tricky.<br><br>But can it be done? I say, anything CAN be done!<br><br>To quote Ra's al Ghul, Batman's Ninja coach, &quot;You're training is nothing! You're WILL is everything!&quot;<br><br>
Kind of looks like the gunslinger from tf2.<br>http://wiki.teamfortress.com/wiki/Gunslinger
Hi. Cool project :D (even if extremly nerdy :P)<br>I would like to build some of these flexsensors for another project, What kind of output do these give? How precise are they?
They give an analogue input which will Serial.read a resistance value. It actually depends on the individual piece. We've seen ranges from 0-300 or even 0-700.<br><br>These also work as pressure sensors so try it both ways.<br><br>Cheers,
You should consider redoing this with a smaller protoboard, maybe like one of these commercial products Sparkfun sells:<br><br>https://www.sparkfun.com/products/9102<br>https://www.sparkfun.com/products/9101<br><br>They are circular LilyPad protoboards.<br><br>and use conductive thread to tie the sensors into the wave shield.
Agreed. This is first prototype level. The full documentation comes as the hybrid offspring of LOVE FOR OPEN SOURCE(yay!) + CLASS REQUIREMENT(booo). So in a given time frame we struggle to get a working prototype coupled with the academic baggage (which is obviously truly good).<br><br>Regardless, you're point is well-taken. Clean it up! <br><br>Thank you for the ideas and links.
Great project! What are the total costs of the components in this project?
Hard to say as some of the stuff was repurposed from other worlds. To guestimate (I have now become my father) I would say,<br><br>Glove: free - $35 (any glove would work)<br>Wave Shield $25+/-<br>Flex Sensors $10<br>Arduino and Other Electronics $30 (???)<br>Misc $10<br><br>It realistically costs $100 plus assuming you have nothing to start with. Now that you ask, I see that's pretty high.<br><br>The price point on a commercial product should be less than $35 a PAIR!<br><br>You also don't need gloves that cost $35. Ours did, but it's a high quality (Youngstown) glove that kinda looks cool to start with.<br><br>There are lots of places, I suppose, to trim the fat.<br>
Dude, its awesome!
Please enjoy the new Promo Video from Jimmy &quot;Scorsese&quot; Krahe!
Wow this is very cool... I will definitely have to see about trying to build this.
Cool - is there a video of it in action?<br><br>(You know, even it hadn't worked, this still looks <em>way</em> cool!)
Done and done, Kiteman. We didn't have all the bugs worked out as you'll see in the video (step 8). I'm sure your's will be better!
That's great - love the smile as well.
Yes! Kiteman, we do have a short video demo and another video promo to post. Unfortunately, YouTube must have a monster backlog so we're waiting for that to upload. I'll let you know when it's up.<br>Cheers,

About This Instructable



More by ZJ-Weaver:Augmented Hyper-Reality Glove The Idiot Proof Dishwasher 
Add instructable to: