The EyeWriter

Samuel Taylor Coleridge said, "My eyes make pictures, when they are shut."
Well, my friend Tony's eyes write graffiti and they are wide open.

Behold the latest ocular assault weapon from the Graffiti Research Lab, openFrameworks, The Fat Lab and The Ebeling Group: The EyeWriter. It is a low-cost eye-tracking apparatus + custom software that allows graffiti writers and artists with paralysis resulting from Amyotrophic lateral sclerosis to draw using only their eyes.

This instruction set details how to make your own solderless eyetracker for only $50 dollars using a hacked PS3 Eye and a cheap pair of sunglasses.

"Art is a tool of empowerment and social change, and I consider myself blessed to be able to create and and use my work to promote health reform, bring awareness about ALS and help others"
-- Tony Quan, aka Tempt One

For more information on the story behind the EyeWriter, TemptOne and more, check out http://eyewriter.org.

For more info on ALS click here.

For more words directly from Tempt One click here.

Programmers, engineers, ALS patients/family-members, medical professionals and projection artists! If you're interested in becoming part of the EyeWriter development team contact us here.

The EyeWriter Development Team is:

TemptOne
Graffiti Research Lab
openFrameworks
The Ebeling Group
FAT Lab
Zach Lieberman
James Powderly
Evan Roth
Chris Sugrue
Theo Watson
Keith Pasko
LM4K
Eleanor Dunk
Jamie Wilkinson
Greg Leuch

With special thanks to the Not Impossible Foundation and Sven Travis from Parsons Communication, Design + Technology

Step 1: EyeWriter System Requirements

The goal of the hardware component of the EyeWriter project is to make the most simple and inexpensive eye-tracking head-set possible to use with the "EyeWriter" software suite. Obviously, there are numerous ways to make eye-tracking hardware. Many of these designs, especially those produced for academic research projects (Open Eyes), have already been published openly on the internet. There are also commercial products available -- costing in the range of ~$20,000 US or more-- that are specifically designed to enable people with ALS to communicate using their eyes. We are not in the business of re-inventing these systems. This project is an attempt to address a gap in the development of low-end eyetracking systems, ie to make a super-cheap, eye-tracker that could be made by almost anyone, almost anywhere. Our "EyeWriter" system has several specific design limitations that were meant to emphasize low-cost and ease of construction over other aspects of performance, robustness and appearance. The specific parts and tools you use to build your own "EyeWriter" will depend on your ability, location, financial resources and creative je ne sais quoi (surely you can do better than us -- we're American thugs), but do allow the following design specification to help you to seamlessly connect your hardware to the EyeWriter software and to explain the ethos of the project.

Our functional design specifications are as follows:

1. The EyeWriter should be as inexpensive as possible
2. The fabrication and assembly of the system should require only common hand tools
3. Whenever possible components and parts should be available for purchase locally versus online
4. The camera should produce 640 x 480 NTSC video
5. The camera should be sensitive to near-field IR light
6. The camera should not auto-iris (or auto-iris should be disabled in the camera's driver).
7. IR LEDs should be used to illuminate the pupil

Beyond that its up to you... this instruction set details a solderless variation of the EyeWriter that uses a hacked PS3 Eye and a pair of stunnas we bought on Venice Beach and suggests other possible EyeWriter configurations.

Comments

[qquuiinn]

why is it that most cool hackable things come from game consoles? wiimote, SNES controller, PS2 joysticks, PS3 eye, nun chuck, etc

[ReneediCherri]

This is awesome! As an artist, stories like this really hit hard.

[trasancos]

From the research I've done so far, IR-Leds come with many different Radiant Intensity and Angles at the 875nm range, some of which can damage the eye. Any help would be appreciated.

[Mandotron]

What wavelength IR is safe to use?

[Mandotron]

Hi Guys, im really struggling to get the lens - M12x0.5 15.5 centred.

Does anyone from the UK know of a supplier? I have found it in USA but postage is $90.

[tuki3]

Does anyone know how to use or run the eye drawing software on windows? i need it now! thanks!

[tuki3]

Does anyone know how to use or run the eye drawing software on windows? i need it now! thanks!

[GEARCLUB]

Hello, Does anyone know how to set the windows input setting so that the PS3 eye camera will work rather than the built-in web-cam. I've disable the web-cam, but it still says in the command promt when running the program that the device ID being used is still "0" and runs the built-in web-cam. Any help with this problem?

[lacebassett]

Thanks guys! Everything worked out great so far. Word to the wise. Make em light. My first version was too heavy to stay on the viewers face.

[ahall3]

Great instructable
Does any one have any ideas on how I would be able to create a science fair project out of this
Thanks

[redwards9]

I downloaded the macam and the eyewriter software and installed it on my macbook pro. Both programs work but I can't figure out how to make the eyewriter use the PS3 cam instead of the built-in cam. Any way to make this work on a macbook pro or any other mac with a built-in cam?

Also were can I download the drawing app and is there a mac version?

[anesteruk]

On mac, all you have to do is this:

mac users need to install the modified maccam component (http://www.openframeworks.cc/files/macam-ps3eye-manualwb-defaultVGA.zip) to /Library/QuickTime to get a good, fixed everything ps3 camera image from their computer (if they are using ps3 eye camera as described in the eyewriter instructables)

should work after you move the compnent file to that directory

[anair8]

redwards9,

Have you figured out how to make the eyewriter use the PS3 cam instead of the built-in cam? I have the same problem and will be grateful if you share the solution (if you have found it!)

[redwards9]

I have not unfortunately. I have tried sending out other emails but no response. If I get it figured out, I'll post it.Please do the same.

Thanks!

[anair8]

redwatds9,

I have since figured this out! (I work with Windows 7. I am sure this will work with Windows XP too)

Do NOT connect your PS3 Camera to the laptop/ PC

Go to Control Panel->System->Device Manager

You will see your built-in camera listed here under Imaging Devices. (Mine was Sony Visual Communications Camera). Right click on this and select "Disable".

With the Device Manager open, plug your PS3 Camera to the USB Port

You will see that as you plug on the PS3 Camera, a new device gets displayed as a new device. (In my case this came listed as "PS3 Eye Camera" under a new group named "CodeLabs DeVices". If You don't see this, try unplugging/ plugging on the camera).

To calibrate the PS3 Camera, I used the software temptTracker tracker that I downloaded and extracted in the folder temptTracker_020_cb. Hope you too have downloaded this.

Go to temptTracker_020_cb->bin->data->settings. Open the file xml file inputSettings using NotePad. In this file there is a line to specify the DeviceId (Between angular brackets with DeviceId and /DeviceId)

I had to try different device IDs in the line 0. (In my case 2 worked!). Thus this line was changed to 2. After each trial with a new device number, save the file in NotePad.

With the DeviceId as 2 I got the eyewriter to detect and use the PS3 cam! For this, I executed the Application "temptTracker" found in the Bin folder.

Hope this works for you too!

Anand Nair

[jbruner1]

Hi, i am very new to the software side of this project.. I have the built the glasses and are fully funtioning. But I have no idea where to start with the software or how to get the app running, I have a PC and have Code::Blocks installed.. Thanks

[dbattsogt]

hey so i followed your instructions and it worked great for temptTracker.exe file but now im having trouble having it work for the Remoteeyetracker.exe file .. that you can download from https://cid-f966c677a7c86219.office.live.com/embedicon.aspx/Remote%20Eye%20Tracker%20Windows ... does anyone know how to make it work?

[redwards9]

Thanks! I am trying to get this to work on my Macbook Pro but the person who needs to has a PC too I believe. I'll have to borrow a PC and follow your instructions.

Thanks again for the reply!!

Robert

[anesteruk]

Can you please post a combined version of the program for this version of the eyewriter project? I have the tracking software working with the ps3 cam, but cannot figure out how to use the drawing app with the camera. You said you would post the combined version, but I can't find it anywhere! Thanks!

[mconway1]

I was listening to a podcast , Brain food Dude, which take the best from all the pod casts each week and plays segments. That is were I heard about the EyeWriter. I cried at the end of the segment. My Best friend cared for her Mother in Law while she slowly lost her battle with ALS. My brother had MS and My Husband who used to be an amazing artist, lost the use of his dominant hand to a drunk driver. I constantly have ideas for things that would make his life easier, but I never take action.....the final thought the speaker had for the audience was "If not now, then when. If not you, then who."
What you are doing here is so remarkable, I can not even find the words to express enough. You are inspiring. You are giving quality to life. You are creating freedom. This is the American Dream...Life, Liberty, and the pursuit of Happiness. That may sound corny, but if you have ever lost any of these, lets just say you appreciate what you do have so much more. THANK YOU

[pstone2]

so did you end up making one of these or did you need help making one?

[insmac]

Great to see the work that Bob Wasburn and I did in the 1970's being continued and updated.

We used an ir diode, ir sensor on the glasses, and a Sinclair ZX-81 to allow an ALS patient to communicate with friends and family.

Keep up the cool work!

Mac

[imonsei]

This is seriously awesome.

it's things like this that makes me think that humanity has a chance after all :)

on the other hand tho... it will enable people to even more lazy now :D
wonder if you can do anything like that with a wiimote... hmmmmz ;)

[freakyqwerty]

It depends on what wavelength of IR LED you are using. Near infrared (800 nm to 1400 nm) is projected on to the retena which means if it is powerful it will burn your retina but infra red over 1400 nm will be blocked by the cornea, which has pain sensors so you will know.

_____

Bottom line; If you get an IR LED that is powerful enough it will damage your eyes.



http://www.ehow.com/facts_6142267_infrared-light-effect-eyes.html

[MacGyver1138]

I don't know that the Wiimote could be used to do eye tracking, but it could pretty easily be rigged up for someone who could move their head. 

This project is awesome, and it's cool that it is inexpensive.  Now I want to see if anyone can improve on those "brain toys" that let you control a fan by thinking.  If they can be made to interpret more specific commands, they could be used in a similar manner to this project.

[BlueFusion]

 Check out the OCZ nia - it's marketed as a gaming peripheral, but it's capable of so much more.

[dawgz031]

wow...this is really great.....

but im just wondering would ir damage your eyes???

[freakyqwerty]

It depends on what wavelength of IR LED you are using. Near infrared (800 nm to 1400 nm) is projected on to the retena which means if it is powerful it will burn your retina but infra red over 1400 nm will be blocked by the cornea, which has pain sensors so you will know.
_____
Bottom line; If you get an IR LED that is powerful enough it will damage your eyes.

http://www.ehow.com/facts_6142267_infrared-light-effect-eyes.html

[NastySpill]

This is my concern as well. I have asked a friend of mine whos an optomologist or opthomologist  - she works with eyes.. I'll post her answer here, when I find out.

[Bad Maxx]

It is always good to be safe and your concern is appreciated, However this has been addressed thoroughly in previous posts.

[pstone2]

Hey,

So I saw your video and was inspired to find someone in my city that is disabled and needs help and is interested in an eyewriter but I'm a bit stuck, help!

So I bought and took my ps3 camera apart and it has a different lens configuration so i couldn't take out the infra-red filter as it is stuck to the new style chunkier piece of glass..instead i accidentally damaged the lens.

I also ordered the lens set you mentioned on instructables from dealextreme (with the 8mm lens) .. but wasnt able to pry the other lens from the lens holder to insert the new 8mm lens onto the existing one. i assume the dealextreme ones dont have infra red filters?

My questions are these:

the lens holders are expensive from australia.. shipping alone is $20! so im hoping for a cheaper alternative.. the shipping on the $6 lenses is $50 to here too. Is it possible to attach the 8mm lens without a lens holder... perhaps just with some blutack or gaffa tape or a piece of plastic holding it on?

Do I need to use part of the original lens system from the ps3 eye or is the dealextreme lens part all I need?

does it need to be a certain distance away from the circuit board? does it focus somehow?


if I was to use a different webcam, what specs does it need to have to work properly with your system?

Cheers

Paul

[jtmax24]

Wow, love this project. Question though if someone had Amblyopia, or "lazy eye," would that still work? Curious because if you using the one eye to draw with the other eye would have to be looking at the screen. I'm not for sure how this would work if someone had "lazy eye," like me. I have almost perfect vision in one eye with the other eye well seeing the same thing just not as well. Usually effecting close perceptive of objects coming at me. (ex. a ball being thrown at me or watching 3D movies).

Anyways, it's a thought for another project anyways. :) I still love this project.

[slappysquirrel]

brilliant!

[cheesehandy]

wow! I love this

[plasterhappygfunk]

This is amazing!

[projectbronco]

This is a perfect example of what Instructables should be about. Projects that help people, ideas that enable ideas, and keys that unlock doors for a brighter future for those whose present may be be slightly darker.

Great job guys!

[killerwalrux]

Dude, you stole the words outta my mouth. I completely agree. I'm so happy to see people using the internet to make people lives better. Instead of wasting countless hours on flippin youtube begging people to subscribe. Same same to you guys! change the world, one life at a time.

[whiteboyninja]

That's awsome! I do have a few questions though.
1) Can it work on a mac?
2) Is there any way you can use it as a computer mouse?
3) Can it work with the ps2 Eyetoy?

[Roceifin]

i dont draw with my eyes!! i draw with my hands!! i meen i dont use my eyes brain to draw i use my hands brain....hard to wrap your brain into but idont look at what im drawing when i draw and i am very skilled.....

[lovemachinesix]

Ugh. Amazing story and then dudes like you come around. There's a world out there son, take a look at it, join in, you might learn something.