The EyeWriter

Samuel Taylor Coleridge said, "My eyes make pictures, when they are shut."
Well, my friend Tony's eyes write graffiti and they are wide open.

Behold the latest ocular assault weapon from the Graffiti Research Lab, openFrameworks, The Fat Lab and The Ebeling Group: The EyeWriter. It is a low-cost eye-tracking apparatus + custom software that allows graffiti writers and artists with paralysis resulting from Amyotrophic lateral sclerosis to draw using only their eyes.

This instruction set details how to make your own solderless eyetracker for only $50 dollars using a hacked PS3 Eye and a cheap pair of sunglasses.

"Art is a tool of empowerment and social change, and I consider myself blessed to be able to create and and use my work to promote health reform, bring awareness about ALS and help others"
-- Tony Quan, aka Tempt One

For more information on the story behind the EyeWriter, TemptOne and more, check out http://eyewriter.org.

For more info on ALS click here.

For more words directly from Tempt One click here.

Programmers, engineers, ALS patients/family-members, medical professionals and projection artists! If you're interested in becoming part of the EyeWriter development team contact us here.

The EyeWriter Development Team is:

TemptOne
Graffiti Research Lab
openFrameworks
The Ebeling Group
FAT Lab
Zach Lieberman
James Powderly
Evan Roth
Chris Sugrue
Theo Watson
Keith Pasko
LM4K
Eleanor Dunk
Jamie Wilkinson
Greg Leuch

With special thanks to the Not Impossible Foundation and Sven Travis from Parsons Communication, Design + Technology

Step 1 EyeWriter System Requirements

The goal of the hardware component of the EyeWriter project is to make the most simple and inexpensive eye-tracking head-set possible to use with the "EyeWriter" software suite. Obviously, there are numerous ways to make eye-tracking hardware. Many of these designs, especially those produced for academic research projects (Open Eyes), have already been published openly on the internet. There are also commercial products available -- costing in the range of ~$20,000 US or more-- that are specifically designed to enable people with ALS to communicate using their eyes. We are not in the business of re-inventing these systems. This project is an attempt to address a gap in the development of low-end eyetracking systems, ie to make a super-cheap, eye-tracker that could be made by almost anyone, almost anywhere. Our "EyeWriter" system has several specific design limitations that were meant to emphasize low-cost and ease of construction over other aspects of performance, robustness and appearance. The specific parts and tools you use to build your own "EyeWriter" will depend on your ability, location, financial resources and creative je ne sais quoi (surely you can do better than us -- we're American thugs), but do allow the following design specification to help you to seamlessly connect your hardware to the EyeWriter software and to explain the ethos of the project.

Our functional design specifications are as follows:

1. The EyeWriter should be as inexpensive as possible
2. The fabrication and assembly of the system should require only common hand tools
3. Whenever possible components and parts should be available for purchase locally versus online
4. The camera should produce 640 x 480 NTSC video
5. The camera should be sensitive to near-field IR light
6. The camera should not auto-iris (or auto-iris should be disabled in the camera's driver).
7. IR LEDs should be used to illuminate the pupil

Beyond that its up to you... this instruction set details a solderless variation of the EyeWriter that uses a hacked PS3 Eye and a pair of stunnas we bought on Venice Beach and suggests other possible EyeWriter configurations.

Comments

[lacebassett]

Thanks guys! Everything worked out great so far. Word to the wise. Make em light. My first version was too heavy to stay on the viewers face.

[ahall3]

Great instructable
Does any one have any ideas on how I would be able to create a science fair project out of this
Thanks

[redwards9]

I downloaded the macam and the eyewriter software and installed it on my macbook pro. Both programs work but I can't figure out how to make the eyewriter use the PS3 cam instead of the built-in cam. Any way to make this work on a macbook pro or any other mac with a built-in cam?

Also were can I download the drawing app and is there a mac version?

[anesteruk]

On mac, all you have to do is this:

mac users need to install the modified maccam component (http://www.openframeworks.cc/files/macam-ps3eye-manualwb-defaultVGA.zip) to /Library/QuickTime to get a good, fixed everything ps3 camera image from their computer (if they are using ps3 eye camera as described in the eyewriter instructables)

should work after you move the compnent file to that directory

[anair8]

redwards9,

Have you figured out how to make the eyewriter use the PS3 cam instead of the built-in cam? I have the same problem and will be grateful if you share the solution (if you have found it!)

[redwards9]

I have not unfortunately. I have tried sending out other emails but no response. If I get it figured out, I'll post it.Please do the same.

Thanks!

[anair8]

redwatds9,

I have since figured this out! (I work with Windows 7. I am sure this will work with Windows XP too)

Do NOT connect your PS3 Camera to the laptop/ PC

Go to Control Panel->System->Device Manager

You will see your built-in camera listed here under Imaging Devices. (Mine was Sony Visual Communications Camera). Right click on this and select "Disable".

With the Device Manager open, plug your PS3 Camera to the USB Port

You will see that as you plug on the PS3 Camera, a new device gets displayed as a new device. (In my case this came listed as "PS3 Eye Camera" under a new group named "CodeLabs DeVices". If You don't see this, try unplugging/ plugging on the camera).

To calibrate the PS3 Camera, I used the software temptTracker tracker that I downloaded and extracted in the folder temptTracker_020_cb. Hope you too have downloaded this.

Go to temptTracker_020_cb->bin->data->settings. Open the file xml file inputSettings using NotePad. In this file there is a line to specify the DeviceId (Between angular brackets with DeviceId and /DeviceId)

I had to try different device IDs in the line 0. (In my case 2 worked!). Thus this line was changed to 2. After each trial with a new device number, save the file in NotePad.

With the DeviceId as 2 I got the eyewriter to detect and use the PS3 cam! For this, I executed the Application "temptTracker" found in the Bin folder.

Hope this works for you too!

Anand Nair

[redwards9]

Thanks! I am trying to get this to work on my Macbook Pro but the person who needs to has a PC too I believe. I'll have to borrow a PC and follow your instructions.

Thanks again for the reply!!

Robert

[anesteruk]

Can you please post a combined version of the program for this version of the eyewriter project? I have the tracking software working with the ps3 cam, but cannot figure out how to use the drawing app with the camera. You said you would post the combined version, but I can't find it anywhere! Thanks!

[mconway1]

I was listening to a podcast , Brain food Dude, which take the best from all the pod casts each week and plays segments. That is were I heard about the EyeWriter. I cried at the end of the segment. My Best friend cared for her Mother in Law while she slowly lost her battle with ALS. My brother had MS and My Husband who used to be an amazing artist, lost the use of his dominant hand to a drunk driver. I constantly have ideas for things that would make his life easier, but I never take action.....the final thought the speaker had for the audience was "If not now, then when. If not you, then who."
What you are doing here is so remarkable, I can not even find the words to express enough. You are inspiring. You are giving quality to life. You are creating freedom. This is the American Dream...Life, Liberty, and the pursuit of Happiness. That may sound corny, but if you have ever lost any of these, lets just say you appreciate what you do have so much more. THANK YOU

[pstone2]

so did you end up making one of these or did you need help making one?

[insmac]

Great to see the work that Bob Wasburn and I did in the 1970's being continued and updated.

We used an ir diode, ir sensor on the glasses, and a Sinclair ZX-81 to allow an ALS patient to communicate with friends and family.

Keep up the cool work!

Mac

[imonsei]

This is seriously awesome.

it's things like this that makes me think that humanity has a chance after all :)

on the other hand tho... it will enable people to even more lazy now :D
wonder if you can do anything like that with a wiimote... hmmmmz ;)

[freakyqwerty]

It depends on what wavelength of IR LED you are using. Near infrared (800 nm to 1400 nm) is projected on to the retena which means if it is powerful it will burn your retina but infra red over 1400 nm will be blocked by the cornea, which has pain sensors so you will know.

_____

Bottom line; If you get an IR LED that is powerful enough it will damage your eyes.



http://www.ehow.com/facts_6142267_infrared-light-effect-eyes.html

[MacGyver1138]

I don't know that the Wiimote could be used to do eye tracking, but it could pretty easily be rigged up for someone who could move their head. 

This project is awesome, and it's cool that it is inexpensive.  Now I want to see if anyone can improve on those "brain toys" that let you control a fan by thinking.  If they can be made to interpret more specific commands, they could be used in a similar manner to this project.

[BlueFusion]

 Check out the OCZ nia - it's marketed as a gaming peripheral, but it's capable of so much more.

[dawgz031]

wow...this is really great.....

but im just wondering would ir damage your eyes???

[freakyqwerty]

It depends on what wavelength of IR LED you are using. Near infrared (800 nm to 1400 nm) is projected on to the retena which means if it is powerful it will burn your retina but infra red over 1400 nm will be blocked by the cornea, which has pain sensors so you will know.
_____
Bottom line; If you get an IR LED that is powerful enough it will damage your eyes.

http://www.ehow.com/facts_6142267_infrared-light-effect-eyes.html

[NastySpill]

This is my concern as well. I have asked a friend of mine whos an optomologist or opthomologist  - she works with eyes.. I'll post her answer here, when I find out.

[Bad Maxx]

It is always good to be safe and your concern is appreciated, However this has been addressed thoroughly in previous posts.

[pstone2]

Hey,

So I saw your video and was inspired to find someone in my city that is disabled and needs help and is interested in an eyewriter but I'm a bit stuck, help!

So I bought and took my ps3 camera apart and it has a different lens configuration so i couldn't take out the infra-red filter as it is stuck to the new style chunkier piece of glass..instead i accidentally damaged the lens.

I also ordered the lens set you mentioned on instructables from dealextreme (with the 8mm lens) .. but wasnt able to pry the other lens from the lens holder to insert the new 8mm lens onto the existing one. i assume the dealextreme ones dont have infra red filters?

My questions are these:

the lens holders are expensive from australia.. shipping alone is $20! so im hoping for a cheaper alternative.. the shipping on the $6 lenses is $50 to here too. Is it possible to attach the 8mm lens without a lens holder... perhaps just with some blutack or gaffa tape or a piece of plastic holding it on?

Do I need to use part of the original lens system from the ps3 eye or is the dealextreme lens part all I need?

does it need to be a certain distance away from the circuit board? does it focus somehow?


if I was to use a different webcam, what specs does it need to have to work properly with your system?

Cheers

Paul

[jtmax24]

Wow, love this project. Question though if someone had Amblyopia, or "lazy eye," would that still work? Curious because if you using the one eye to draw with the other eye would have to be looking at the screen. I'm not for sure how this would work if someone had "lazy eye," like me. I have almost perfect vision in one eye with the other eye well seeing the same thing just not as well. Usually effecting close perceptive of objects coming at me. (ex. a ball being thrown at me or watching 3D movies).

Anyways, it's a thought for another project anyways. :) I still love this project.

[slappysquirrel]

brilliant!

[cheesehandy]

wow! I love this

[plasterhappygfunk]

This is amazing!

[projectbronco]

This is a perfect example of what Instructables should be about. Projects that help people, ideas that enable ideas, and keys that unlock doors for a brighter future for those whose present may be be slightly darker.

Great job guys!

[killerwalrux]

Dude, you stole the words outta my mouth. I completely agree. I'm so happy to see people using the internet to make people lives better. Instead of wasting countless hours on flippin youtube begging people to subscribe. Same same to you guys! change the world, one life at a time.

[whiteboyninja]

That's awsome! I do have a few questions though.
1) Can it work on a mac?
2) Is there any way you can use it as a computer mouse?
3) Can it work with the ps2 Eyetoy?

[Roceifin]

i dont draw with my eyes!! i draw with my hands!! i meen i dont use my eyes brain to draw i use my hands brain....hard to wrap your brain into but idont look at what im drawing when i draw and i am very skilled.....

[lovemachinesix]

Ugh. Amazing story and then dudes like you come around. There's a world out there son, take a look at it, join in, you might learn something.

[sisar]

Not everything is about you Roceifin!!! this is a technology for those who are impaired or those who have motor disabilites.

~ We have a "be nice" comment policy. Please be positive and constructive with your comments or risk being banned from our site.

[Roceifin]

YES I KNOW THATS FOR IMPARED PEOPLE...caps damnit....but still if you are mobile impared then thats sad but people are still going to use this weather there impared or not....i am impared but i still would rather use my hands....15 of my friends agreed that if you were able to draw, etc. then you would rather use your hands....and details are not as accurate probly as you useing your hands, maybe its easy er to do but not better

[uberdum05]

ITS JUST SOMETHING FUN AND USEFUL TO HAVE A PLAY ABOUT WITH AND ONE DAY, IT MIGHT JUST HELP YOU!!!!!!!

[Azayles]

Congrats on the Sparkfun feature :D
http://www.sparkfun.com/news/540

[Luziviech]

you guys rock. Graffiti Research Lab's Powerthief (and themselves) is yet one of my faves, but this one is a real blast.

[Opcom]

This is one of the coolest and useful projects I've seen so far.

[cooldudeintown]

Dam look at him go. I cant use gimp , photoshop hell even mspaint that fast.
Looks like it could be hard to learn but looks worth it for speed . 

wow look at him go.

[stengah]

Amizing guys - Ppl like you are actually making to world a much better place. Great this has been open sourced too.

Hopefully this can inspire and help people all around the world to help others and communicate visions - in spite of all odds.

Spread the word - blog it - mail it - I know I will!

Thanks for doing what you do!

[macmaniac]

I was surprised and pleased to see the EyeWriter on display at the BRIT Insurance awards exhibition in the Design Museum, London :D

[G-pod]

Rock on guys
gr8 inovation
go opensource