Instructables
Picture of The EyeWriter 2.0
IMG_4560.jpg
IMG_4561.jpg
IMG_4520.jpg
IMG_4578.jpg
P1160822.jpg
The EyeWriter is a low-cost eye-tracking apparatus + custom software that allows graffiti writers and artists with paralysis resulting from Amyotrophic Lateral Sclerosis to draw using only their eyes.

The original design, as shown here, featured a pair of glasses as the basis for the eyewriter design:


Since that first video, we've been hacking on and developing the project, and we have a new design, which we've called "eyewriter 2.0" which improves the accuracy of the device, and allow for people who's heads are moving slightly to also use an eye tracker. The original eyewriter, designed for a paralyzed Graffiti artist TEMPT1, is designed to be worn on a completely motionless head. The 2.0 design, which uses a camera and LED system mounted away from the head, can be used by people whose heads are moving slightly, such as MS patients, and people who wear glasses, etc.


This eyewriter system is cheap, and completely open source.  At the moment, it costs about 200$ in parts.  Traditional commercial eye trackers costs between $9000-$20,000, so this is a magnitude of order cheaper, and is designed to help anyone who wants or needs an eyetracker.

This fall, we've been showing off and demoing the 2.0 device -- check out the eyewriter 2.0 in action --  we even hooked it up to a robotic arm, to draw the artwork people make with their eyes: 

http://www.switched.com/2010/12/13/eyewriter-teams-up-with-robotagger-to-print-kids-ocular-artwork/print/


(The 2.0 device was designed with help and input from Takayuki Ito, Kyle McDonald, Golan Levin and students of the eyewriter collab at Parsons MFADT.  Thanks also to the Studio for Creative Inquiry / CMU for hosting a session for development)



 
Remove these adsRemove these ads by Signing Up
1-40 of 167Next »
happy,happy15 days ago

hey can we use a web cam for this and can we control a servo
of 9 g using our eye movements using arduino pls give me answer fast and it
would be nice of you to provide me with the codes and if web cam can be used
then how

yes there are some web cam available in market with ir capabilities you can use it.. but you have to work from scratch to control the servo .......

But can u tell me what variation in the codes i have to do if i want to control it with my arduino UNO
But can u tell me what variation in the codes i have to do if i want to control it with my arduino UNO
But can u tell me what variation in the codes i have to do if i want to control it with my arduino UNO
But can u tell me what variation in the codes i have to do if i want to control it with my arduino UNO
But can u tell me what variation in the codes i have to do if i want to control it with my arduino UNO
But can u tell me what variation in the codes i have to do if i want to control it with my arduino UNO
But can u tell me what variation in the codes i have to do if i want to control it with my arduino UNO
But can u tell me what variation in the codes i have to do if i want to control it with my arduino UNO
But can u tell me what variation in the codes i have to do if i want to control it with my arduino UNO
But can u tell me what variation in the codes i have to do if i want to control it with my arduino UNO
tkhalid113 days ago

i have a question regarding hardware of eye writer ...... i follow each and every step .. vsyn works fine but when i turn on the entire circuit leds would not fleshes instead they stay on.. when i cut off supply of vsyn, leds start flashing any help regarding to this problem will be appreciated thanks

happy,happy15 days ago

hey can we use a web cam for this and can we control a servo
of 9 g using our eye movements using arduino pls give me answer fast and it
would be nice of you to provide me with the codes and if web cam can be used
then how

happy,happy15 days ago

hey can we use a web cam for this and can we control a servo
of 9 g using our eye movements using arduino pls give me answer fast and it
would be nice of you to provide me with the codes and if web cam can be used
then how

happy,happy15 days ago

hey can we use a web cam for this and can we control a servo
of 9 g using our eye movements using arduino pls give me answer fast and it
would be nice of you to provide me with the codes and if web cam can be used
then how

happy,happy15 days ago

hey can we use a web cam for this and can we control a servo
of 9 g using our eye movements using arduino pls give me answer fast and it
would be nice of you to provide me with the codes and if web cam can be used
then how

happy,happy15 days ago

hey can we use a web cam for this and can we control a servo
of 9 g using our eye movements using arduino pls give me answer fast and it
would be nice of you to provide me with the codes and if web cam can be used
then how

happy,happy15 days ago

hey can we use a web cam for this and can we control a servo
of 9 g using our eye movements using arduino pls give me answer fast and it
would be nice of you to provide me with the codes and if web cam can be used
then how

happy,happy15 days ago

hey can we use a web cam for this and can we control a servo
of 9 g using our eye movements using arduino pls give me answer fast and it
would be nice of you to provide me with the codes and if web cam can be used
then how

happy,happy15 days ago

hey can we use a web cam for this and can we control a servo
of 9 g using our eye movements using arduino pls give me answer fast and it
would be nice of you to provide me with the codes and if web cam can be used
then how

happy,happy15 days ago

hey can we use a web cam for this and can we control a servo
of 9 g using our eye movements using arduino pls give me answer fast and it
would be nice of you to provide me with the codes and if web cam can be used
then how

happy,happy15 days ago

hey can we use a web cam for this and can we control a servo
of 9 g using our eye movements using arduino pls give me answer fast and it
would be nice of you to provide me with the codes and if web cam can be used
then how

happy,happy15 days ago

hey can we use a web cam for this and can we control a servo
of 9 g using our eye movements using arduino pls give me answer fast and it
would be nice of you to provide me with the codes and if web cam can be used
then how

happy,happy15 days ago

hey can we use a web cam for this and can we control a servo
of 9 g using our eye movements using arduino pls give me answer fast and it
would be nice of you to provide me with the codes and if web cam can be used
then how

Omar Amir1 year ago
@Abhi131: Here's the compiled version for Windows https://skydrive.live.com/?cid=f966c677a7c86219&sc=documents&id=F966C677A7C86219!103 Good luck!

Hey, I've made the hardware and now that I'm testing it, the software won't recognize my eye. Shouldn't I be ale to control the green dot with my eye? However, I can use the cursor and everything else works perfectly fine. It is just that the eye cannot control the system (like type, play "Catch Me" or "Pong" etc.) What should I do?

main.h file missing in your program :(

please help me how can i make this project trying for months but no vain :(

I've made the eyewriter hardware but the software won't recognoze my eye. I am not able to control the green dot in order calibrator or do anything with the use of my eyes. What should i do to make it work?

Screen Shot 2014-03-03 at 5.14.55 PM.pngScreen Shot 2014-03-03 at 5.17.19 PM.png
tkhalid16 months ago

please tell me if some one has made this project on win plateform as i am trying to make this project for past few months but not even suucceded to compile code in code block..

inZet9 months ago
The EyeFinder works depending on IR illumination and threshold, but the pupilFinder can't find anything, nor the glintFinder. Did I missed something? Any help?
TryinHarder inZet9 months ago
It's difficult to help without more information.  Please provide everything you can.

Are the IR LEDs flashing rapidly?
Have you tried tweaking the potentiometers for brightness of the LEDs?
Can you send a screen cap of your screen with the system operational and the software running?

inZet TryinHarder9 months ago
The VSync signal seems to work: I attached visible light leds and I can see them blinking on Arduino pin 11 and 12, alternated.
I also replaced the potentiometer with a 470 Ohm because the IR leds seemed too bright.
Today the software can't even catch the eye, it's like playing a russian roulette.
I don't see any reason why it shouldn't work: the only one is the infrared filter I used, taken from an unexposed film instead of Wratten 87c.
TryinHarder inZet8 months ago
Can you take a picture of your setup? And also your screen? I found that my eyes had to be looking directly on into the camera, and the glints needed to be positioned a certain way to reflect off the pupil.
inZet TryinHarder8 months ago
I attached a picture of my setup and a screenshot.
I can't figure out what's going wrong.
DSC_5142_1024.jpgSchermata 2013-11-29 a 22.14.28.png
TryinHarder inZet8 months ago
Here are some tips based on the images:

Your pupils look very small to me - try turning down the ambient lighting.

You are looking at the camera at an angle. Try looking at it straight-on.

For mine to work, I needed to raise the camera closer (but not all the way) to eye level. (It did obscure the bottom center of my monitor a bit.)

I also needed to tweak my Eye, Pupil, and Glint thresholds to 39, 66, and 221, respectively.

Be sure to experiment with the potentiometers.  The brightness/dimness of the LEDs does make a difference.  They need to be "just right".

Try each eye - my left works better than my right - and make sure the glints are pointed directly at the eye.

I ended up re-doing my glints and putting a space between each LED on the circuit board.  This is because they are otherwise too close together and not pointing straight ahead (they are pointing in different directions) because they don't actually fit in the adjacent holes.  Getting them all pointing straight ahead really made a big difference for me.

Hope this helps!
inZet TryinHarder8 months ago
Thank you! It has something to do with the camera driver; on the Mac, it still can't recognize the pupil but compiled on WinXP, it works. Same hardware, same position of the glints.
It is a try-and-control process and sometimes the process fails. You have seen my setup, I hope the leds are soldered at the same distance as yours.
I was able to calibrate the system but at the end the aiming is not precise. I can't shot the square, or with extreme difficulty. There are parameters on the software I'm not aware what they do: I'm studying the source code to understand as they influence the behaviour. Any suggestion here?
TryinHarder inZet8 months ago
Hi, again - Interesting about the cam driver. I also had a problem with it, and found I had downloaded the wrong version. Then I found the version here:

http://sourceforge.net/projects/webcam-osx/files/cvs-build/2009-09-25/macam-cvs-build-2009-09-25.zip/download

and it worked fine.  Not sure that's your problem as well, but thought I'd mention it.  :)

I'm afraid I can't help much with the software settings.  Without documentation, I find them... stupefying.  ;)   If it helps, I didn't need to change anything past screen one of the settings to get my setup to work.  I would be interested in knowing what you find through your source code review.

Regarding the glints, it does look like yours are spaced the same as mine, although they do look a bit uneven to me.  The resolution of your pic isn't super high, so I'm not sure if I'm seeing it accurately.  I'll add an image of my re-worked version here.  Once I got mine all pointing directly ahead, it made a big difference in finding (and keeping) the pupil.

Another thing I didn't mention: It helps enormously if you have your head completely still.  I use an ad hoc chin stand to keep my head in place.  Once I did that I found the tracking became much more accurate.

On your camera rig, what are those four white things just under the screw corners?  Are they extra LEDs?  Wondering what their purpose is...

Also, out of curiosity, what version of OS X and Xcode did you use to build the EyeWriter software?  Were you able to get it compiled on anything newer than Snow Leopard and Xcode 3?

Thanks - I've been enjoying our thread.

David

IMGP2987.jpg
inZet TryinHarder6 months ago

I'm still trying to get a stable pupil catch. It often get out-of-sync and stops. I can't move the green pointer on the letters I'm looking for, so the system can't write complete words.

Perhaps the best thing to do for me is to use glasses as EyeWriter 1.0. Or re-doing the glints as you did.

I tried to compile on OSX Mavericks with no success.

1-40 of 167Next »