Back projection 56 inch multitouch television.

Back projection 56 inch multitouch television.
After reading this Instructable, I have built a nice multitouch display during my spare time as a hobby. In this article, I will share plans and explain how to construct a 56 inch multitouch screen that looks like a TV. It's totaly homemade, it's not made from an old tv but you could do so. This article is for people who already have basis in this kind of thing. It's not an easy setup and it's not suitable to be commercialized but for personal use it's fine for testing new softs.You can look my website at: www.Softmt.com

 
 
Remove these adsRemove these ads by Signing Up
 

Step 1Basic principle

Basic principle
Basic Principle

The principle is to modify a webcam to allow it to capture only IR light and point it to your screen. Then the software analyzes the images and detects press where there is a blob. A blob is the light projected back of your screen when you press onto it (Scattered Light on the schema).

Multitouch technology grows at a lighting speed during those years. There are many different methods for sensing the touch on the screen. As far as I know there's electronically and optically based setup. Iphone and Ipod touch are multitouch devices and use electronic circuit for sensing touches.

Optical systems are the simplest to build for home users. Those systems require a low light environment and may not be as stable as electronical systems. There's two big principle in multitouch optical system, the first Is FTIR (Frustrated total internal reflection) like I use and DI (Diffuse illumination) like Microsoft surface uses.

Frustrated Total Internal Reflection

When light encounters an interface to a medium with a lower index of refraction (e.g. glass to air), the light becomes refracted.
The extent of refraction depends on the angle of incidence, and beyond a certain critical angle, it undergoes total internal reflection (TIR).
Fiber Optic cable is a common technology that employs TIR.
However, another material at the interface can frustrate this TIR, causing the light to escape the waveguide there instead. Ref : http://www.cs.nyu.edu/~jhan/ftirtouch/

Under "ordinary conditions" it is true that the creation of an evanescent wave does not affect the conservation of energy, i.e. the evanescent wave transmits zero net energy. However, if a third medium with a higher refractive index than the second medium is placed within less than several wavelengths distance from the interface between the first medium and the second medium, the evanescent wave will be different from the one under "ordinary conditions" and it will pass energy across the second into the third medium. (See evanescent wave coupling.)
A transparent, low refractive index material is sandwiched between two prisms of another material. This allows the beam to "tunnel" through from one prism to the next in a process very similar to quantum tunneling while at the same time altering the direction of the incoming ray. Ref: Wikipedia

Diffuse illumination
In DI system, The IR light isn't inside the acrylic but projected onto it by the top or the bottom. The acrylic should be evenly projected onto the screen to be reliable.
+ Simplest construction
+ DI don't require a compliant surface (Rubber)
+DI don't require acrylic, it can be made out of any transparent material
+ Allow tracking of Fiducial
-Blobs are not as clear and sharp compared to ftir blobs

http://youtu.be/Wi8DqXYYehE

« Previous StepDownload PDFView All StepsNext Step »
127 comments
1-40 of 127next »
Nov 11, 2008. 10:28 AMGoldCannon says:
is there such thing as a projector lens that can project a fully proportional rectangular image when mounted at the side of the screen, not in the center? If I were to build a multi touch desk and need at least some space for my legs under the table, i would need to put the projector somewhere at the opposite side with a special lens, but i still want the image to reach to the edges of the table. Would this be possible?
Jan 20, 2012. 12:01 PMguunhan says:
I believe the setup your looking for is a telecentric lens.
Nov 18, 2008. 11:38 AMHoaxe says:
what you need is an "optical engineer" or an "optical designer", that sort of thing, to help you figure out how to build this lens of yours. I have never seen anything that could do that, but hit me up if you do. there's probably an e-mail in my profile or something. you could also try pushing the projector back and tilting forward and then just use a regular Isosceles trapezoid regulating feature seen on most projectors to fix the picture. a last try is to project the image from the top. the picture would appear on your hands when on it but other than that, i don't see why not.
Jul 15, 2011. 4:10 PMaerwin says:
I understand that you can use Microsoft paint and all... but, can you get on the internet while using the software?
Sep 23, 2011. 7:20 PMarjay1491 says:
of course you can, its a computer after all
its just a computer with a projector and webcam installed
Mar 16, 2009. 9:17 PMsrvliveson says:
Could I theoretically use a projection TV to create this? I have a sony 43 inch.
Aug 13, 2011. 4:48 AMcliffyd says:
ya me too, have RCA 52" work exactly the same, theoretically!
Aug 26, 2008. 8:05 AMOpalinus says:
Very nice project. You show how easy it is to use Multitouch even for a huge surface. The only Problem is - I think - you must stand. It isn't very comfortable, but I don't think you want to work with that for hours, as with a "normal" computer. But at least very cool.
Aug 13, 2011. 4:47 AMcliffyd says:
ahh pull up a bar stool, LOL
Apr 28, 2011. 4:09 AMzack247 says:
i have a question. hopefully you can answer?
would this work if i used a LCD screen?
is there any way to make something like this with a lcd screen?

please post back and let me know!
Dec 13, 2010. 12:22 AMmikebook says:
I understand how your finger triggers the IR to bounce back, by why doesn't the silicone/rubber do the same thing? Maybe I'm really just missing a big concept here?
May 12, 2010. 5:08 PMermapundi says:
Could I just add IR LED's and an IR webcam to this TV? TV link  or would I need some layers of some material
Apr 5, 2010. 7:03 PMtanmanknex says:
You know, I think this could be used as a table also, with the slanted part where you sit under.  It might not be quite as effective, but it might work.
Apr 4, 2010. 9:21 PMbowmaster says:
Amazing. This would be the perfect thing for my geek pad. I WILL make one when I have the money.
Apr 4, 2010. 2:55 PMVTguy says:
Ever see the Homemade Multi-touch on the Hak5 show?
Sep 25, 2008. 6:16 PMPumpkin$ says:
genius.... pure genious
Apr 4, 2010. 2:53 PMVTguy says:
Jeff Hann may be a genius but he was rude to me, I talked to him on the phone to get an interview, he told me he would.... never answered my call again
Feb 14, 2010. 2:31 PMgreenie7888 says:
I was wondering if your box is made of wood and what the holes on the back are (if they are air vents should i consider putting some fans in, is over heating a problem, do i have to use the same projector?) , do you have it plugged into a computer or does it have a dedicated computer.
Dec 20, 2009. 12:35 AMkristoff1313 says:
I dig your project man. 
 This project and NuiGroup inspired me to make somehting similar to this. I am changing a couple things from your design as a basis.
1. Screen will be glass and sit 30-45 degrees for a more ergonomic approach for extended use. Like a drafting desk.
2. I think I will go with a 1/4 inch tempered glass (clear no tint and without manufacturer bug engraved)
 Seems everyone is migrating to lasers over the surface for touch(less) interface. Would you considering doing an updated project with IR lasers?
Sep 24, 2009. 10:56 AMRapidMustang says:
Do I have to use 850nm leds, or can I use any IR led?
Jul 7, 2009. 4:52 AMJG96 says:
Could you make it in to a (for example) 13 inch screen, and embed it into a desk (so its facing upwards)?
Jul 2, 2009. 10:36 AMCaptHowdy1173 says:
"DI don't require acrylic" ... is there a disadvantage to acrylic? I designed mine using acrylic and was going to coat the bottom side of it with a material that's about 20% opaque (using silicone glue). If anyone's having trouble understanding this there are TONS of materials elsewhere on this project.
Jun 27, 2009. 8:23 PMmaxpower49 says:
what is the special lense and the link doesn't work
May 31, 2009. 1:32 AMm.kitchen says:
Is it possible to put the projection screen on the bottom layer? This way you're touching the acrylic and not the rosco.
May 14, 2009. 12:29 PMbiotecnix says:
endlightin plexi glass you will find works allot better if your using 850nm leds
Apr 30, 2009. 3:58 PMPyshotic Wards says:
sexyyyyyy!!!!!
Feb 17, 2009. 1:53 PMhousewright30 says:
about how thick did you make the rubber layer? i tryed this without anything on the acrylic and it was hard to use i put a thin layer of rubber on then tryed it again with only the rubber and it didn't show anything. i understand how this is suposed to work but how do you get the RI light to go into the rubber so that when you tuoch it, it is reflected back down to the web cam?
Feb 12, 2009. 5:10 AMjantunes91 says:
Hi. I'm doing a project similar to this for school and I can't seem to understand the purpose of the Special Lens and the IR Filter. I've seen other tutorials where these items are not required to modify the webcam. I you can light me up on this, I'll be very grateful. Thanks in advance, jantunes
Jan 3, 2009. 1:23 PMItsTheHobbs says:
Can't you use a regular $15 webcam from like, Staples?
Jan 8, 2009. 4:52 AMArchive555 says:
You could, if you wanted to use a setup which is called a Diffused Illumination setup. This relies on (usually) outside sources of ambient light shining on a diffused surface with the camera in an enclosed space below. The camera picks up dark patches (fingers) on the surface and software on your computer is able to translate that into trackable objects. This system however has a lower accuracy, and is more prone to 'False Blobs' (tracked objects that aren't actually there). Hope that helps. You can find a ton of info over at the NuiGroup forums (nuigroup.com/forums/). The setup he is using is an FTIR setup (which uses infrared light 'rebounded' off of objects on the surface back towards and IR camera (and interpreted as trackable objects), and offers far greater accuracy and isn't prone to 'false blobs'. -Archive
Dec 18, 2008. 5:13 PM09wklaehn says:
Christopher, I am at teh point of adding the screen in, thanks to your great plans I have been able to build eveerything else, but I am a bit confused on the placement of the rosco aabove the screen. Should I put the spacer along the 1/2 inch edge without silicon? and tehn put tapw o the sides and stretch the rosco? Thanks for any help, William!
Dec 22, 2008. 11:37 PM09wklaehn says:
So I have the LEDs in, and everything else, but you said in your post to never tape directly onto the Acrylic. I don't see how you can't? how did you attach and stretch the rescue without taping on the back of the acrylic. Sorry to bother you again, but thanks for all your help. Have a merry Christmas!!
Dec 18, 2008. 11:39 PMMFeinstein says:
Hi Christopher, I am from brazil and I really like your work, actually i want to make my own :P I was wondering, the image quality is like an LCD tv, like those in the market? second think. you have sad that the ambient IR ligth may cause interference in the system , so i have the ideia to make the IR LEDs blink in some frequency, and an software can filter those blinking bloobs, dont? and did you thougth about making an "processor board" to filter the bloobs and makes the PC have less work (with microprocessors like AVR or PIC)? thanks for the atention Michel.
Dec 20, 2008. 9:56 PMMFeinstein says:
Christopher, Tanks for your reply, please continue with your great work and keep us posted! I will soon test some things (it will take some time to buy it on brazil :P) thanks again! Michel.
Dec 15, 2008. 6:37 PMcham2020 says:
man, i am amazed by your work. just a question though. inside the frame, there are two mirrors to reflect the projection image from the projector to be visible on the screen. so what's the size of both mirrors? thanks !
Dec 5, 2008. 4:05 PMjunior2387 says:
ok i have a couple questions. 1. u applied the glue first into the wholes, then you slid the LEDs in? and second if i were to use the paint, any paint in black would work? and do i want the paint to NOT touch the LEDs legs, or is doesnt matter that much? or would u thing it is better to paint the edges and then make the wholes? let me know please. thank you.
1-40 of 127next »

Pro

Get More Out of Instructables

Already have an Account?

close

All Steps Viewing
View all steps of an Instructable on the same page when you're a Pro Member.

Upgrade to Pro today!
20
Followers
1
Author:Christopher Jette(Cuisivanco)