This tutorial is for an augmented reality book using a Kinect 360 and a projector. The Kinect is tracking the position of the book via its camera, so you can move it around and the projection will follow the motion of the book. You can for example project 3D elements that will appear complete with shadows and will be able to rotate and change shape, colour, texture.

We always thought augmented reality to be a great technology however it is always required to experience it while looking through a device. We wanted to try to use it in combination with projection-mapping to create a seamless and magical experience.

As we decided to go for a large format (A3) we wanted to use a Japanese Stab Binding technique. There are several versions of this technique, and we are explaining the most simple one which is perfect for beginners. You also do not need any adhesives or complicated tools. The downside of this binding technique is that it does not open completely flat which is why we added another step of prefolding the pages using a bone folder. If you decide to go with a smaller format that allows you to fold your pages in the middle you could also use single, multi-section or coptic binding which naturally open flat.

We hope you enjoy the tutorial, we would love to see the type of books and projections you come up with and welcome any feedback. If anything is unclear, please comment.

Step 1: Materials needed

  • Printed pages for the inside of your book (number of pages according to your needs)
  • 2 Cover papers
  • Thread (for example waxed cotton or linen thread)


<p>Hello!</p><p>Thanks for sharing such an awesome project with us!<br>Im trying to make this, but while downloading all of the addons i get a 404 error with the following link: <a href="https://github.com/rezaali/ofxUI%C2%A0" rel="nofollow">https://github.com/rezaali/ofxUI</a></p><p>Do you perhaps know if there is another way to download these addons?</p>
<p><a href="https://github.com/rezaali/ofxUI" rel="nofollow">https://github.com/rezaali/ofxUI </a> seems to work for me. The addons is deprecated but still seems to be compatible with last version of openFrameworks.</p>
<p>Hi, super cool project !</p><p>Im going to try and experiment with it but first I have a question : can it work with a mac ?</p><p>Thanks</p>
<p>Thank you for the feedback. If you can run all the addons used in the project separately on OSX then it can work. After you can use the openFrameworks project generator tool to link all add-ons and files.</p><p>If one of the addons doesn't run it's very likely there is an existing equivalent OSX addons on <a href="http://ofxaddons.com/categories" rel="nofollow">http://ofxaddons.com/categories </a> . </p>
<p>Wow nice project :)</p><p>but i have some broblem when compiling them it wont do it say &quot;2 failed&quot;</p><p>i dont know why.I have :</p><p>-Win10</p><p>-Of 0.9.3</p><p>-downloaded all the addon :(</p>
<p>Hi Mohamed</p><p>it can be different things, do you have more info about the error and where the compilation fail?</p><p> it is possible an addon has been updated since we published the project and it is not compatible anymore.</p><p>To find out I would try to compile some openFrameworks exemple and then each external addons example separately. </p>
Awesome project i can definiey see this as an advertising tool . :) looking forward to seeing the final project ,rhank,yiu for sharing
<p>Hey, super nice guys. I have been working on something similar for a few years now : <iframe allowfullscreen="" frameborder="0" height="281" src="//www.youtube.com/embed/ZBndzLAM5I8" width="500"></iframe></p><p>I am now working on building/selling the whole projector / camera / kinect setup with this kind of app !</p>
<p>Wow, impressive! Thanks for sharing, it looks great! We didn't know your project but will follow your progress from now. It's really interesting. </p>
<p>Thank you :) </p>
cool stuff. I saw something similar a couple years back. not a book though, a guy took a Pico projector and a Web cam l, attached it to himself and was able to interact with the projections. this was before google glass. don't know what ever came of it.
<p>It was much more than a few years :), he (Pranav Mistry) even got a TED talk about it : </p><p>https://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_technology?language=en </p>
<p>Yes, I have seen this a few years ago actually. Such incredible work! Thanks for sharing the TED link. </p>
<p>very clever, thank you for sharing.</p>
<p>Cool augmented reality effect. </p>
<p>Thanks for the positive comment and the warm welcome to the instructables community! </p>

About This Instructable




More by convivialstudio:Object Interaction with Touchscreens Augmented Book Prototype 
Add instructable to: