Introduction: Simplest Augmented Reality

Don't believe the hype! In its simplest form Augmented Reality or Computer-Mediated Reality can be achieved using any live input source connected to a computer, such as any webcam. This tutorial will show you how to put together some libraries for visual augmentation (using Processing + OpenCV) and open up a world of new possible worlds.

A video feed contains a lot of information in its pixels so we will use simple color tracking from OpenCV for our augmentation. We will use Processing since it is versatile and developed.

Step 1: Download Processing.

Follow instructions at

Step 2: Download OpenCV for Processing:

Link is here:

CV stands for Computer Vision! So we can sound fancy.

Step 3: Download ToxicLibs for Processing

Link is here:

This will help us with our visuals and the physics-behavior of the visuals. Any other libraries you like for visuals might also allow interesting combinations!

Step 4: Integrate sketches

It may be useful to play with what OpenCV offers you in the example sketches, particularly the ones using live input. I used BlobDetection to get the Pixels from the incoming video stream and triangulated the blob to create a planar mesh.

See Attached Files for the code used.


DIY Hacks and How Tos (author)2016-08-28

Cool AR tutorial