loading

Industrial robots are truly incredible CNC machines –– not just for their speed, power, and precision, but because they are also highly adaptable. Unlike other CNC machines, when you put a tool on the end of the robot, you completely transform what it can do: put a sprayer on it, and it becomes a painting robot; put a gripper on it, and it becomes a material handling robot; put a welder on it, and it becomes a spot welding robot.

This adaptability has made the industrial robot a key piece of infrastructure for factory automation over the past 50 years. But despite their adaptability, industrial robots are fairly dumb machines: they have little-to-no awareness of the environment outside of their programmed tasks. This is one of the main reasons why industrial robots have thrived only in highly controlled environments, like factories. They need places where unpredictable objects (a.k.a. people) are strictly separated from their work zones.

But an industrial robot's adaptability is useful beyond the factory. Putting a film camera onto an industrial robot gives a director precise, complex, and repeatable camera moves. Putting a loader onto an industrial robot gives a construction worker a way to move heavier quantities of materials. Putting a light onto an industrial robot gives a photographer more precise control of a scene's ambiance. While these are somewhat mundane use cases, they tease out some of the biggest challenges for bringing industrial robots outside of the factory: because they are blind to the world, they are very dangerous to use; because they need highly technical skill to program, they are very difficult to use.

For the Pier 9's Fall 2015 Artist in Residence program, I decided tackle these two challenges and build a way for industrial robots to be safer and easier to use in uncontrolled settings. I created Quipt, a gesture-based control software that gives industrial robots spatial awareness and spatial behaviors for interacting closely with people.

P9 AiR Profile: Madeline Gannon from Pier 9 on Vimeo.


Find out more on how Quipt was made in the few next steps...

See the full project page here.

Step 1: System Overview

Quipt is a gesture-based control software that facilitates new, more intuitive ways to communicate with industrial robots. Using wearable markers and a motion capture system, Quipt gives industrial robots basic spatial behaviors for interacting closely with people. Wearable markers on the hand, around the neck, or elsewhere on the body let a robot see and respond to you in a shared space. This lets you and the robot safely follow, mirror, and avoid one another as you collaborate together.

Quipt augments an ABB IRB 6700 industrial robot by giving it eyes into its environment. Using a Vicon motion capture system, the software is structured to receive and reformat motion capture data into corresponding movement commands for the 6700. Movement commands are generated using our open-source library, Robo.Op (see it on github). Quipt also visualizes debugging data in an Android app, so a human collaborator has a mobile, continuous view of what the robot is seeing.

Saw you on TV, amazing! What a beautiful dance of robotics, ingenuity, and forthcoming. Good luck with your work.
Interesting i have been working on a similar system myself. Also use of mind control and position as well as gesture. Also force feedback in reverse. So as to make the robot safer. If resistance exceeds a certsin level stop and or reverse. This can be trsined behavior. Also protection of the dagerous object. Ant tool or material once loaded or on board sets conditions of cation or catious movement. Soooo many ways to skin thst cat. Let me know if you need any help.<br><br>Warren.
<p>Very impressive. I can see how safety is a primary concern from the start as it would not take much of a bump from something that large to put a painful pause in your day. Using something of that size really takes the creative possibilities to a new level. I'll be following along closely with your progress on this as I find it extremely interesting. Good luck with your work.<br>Cheers, <br>David - VEL</p>