Maestro - Finger Mounted Input Device to Control the Cursor.

by jhong12

12K26112

Intro: Maestro - Finger Mounted Input Device to Control the Cursor.

Maestro is wearable input device using the orientation of the finger. Wearable small devices on the finger has been investigated to provide easy access to PC and surrounding environment (NailO, HandSight). Maestro enables user to do pointing and scrolling based on the orientation of the finger and contact between fingers.

Materials

This Instructable was made as part of the CS graduate course "Tangible Interactive Computing" at the University of Maryland, College Park taught by Professor Jon Froehlich. Please see http://cmsc838f-s15.wikispaces.com/ for more details.

STEP 1: 3D Printing the Rings

To mount the components in Maestro, rings are used. Download the stl file and print it with 3D printer.

STEP 2: Connect IMU Sensor Stick to Arduino

To mount the circuit to the finger, the circuit should be small. Therefore, Arduino Pro Mini is used. Connect the IMU sensor stick to Arduino Pro Mini as shown in the schematic. The detail of using IMU sensor stick is here.

https://github.com/ptrbrtz/razor-9dof-ahrs/wiki/Tutorial

STEP 3: Connect Electrodes to Make Touch Sensors

As shown in the schematic above, 3 electrodes are used as a touch sensor. The touch sensor will be used to activate/deactivate the cursor movement and scroll.

STEP 4: Upload the Arduino Code

The arduino code computes the orientation of IMU sensor and the proximity of finger to the touch sensor. The code is composite of these two tutorials. See them for detail.

IMU sensor code

https://github.com/ptrbrtz/razor-9dof-ahrs/wiki/Tu...

Touch sensor code

http://playground.arduino.cc/Main/CapacitiveSensor...

STEP 5: Putting It All Together

Put all electrical components as shown in the figure in the previous step.

STEP 6: Install the Mouse Event Injection Code

You can download the mouse event injection code from the github repository.

https://github.com/jhong12/FP_Maestro

In the repository, the java project named JavaBrowser is the mouse event injection program.

STEP 7: Check the Serial Port and Set It in the JavaBrowser Code

The final step is changing the port name in the JavaBrowser code. Open the Arduino program and check what is the name of serial port connected to Arduino.

Find the line

CommPortIdentifier portIdentifier = CommPortIdentifier.getPortIdentifier("/dev/tty.usbserial-AE01COQ2");

in the JavaBrowser.java and change the parameter to the name of your serial port.

STEP 8: Try It!

That's it. You can try Maestro.

12 Comments

saneesh123 7 years ago

Can I use this sensor like a substitute of the 9axis 9DOF IMU Sensor Breakout Board Module Gyroscope Compass for Arduino?

http://www.amazon.in/Sensor-Breakout-Gyroscope-Compass-Arduino/dp/B01KT7XCKS?tag=googinhydr18418-21

miss perfect 8 years ago

i m confused where to join the USB cable to connect it with pc........................ive seen following comments ...u guys dont answer our question thats really bad......i request u to solve our queries as soon as possible.

tmercados 8 years ago

Great instructable.
I have a question:
Can I use this sensor like a substitute of the 9DOF IMU sensor?

http://pages.ebay.com/link/?nav=item.view&id=310513793857&alt=web

saiesh 8 years ago

Which other component I can use as a substitute of 9DOF IMU sensor stick

HOWE_yadoing 8 years ago

I don't see anywhere to plug in a USB, was the original sensor 9DOF IMU sensor stick modified? The one I'm trying to buy does not have a USB port, same with the Arduino Pro Mini.

Han_Solo_Order66 8 years ago

this is really cool can't wait to see more like this

seamster 8 years ago

Very interesting project, thank you for sharing it here!

noctaib 8 years ago

good inspiration. would love to buy the finished product together with an asp.net api making it accessible more dev

HOWE_yadoing 8 years ago

What is holding the resistors, the jump wires to the arduino board, and the wires connecting the electrodes together? It looks like a conductive gel

jhong12 8 years ago

The resistors and wires are soldered and covered by silicone extruded from the glue gun. The bare connecting part is weak, so the silicone make it stronger. The electrodes are attached to transparent tape.