Introduction: Gaming With Thoughts/Mindwaves (w/ Arduino)

Picture of Gaming With Thoughts/Mindwaves (w/ Arduino)

What do you think why we like videogames? The answer isn't hard: the videogames shows us new, extremly good challanges. I play videogames rarely, but my favorites are car racing and open world games just like Need for Speed and Grand Theft Auto series. Yes, these games are intrerestings, but after one month I didn't played with them so much. So I needed something new in my gaming experience. And...

I created a tool that allows you to play any games only with the power of your mind. This device can emulate W, A, S and D to play any games on your computer... This device is like a game controller for the mind. You don't need to press any key only think on steering left, roght or forward. Join me and enjoy the ultimate gamer experience.

I already made a brainwave based project (you can find here), but I just realized that this is too complicated for a simple maker. So I made a second version and I have some good news: it is very simple to build if you have some experience in Arduino, and costs less than $90in total. After gathering parts you can start building and after one a day of working you can control PC games with your mind.

You can modify the code to any keyboard or mouse button to play with. I used WASD because in racing and open world games usually are used these.

The theory is easy, the homemade Bluetooth headset can recognise brainwaves and transmits these to the Arduino Leonardo that anayzes signals then controls the videogame, it's that simple. All these in less than one second. What are you waiting for? I think this is my coolest project that I've ever made. My childhood dream come true.

Read the instructions, buy the parts, hack things and enjoy...

Step 1: Watch the Test Video!

Of course you need to practice a lot to control the games. And as you can see on my video that I'm not a very good driver, but I was able to move my car with my mind. It's extremly fun to play with. At first time I blew up my car, this is the second test. (I played with the GTA 5)

In the video I tryed to control the car and went very well. I come down off the road, and crashed a few times... That's because it's hard to record the video and control the game in the same time, and the brain cannot concentrate on two things perfectly. The driving experience isn't so easy and smooth like the keyboard's but it's much more cooler.

Step 2: The Science Behind the Project

Picture of The Science Behind the Project

Electroencephalography (EEG) is an electrophysiological monitoring method to record electrical activity of the brain. It is typically noninvasive, with the electrodesplaced along the scalp, although invasive electrodes are sometimes used in specific applications. EEG measures voltage fluctuations resulting from ionic current within the neurons of the brain. Diagnostic applications generally focus on the spectral content of EEG, that is, the type of neural oscillations (popularly called "brain waves") that can be observed in EEG signals. (thank you Wikipedia) But we're going to use two very accurate values.

  • Alpha is the frequency range from 7 Hz to 14 Hz. It emerges with closing of the eyes and with relaxation, and attenuates with eye opening or mental exertion.
  • Beta is the frequency range from 15 Hz to about 30 Hz. Low amplitude beta with multiple and varying frequencies is often associated with active, busy or anxious thinking and active concentratiion.

Basically the device can detect your focus level, your meditation level and blinks. The more focused you are the higher the "attention" level becomes, the more relaxed you are, the higher the "meditation" level becomes.

Step 3: Games Made Directly for Mindwaves

Picture of Games Made Directly for Mindwaves

This hacked Necomimi toy is compatible with every game/app that is made by NeuroSky. In the NeuroSky Store you can find many interesting adventure games. On the pictures you can see screenshots of a trackor racing game, brainwave visualizer and an app that is made for testing the headset.

The problem with these games was that they weren't enough interesting after a few hours, they become boring. So I started to build the project, I wanted to play real games with my thoughts.

Step 4: Tools and Materials

Picture of Tools and Materials

Click on the part to watch the purchase links. The parts are from the Gearbest.com because of their very low prices. If you want to build the project don't hesitate buy the parts now. You don't need any special tools only simple workshop tools. The total cost is less than $100.

Tools:

  • Glue Gun
  • Double Sided Tape
  • Soldering Iron
  • Solder

Parts:

Software:

Hardware:

Parts for the Headset:

Parts for the Reciever:

Step 5: Configuring Bluetooth Modules

Picture of Configuring Bluetooth Modules

HC-06: First load up the sketch named “HC_06_Bluetooth” to an Arduino UNO then connect the Bluetooth module as the schematic shows. I found this schematic on Artronix team's website and seemed to be useful.

//HC-06-Bluetooth

void setup() {
   // Start the hardware serial.
Serial.begin(9600);  // default HC-06 baud rate
delay(1000);
Serial.print("AT");
delay(1000);
Serial.print("AT+VERSION");
delay(1000);
Serial.print("AT+PIN"); // to remove password
delay(1000);
Serial.print("AT+BAUD7"); // Set baudrate to 576000 - eg Necomimi dafault
delay(1000);
Serial.begin(57600);    // 
delay(1000);
}
void loop() {
}

Open your Serial Monitor in the Arduino IDE and wait until the Arduino configures the BT module. Now your Bluetooth module is set to 57600 baud rate. You can try out a lot BCI (Brain Computer Interface) apps, because this hacked bluetooth Necomimi toy will be compatible with every Neurosky apps. You can use these apps to learn to control your brainwaves and values, like attention or meditation. You can try a lot of cool games, but I recommend these apps (they are compatible with PC, iOS and Android):

http://store.neurosky.com/products/brainwave-visua...

http://store.neurosky.com/products/eeg-analyzer

http://store.neurosky.com/collections/android/pro...

HC-05: Then use the "HC_05_Bluetooth" and load up to your Arduino the same way like before. Connect "EN" pin of the HC-05 to the 3v3 of the Arduino. You should write the adress of your HC-06 module in the code. Check the adress of the BT module with an Android smartphone, like me. Replace ":" (double dottles) with "," commas in the code.

//HC-06-Bluetooth

void setup() {
  // Start the hardware serial.
  Serial.begin(9600);  // default HC-05 baud rate
  delay(1000);
  Serial.print("AT");
  delay(1000);
  Serial.print("AT+VERSION");
  delay(1000);
  Serial.println("AT+ROLE=1"); //set the HC-05 to master mode
  delay(1000);
  Serial.println(" AT+LINK="copy here your adress"); //now the module should connnect automatically
  delay(1000);
  Serial.print("AT+UART=57600,1,0"); // Set baudrate to 576000
   Serial.begin(57600);    //
  delay(1000);
}
void loop() {
}

Check the HC-06's adress with an Android phone (see on the picture). And you should change the adress in the code: 20:15:09:15:17:82 ==> 2015,09,151782 This way the HC-05 module can recognise the adress. So just leave some ":", because they aren't neccesary. From now your Bluetooth modules should connect to each other. If you still have probles read this article.

Step 6: Hacking the Necomimi Toy

Picture of Hacking the Necomimi Toy

I love hacking toys so I bought a brainwave sensing toy called Necomimi, that is able to move its ears depending on your brainwaves (attention, meditation). This is the most useless toy that I’ve ever saw, but there’s inside a small chip that reads brainwaves, filters noise and gives a very good signal. Works with UART (Serial) interface, so with some hacking we can use Arduinos to read brainwaves. The role of this headset is to transmit brainwaves wirelessly to the Arduino Leonardo. Nobody wants cables on his head so I created this comfortable and user friendly headset.

Go downer to see how to take apart and make a wireless Bluetooth headset out of it. Follow the pictures too:

We want to modify this EEG toy to transmit data via Bluetooth so first take apart the case. The screws are under the sticker. Remove the sticker and the back of the device and you’ll find inside a small circuit. The one that is under the main circuit is the Neurosky TGAM chip. This is connected with four header pins to the main microcontroller board so take a soldering iron and remove this circuit carefully. Now you can build in your own rechargeable power source. I used a 500mAh Li-Ion battery, a USB charger circuit, a 5v step up circuit and two resistors (100 ohm and 200 ohm) to ensure a perfect 3.4 volt power supply for the chip and for the Bluetooth module. Follow the schematic to build the circuit that is needed in the headset.

Step 7: The Rechargeable Power Source

Picture of The Rechargeable Power Source

Following the circuit schemantic create the circuit that will be placed in the headset. After removing batteries, circits and all unneded stuff from the original headset using some double sided tape mount everything on the headset's left side. First create the battery's circuit with charger circuit and with 5vstep up module. After this make a voltage divider with the 2 resistors for 3.3 volts. This ensures the power for the sensor. Now solder a wire to the to the T-pin. The T-pin is the transmitter pin with 57600 baud rate that sends data to a HC-06 slave BT module.

Step 8: Assembling the Reciever

Picture of Assembling the Reciever

I placed the whole circuit on a hobbyglass. With some double sided tape mounted the Arduino Leonardo and the breadboard on the hobbyglass then plugged in the Bluetooth module and the LEDs. Use here the HC-05 Bluetooth module that is already configured. Use some jumper wires and make the following connections:

  1. Arduino Leonardo-5v to Bluetooth-VCC and to cathodes of the two LEDs
  2. Arduino Leonardo-GND to Bluetooth-GND
  3. Arduino Leonardo-D9 to Bluetooth-TX
  4. Arduino Leonardo-D5 to Red LED
  5. Arduino Leonardo-D6 to Green LED

That's all so now you should write a code or download mine in the next step.

Step 9: Software

Picture of Software

The Arduino Leonardo board is able to emulate keyboard or mouse. Using this feature I made a code that emulates WASD and controls many games on your computer. The NeuroSky uses eSense values: attention and meditation from 1 to 100 and detects blinks. If the eSense value reaches the limit (70 for meditation and 65 for attention) or detects blinks emulates a pressed key.

The role of the two LEDs is to indicate when you reached the attention or meditation limit. The red indicates attention and the green meditation.

Plug in your Arduino Leonardo and load up this code. Download the libraries from the Software Parts step. The Bluetooth modules are already configured so after loading up the code you can start playing video games.

/*
Code created by Tamás Imets for playing videogames with mindwaves Feel free to use it 25th of March, 2016 */

#include <Mindwave.h> #include <SofwareSerial.h> #include <Keyboard.h>

SoftwareSerial bluetooth(9, 8); //softwareserial pins Mindwave mindwave; //mindwave library activated

int medlimit = 70; //set limits int attlimit = 65; //set limits

void setup() { bluetooth.begin(MINDWAVE_BAUDRATE); //set Baudrate pinMode(5, OUTPUT); //setup pins pinMode(4, OUTPUT); //setup pins } void onMindwaveData() {

if (mindwave.quality() < 95) { /if you blink Keyboard.write('w'); //presses W

}

if (mindwave.quality() == 100) { Keyboard.write(' '); }

if (mindwave.meditation() > medlimit) { //if you meditate digitalWrite(5, HIGH); Keyboard.write('d'); //presses D

}

if (mindwave.meditation() < medlimit) { digitalWrite(5, LOW); Keyboard.write(' '); }

if (mindwave.attention() > attlimit) { //if youe focus digitalWrite(6, HIGH); Keyboard.write('a'); //presses A }

if (mindwave.attention() < attlimit) { digitalWrite(6, LOW); Keyboard.write(' '); } }

void loop() { mindwave.update(bluetooth, onMindwaveData); }

Step 10: How to Use It?

Picture of How to Use It?

It's very easy to learn to use the device. A few hours of practice makes you a real driver, you will be able to control almost any games with it. Only your brain needs to get used to control its activity. If the device is done follow these steps to us your mindwave game controller.

  1. Put the headset on your head.
  2. Plug the reciever in your computer.
  3. Check if the Bluetooth modules are connected.
  4. Enjoy the Ultimate Gamer Experience.

To control the game make the following things:

  • Blink to start the car (emulates "W" key)
  • Blink again to stop (emulates "Space" key)
  • Relax a bit to steer right (emulates "D" key)
  • Focus to steer left (emulates "A" key)

Step 11: Testing the Circuit

Picture of Testing the Circuit

Power up the circuit and try to increase your attention or meditation levels. If the LEDs light up that means you made a good job. Now you can try to play games.

Step 12: Gaming!!!

Picture of Gaming!!!

The future is here! Play your favorite video games with the power of your mind. You can play GTA, Need for Speed, action games, online games... Anything! Play online games on any website... Be Creative!

Step 13: Thank You for Watching!

Picture of Thank You for Watching!

Have fun while playing with your mind. If you liked my Instructable and my idea please give me a kindly Vote. Write your opinion in comments and thanks again!

Comments

GinoG10 (author)2017-08-21

Dude, that is awesome! Imagine connecting it to VR it would be a totally new experiance.

Ashutosh Zade (author)2017-03-16

I have all the devices and arduino and code. I tried to make this device but code is not working..

_a_p_s (author)Ashutosh Zade2017-06-11

Did this project not work.?

Andicandy (author)2016-06-17

wait is this legit?

Krosyss (author)2016-05-15

will this project work with the Arduino Uno R3 board. If so, what modifications would I need to make with the code?

EvilGnomeLock (author)2016-04-20

So when coding the Arduino to the HC-05 Bluetooth Module to read the MAC address of the HC_06 Bluetooth Module,we kept getting an error in the code "

exit status 1
missing terminating " character"

We need help with it

SouravD13 (author)2016-04-16

hey, what kind of game we can play with this , is there any restriction to certain games, if it has limitation then then how we can make it a universal gaming module, plz explain..

www139 (author)2016-04-16

This is incredible! :)

PurpleEarth (author)2016-04-11

Could this work with Minecraft?

Imetomi (author)PurpleEarth2016-04-11

Yes, but the gaming experience will be bad... You haven't enough EEG signals to control Minecraft well.

shahroza2 (author)2016-04-11

will NeuroSky Mindwave work instead of Necomimi Brainwave???

Imetomi (author)shahroza22016-04-11

Hmm, probably yes, but I think you'll need a different bluetooth module... It's possible that HC-05 isn't compatible with the NeuroSky Headset, but worth a try.

shahroza2 (author)2016-04-11
NeuroSky Mindwave Mobile will this module work? instead of

Necomimi Brainwave

Arduino4Me (author)2016-04-06

This is an AMAZING project! Awesome work! Do you know if there is already a headset that is set up like how you hacked the one above? I'm just asking, because if I buy this one, and try to do what you did, I'll end having to buy another one because I messed it up! Lol :)

Hey Jude (author)2016-04-03

Great project - really impressive!
I've been playing around with these EEG headsets also...you might also like to know there are games called 'Mind Flex' Duel....a 2 player games with EEG headset (also made by the same company). The reason I mention it is that you can get these for ~$40-$100 on ebay, and I suspect you'd have fun hacking one and making it a two-player game with your friends (next to you or even over the web?).

And yeah - ignore the haters. This EEG stuff has years to become 'good' for the mainstream, but it always starts with guys like you making weird stuff just for fun. But I do agree, you probably should send this to someone at MIT, and/or Neorosky, they might send you some freebies, who knows ;o)

vternal3 (author)Hey Jude2016-04-04

Emotiv has made a really good head set, I know the technology has been around for years and there is also work being done to use a combination of inputs, including eye tracking, EEG, haptick feedback gloves, augmented reality, as well as tons of streaming meta data like location, time of day, current activity, all to assist in predicting what your intents are and optimizing the environment around you to manifest those intents... We already do this as observers, I recommend watching on YouTube 'The two slit experiment' Cartoon to see what I am speaking about with our observation manifesting the outcome of what is.

Kendrickxy (author)2016-04-04

I think it's gonna be my summer project! :D I really like to play video games, and if I can play it a cool way, well why not ?
It's a really big work but I can try.
Thanks for the post :)

JadO1 (author)2016-04-04

can i use 2 hc-05 ... use instead of the hc-06 another hc-05 and do the same configuration you've done on the baud and password ?

GrizzlyT (author)2016-04-04

Actually, its not a joke, these do work, but I dont know who actually developed this one in particular,,,, but, IBM already has one sitting on the shelf,,, not using arduino though,,, and they have had it for around 20 years now,,, I had a friend who had developed one,, came to my wife and me with a lawyer to get it patented, and wanted us to be co-inventors,,,, we didnt have the money,,, so, he went to another guy, who sold it to IBM behind his back and bought himself a radio station.... you could hook it up to a computer and type with your mind.... it was slow, and gave you a headache, but worked,,,, So, watch out for your patents with IBM,,, good luck and happy gaming...

GrizzlyT (author)2016-04-04

Actually, its not a joke, these do work, but I dont know who actually developed this one in particular,,,, but, IBM already has one sitting on the shelf,,, not using arduino though,,, and they have had it for around 20 years now,,, I had a friend who had developed one,, came to my wife and me with a lawyer to get it patented, and wanted us to be co-inventors,,,, we didnt have the money,,, so, he went to another guy, who sold it to IBM behind his back and bought himself a radio station.... you could hook it up to a computer and type with your mind.... it was slow, and gave you a headache, but worked,,,, So, watch out for your patents with IBM,,, good luck and happy gaming...

JackC52 (author)2016-04-03

WHAT IS THIS BLACK MAGIC

billbillt (author)2016-04-03

????

GAMELASTER (author)2016-04-03

This is Joke or real working thing? :D

KittyQ1 (author)GAMELASTER2016-04-03

It's a real thing, but doesn't work as advertised. OCZ made a device that does the same thing (google OCZMSNIA). What it effectively does it measure electrical activity from your the muscles in your forehead, then implements a software "potentiometer" under the assumption that the readings are roughly invariant over a given range for a given person. Implementation-wise, it's basically a series of electromyogram sensors you can get for cheap all over the interwebs. Example:

https://www.sparkfun.com/products/13723?gclid=CIOU6PnR8ssCFQmqaQodZQYAdw

John T MacF Mood (author)2016-04-03

This is great. It could be adapted to use brain waves to control the environment of a paralyzed person. Or call for help from a caregiver. Kudos for something so useful!

kchugh (author)2016-04-03

n this is for everyone else who are criticizing it

it is that Necomimi Brainwave Cat Ears uses EEG sensors that are used for collection of frequency of electrical waves and then convert it into codes then to the computer

he just used the bluetooth transmiter

n qualification or age doesent matter i am a 13 year old kid studying in 8th grade n i new all about it an year ago and developed a go kart controlled by my brain

bobdole1221 (author)2016-04-02

Just a few questions. DO you go to MIT? Cause you probably should. Now for my im a bit skeptical questions. How do we know you dont have someone with a wireless controller doing these movements?And if your not going to MIT. Which website did you get these plans from? If all is true you shouldnt be anywhere else right now except for a school of technology.

Imetomi (author)bobdole12212016-04-02

:)) Thank you, but I'm not on the MIT, I'm in a highchool in Transylvania, far from the USA, but I still don't know, where'll I go in the future. It isn't from a website, I just was bored on one weekend, and I had no better idea, so I made this to play with.

CaptainLlamas (author)2016-04-01

I really thought it was an April fools joke for a little bit there. Well done, I love how you gutted the crappy toy and made it useful.

Imetomi (author)CaptainLlamas2016-04-02

No it's not April fools day, it's pure science... :)

GarvA1 (author)2016-03-31

awesome ! really cool gadget you should try to sell you may get 1000 s of $s

Imetomi (author)GarvA12016-04-02

I'll try it.

Bosskeith83 (author)2016-03-31

cool

Imetomi (author)Bosskeith832016-04-02

Thanks!

kchugh (author)2016-03-31

well done!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

Imetomi (author)kchugh2016-04-02

Thank you!!!!!

About This Instructable

25,864views

465favorites

License:

Bio: Hi, I'm Tamas (Thomas), a 17 years old Hungarian guy. My hobby started more than 10 years ago. I learn electronics, physics, programming, IoT ... More »
More by Imetomi:DIY Cheap VR FPV System for Drones, Planes, CarsUltimate Intelligent Fully Automatic Drone Robot (w/ RPi, Arduino) Jedi Force Gestures Based Home Automation (with Smartwatch)
Add instructable to: