HAVOC - Home Automation With Voice Control

Before I begin the project description I would like to thank Audrey and Nicole to provide me the Intel Edison board with a bunch of sensors.

In this Instructable I have used Intel Edison to implement home automation with complete voice control. Basically what I mean by this is that we have a normal voice chat kind-off commands like how we speak to one another. This is done using an android apk which uses a STT engine (Speech to Text engine) to recognize what the commands are.

The project consists of 4 sub-systems:

1. Automation of Lights/Fan : This sub-system mainly deals with automatic switching ON/OFF of lights and fans depending on sensor values. If the light sensor reads a value lesser than a threshold, it automatically switches on the lights. Similarly with fans
   Now if the user wants to manually switch ON/OFF i.e., to override the system automation, he can just speak to the device through the android app to switch ON/OFF. All he has to say is "Switch on the lights/fans". The phase is not only limited to that sentence. He just needs to makes sure the keyword "Switch ON/OFF" and the device is mentioned.
2. Security system : In security I have implemented a live video streaming of a camera which follows the person. The camera is mounted on a servo motor (for angular rotations). This system also has 2 PIR (Proximity infrared) sensors attached to it. Basically PIR is a motion sensor. It detects the motion direction (One PIR for left, other for right) and then send that data to Edison to move the camera in that direction. Also instead of storing that data onto a local system I am hosting that data onto a static IP which can be seen on any device (PC/phones/ipads) connected onto the same network as the Edison.
   I have also added a timer based switching ON of outside porch lights in the evenings even in the absence of the user.
3. Social content; This sub-system mainly deals with the sharing of information. Basically what i mean to say is that you can get updated on any news/sports/stocks or any other genre of that matter by just speaking to the device; like for example "Update me on football" . Edison now goes to the internet and fetches the live news for you. And instead of displaying, it speaks the news to you. This is done using a TTS engine (Text to Speech engine.) The idea is that if the user is tired working late at office, he/she can just sit on the couch and give commands to the device.
4. Alert: I have added a timer based alarm system which wakes you in the mornings. The system is designed in such a way that it plays the morning prayers when you wake up.
   
   And please do vote if you liked it.

Step 1: Automation of Lights/Fan

The automation involves the switching ON/OFF of lights/fans automatically.

The sensors connected are LDR (Light sensor), temperature sensor. The edison now read these values and switches ON/OFF depending on the values and threshold.
If the LDR value is lesser than threshold ==>> Switch ON Lights.

if the temperature value is greater than threshold ==>> Switch ON fans.


Now if the user specifically wants to switch ON/OFF the system, all he has to do is speak to the device through the android app - "Android meets robotics." Its available on Google. This will force the system to system to switch ON/OFF depending on what the user wants.

Components used:

• LDR sensor
• Temperature Sensor
• Bluetooth module - HC -05

Step 2: Security System

The security system consists of a camera mounted on a servo with 2 PIR sensors attached to it.
The PIR sensors are gonna detect the motion and send that data to Edison. Edison will now force the servo to move the camera in that direction. Thus this gives us a presence detector camera. This also improves the field of view rather than having a static stationary camera.

Also the camera data is then streamed live into a static IP address rather than storing it on to a local machine. This gives us the flexibility to access the streaming video with multiple devices.
This is done using websocket programming.
Refer - edi-cam to see how it works.

The servo and the camera are run on two different scripts.

Apart from this I have also added a clock based system which turns on the outside lights in the evenings. This is done by changing the time of the the Edison board and storing it in a variable and checking continuously using a different script running though SSH.
All the codes are run in the Linux part.

Components used:

• Camera
• Servo
• PIR - 2 numbers

Step 3: News Update

This is my personal best sub-system of them all.

This sub-system deals with updating the user on news/sports/stocks or any other genre for that matter. All the user is supposed to do is, speak to the device and let it know you wanna be updated. Like for example "Update me on football"or say "Update me on news" anything what the user wishes to know. (Anything pre-defined in the codes that is.)

Edison now gets the data from the internet (URL's of that particular genre to be previously feed in the codes) and downloads the RSS feed. The system then uses TTS engine called "Espeak" to convert the downloaded RSS into a voice output. The output is heard through a speaker connected to Edison using a USB sound card.
To set-up the sound card, you can refer to my other Instructable post click here

One major advantage of this home automation system is that the entire process is audio;everything from input to output is in audio format.

Components used:

• USB Sound card
• Speaker

Step 4: Alerts/Play Music

Basically i have designed this system to be an alarm to wake up early morning. It automatically plays early morning prayers at the time of your wake up.

I have designed this by a little change of system time (Setting it to sync with my location) and then storing it in a variable and checking continuously.
You can click here to refer to my previous instructables to learn how to play music with your Edison.

Step 5: General Block Diagrams

The general block diagram is as shown.


If you have any queries, please feel free to comment. And don't forget to vote if you liked it.

Thank you

Comments

[queen_kumara]

I found this thread on Google to be the only result relevant to the question I'm trying to understand presently so I hope nobody minds me jumping in to seek some clarification over some of the technicalities you've been discussing. (A great deal of which goes straight over my head)

I'm in the process of buying an outdoor light and have been puzzled by the specifications stating 'voice control'? Not least because it's a very inexpensive solar light and will be outdoors but more that I cannot wrap my head around how 'voice control' could possibly interface with such a simple unit. (I'm perhaps missing something obvious?). I've searched high and low online to try garner more information to no avail...until I found this thread which is well beyond my scope of understanding but in my simple brain it seems to have discussed (among other things) how the PIR motion sensor can facilitate voice control, maybe not itself perhaps but by interfacing with something else, or acting like a conduit, and the other device is what instigates voice control? Maybe? (Put in my simple terms).

Here are the specs for the light. It's less that $20.

"LED Solar Power Outdoor Security Light PIR Motion Sensor Voice Control Outdoor Garden Path Wall Light"

Solar Power Powered 20 LED Energy Saving Waterproof Garden Outdoor Motion Sensor PIR Security Wall Light Lamp
Features:
PIR Motion Sensor
Voice Control
20 LED solar light for outdoor security use
No pollution, energy saving and environmental protection
Build-in 1000mAh Li-ion battery support long working time after enough charged
Support motion detective, when someone close within 3m at night, light will auto ON high brightness mode, 35 seconds after, the light will become dim brightness mode
Easy to install, high bright, waterproof and durable
Suitable for Fence, Patio, Deck, Yard, Outdoor Garden, Home, Driveway, Stairs where can receive sunlight directly
Protection Mode: Over Charging, Over Current, Short Circuit, Over Discharging

Specifications:
Solar Panel: 0.66W
LED: 1W x 20pcs, SMD 3528
Color Temperature: 5500-6000K
Lumen: 340-600LM
Charging Time: 7 Hours
Lighting Mode: Dark / Dim / Bright
Battery Capacity: 1000mAh / 3.7V
Motion Distance: 2m-3m
Shell Color: silver
LED Color: White
Material: Aluminum + ABS
Size: 13 x 9.2 x 5cm / 5 x 3.5 x 1.9 inch
Net Weight: 218.9g

I guess my question(s) are.

A) does this functionality mean anybody can utilise the voice control with what is provided (or is it merely speaking of it broader capabilities)?

B) if so, how would it work?

C) how does it work anyway?

D) is this new-ish technology now easily accessible to Joe Public to own and experiment with? Ie: 3rd Generation?

E) is this the same concept as having a recorded message play if a sensor is triggered? That I can get, but what I don't understand how that could be possible unless there were speakers in the light or the light was connected somehow to a stereo/recording etc...or if I'm giving the voice command then how on earth could the light possibly hear me?!

Any and all responses would be greatly appreciated though please don't forget the level you're pitching to :wink:.

Really interested to learn as it's all quite fascinating.

Many thanks

[queen_kumara]

I found this website on Google to be the only result relevant to the question I'm trying to understand presently so I hope nobody minds me jumping in to seek some clarification over some of the related technical jargon you discuss. (A great deal of which goes straight over my head)

I'm in the process of buying an outdoor light and have been puzzled by the specifications stating 'voice control'? Not least because it's a very inexpensive solar light and will be outdoors but more that I cannot wrap my head around how 'voice control' could possibly interface with such a simple unit. (I'm perhaps missing something obvious?). I've searched high and low online to try garner more information to no avail...and my brain is hurting but from what I can vaguely gather is that maybe the the PIR motion sensor can facilitate 'voice control'? maybe not itself perhaps but by interfacing with something else? or acting like a conduit? And it's then the other device that instigates voice control? Maybe?

Here are the specs for the light. It's less that $20.

"LED Solar Power Outdoor Security Light PIR Motion Sensor Voice Control Outdoor Garden Path Wall Light"

Solar Power Powered 20 LED Energy Saving Waterproof Garden Outdoor Motion Sensor PIR Security Wall Light Lamp
Features:
PIR Motion Sensor
Voice Control
20 LED solar light for outdoor security use
No pollution, energy saving and environmental protection
Build-in 1000mAh Li-ion battery support long working time after enough charged
Support motion detective, when someone close within 3m at night, light will auto ON high brightness mode, 35 seconds after, the light will become dim brightness mode
Easy to install, high bright, waterproof and durable
Suitable for Fence, Patio, Deck, Yard, Outdoor Garden, Home, Driveway, Stairs where can receive sunlight directly
Protection Mode: Over Charging, Over Current, Short Circuit, Over Discharging

Specifications:
Solar Panel: 0.66W
LED: 1W x 20pcs, SMD 3528
Color Temperature: 5500-6000K
Lumen: 340-600LM
Charging Time: 7 Hours
Lighting Mode: Dark / Dim / Bright
Battery Capacity: 1000mAh / 3.7V
Motion Distance: 2m-3m
Shell Color: silver
LED Color: White
Material: Aluminum + ABS
Size: 13 x 9.2 x 5cm / 5 x 3.5 x 1.9 inch
Net Weight: 218.9g

I guess my question(s) are.

A) does this functionality mean anybody can utilise the voice control with what is provided (or is it merely speaking of it broader capabilities)?

B) if so, how would it work?

C) how does it work anyway?

D) is this new-ish technology now easily accessible to Joe Public to own and experiment with? Ie: 3rd Generation?

E) is this the same concept as having a recorded message play if a sensor is triggered? That I can get, but what I don't understand how that could be possible unless there were speakers in the light or the light was connected somehow to a stereo/recording etc...or if I'm giving the voice command then how on earth could the light possibly hear me?!

Any and all responses would be greatly appreciated though please don't forget the level you're pitching to ;)

Really interested to learn as it's all quite fascinating...

Many thanks

[LokkeshR]

Ya that's interesting.....but what if it was kept in noisy areas? More over will it recognizes only the particular voice of a person? I am asking since I had recently started working on it...

[taifur]

Edison has integrated bluetooth, so why you used HC-05 module?

[Shreyansh Jain J]

Yeah. But I wasn't able to take the data from my app and store it in a variable with the integrated module.
By making use of Hc-05 and uart connections I was able to do so.

[JeffreyL2]

Wow! Thank you for sharing the wealth of your ideas! Very easy to understand, great concept with flexibility for future add-ons too!

[B 3D Bureau de Criações]

CONGRATULATIONS for your. Very easy and very well organized !!!

[Shreyansh Jain J]

Thanks :)

[Joniy]

Excellent idea. And very easy to understand steps.

[Shreyansh Jain J]

Thank You Joniy

[AkarshN]

Very interesting! Good project.

[Shreyansh Jain J]

Thank You