BRIEF INTRODUCTION
This project focuses on creating a smart home automation system that enhances convenience and accessibility by allowing users to control electrical appliances using either hand gestures or voice commands. By integrating an ESP32 microcontroller with an MPU6050 accelerometer (for gesture detection) and a Bluetooth module (for voice control), the system enables dual control modes. Users can switch between these modes with the press of a button, offering flexibility based on user preference or environment. This innovative approach combines IoT, embedded systems, and human-machine interaction, making it ideal for modern smart homes, especially benefiting individuals with physical limitations.
COMPONENTS LIST
| S.No. |
Component Name |
Quantity |
Description |
| 1 |
ESP32 Development Board |
1 |
Main controller for processing and communication |
| 2 |
MPU6050 Accelerometer Module |
1 |
For gesture detection (X, Y, Z axis orientation) |
| 3 |
HC-05 Bluetooth Module |
1 |
For receiving voice commands via Bluetooth |
| 4 |
Relay Module (5V/3.3V) |
5 |
To control high-voltage appliances like fan, bulb, motor, etc. |
| 5 |
Push Button |
1 |
To switch between gesture mode and Bluetooth mode |
| 6 |
LED |
1 |
For status indication or as an appliance |
| 7 |
Bulb (or Dummy Load) |
1 |
Used as a controllable load via relay |
| 8 |
DC Fan / Toy Fan |
1 |
Appliance connected to relay for demonstration |
| 9 |
DC Motor or Pump |
1 |
Simulates a motor load controlled via relay |
| 10 |
Power Supply (5V/3.3V) |
1 |
To power ESP32 and relay modules |
| 11 |
Breadboard & Jumper Wires |
As required |
For circuit connections |
| 12 |
Smartphone with Bluetooth |
1 |
For sending voice commands through an app (e.g., Serial Bluetooth Terminal) |
BLOCK DIAGRAM
WORKING
The working of the Home Automation system using Gesture and Voice Control involves two modes of operation that can be switched using a push button. Initially, the ESP32 initializes all connected components including the MPU6050 accelerometer, HC-05 Bluetooth module, and the relays connected to home appliances like a fan, bulb, motor, lock, and LED. In Mode 1 (Gesture Control), the MPU6050 detects the orientation and tilt of the user’s hand. The ESP32 reads this sensor data and maps specific tilt directions to different appliances—for example, tilting the hand to the right may turn on the bulb, to the left may turn on the fan, upward tilt turns on the LED, and downward tilt activates the lock. These gestures are interpreted in real-time, and corresponding relays are triggered to control the appliances.
When the mode is switched to Mode 2 (Voice Control), the system listens for voice commands via the HC-05 Bluetooth module. The user sends voice commands through a mobile app (such as Serial Bluetooth Terminal), which are received as text by the ESP32. Commands like “fan on,” “bulb off,” or “lock on” are parsed and matched, and the ESP32 activates or deactivates the appropriate relays accordingly. The module also sends back confirmation messages to the phone. This dual-mode control system makes the project highly flexible and accessible, offering both hands-free and gesture-based operation suitable for smart homes.
IMAGES ARE ONLY FOR SAMPLE PURPOSES!!!!!
.svg)