Head Controlled Mouse Cursor with Voice Commands for Handicapped Person

Published Aug 05, 2024

GPL-3.0-only

51 hours to build

Intermediate

python

This project helps handicap person to use computer with the help of their head and eye movements. For this project we have used Python language and libraries like OpenCV, Mediapipe, PyautoGUI, Speech Recognition.

Components Used
Microphone Microphones microphone, 4 mmx1.5mm, electret condenser, noise cancelling, solder pads, 1 Vdc	X 1
Webcam (For prototype) Used to capture live/realtime footage and also for eye/head movements	X 1
Desktop/Laptop We use a Windows Forms application to read data from the Discovery board and display the inference results. The connection is established via a USB interface, which allows the application to communicate with the Discovery board and retrieve the necessary data for processing and visualization.	X 1
Python for backend scripting	X 1

Description

Eye-Controlled Mouse Cursor with Voice Commands, This project helps people who are physically disabled.This enables you to access a laptop without even touching it.We are breaing down the barriers that prevent disabled people from accessing computerr. We want technology to be accessible & useful for everyone, specifically those who has difficulties in moving around.

The user face is tracked by a webcam in real-time. Firstly with the help of OpenCV librabry we gave our webcam access to code.With the help of Mediapipe Librabry we draw facial landmarks on eyes,nose etc. and detects their movements then they translate to mouse operations on the screen with PyAutoGUI. In view of this uers can use their laptops easily, without requiring a regular mouse.

We have added voice recognition through the SpeechRecognition library. With this feature, users can type and give commands just by talking. Mixing eye-tracking for moving around & voice recognition for commands creates a hands-free experience. It’s super user-friendly, especially for people who can’t use regular input devices.

The main goal of this project is to help users with disabilities operate their laptops smoothly and independently. We believe everyone deserves ease in their tech use, making life just a bit simpler than before.