Change your cover photo
Upload
Change your cover photo
This user account status is Approved

This user has not added any information to their profile yet.

Wearable Communication Assistant for the Deaf and Mute
Maixduino Kit for AI+IoT

1. Project Overview: The Wearable Communication Assistant aims to bridge the communication gap for individuals who are deaf or mute. This device utilizes the Sipeed Maixduino AI + IoT Kit to convert sign language into text or speech and vice versa, enabling seamless communication in real time.

2. Objectives:
Sign Language to Text/Speech: Use the onboard camera to capture hand gestures and convert them into readable text or audible speech.
Speech to Text: Capture spoken words through the microphone and display them as text on the screen for those who cannot hear.
Dual-Mode Functionality: Allow users to switch between sign language recognition and speech-to-text conversion based on their needs.
User-Friendly Interface: Ensure the device is easy to use, with clear text display and simple controls.

3. Outcomes:
* Enable individuals who are deaf or mute to communicate effectively with others without the need for interpreters.
*: Provide a tool that empowers users to interact independently in various social and professional settings.

4. Detailed Project Implementation:

Hardware Setup:
Assemble the Sipeed Maixduino AI + IoT Kit with its camera, microphone, display, and other peripherals.
Ensure the device is lightweight and portable, suitable for wearing on the chest or arm.
Software Development:
Sign Language Recognition: Train a neural network model using a dataset of hand gestures. Implement real-time image processing and gesture recognition.
Speech-to-Text Conversion: Integrate a pre-trained speech-to-text model. Capture audio using the microphone and process it in real time.