Emotchy Glass

Abstract

Translate Article

The proposed glasses-type wearable enhances social interaction for visually impaired individuals by recognizing and communicating facial expressions in real-time. Social interactions can be challenging, leading to isolation. It utilizes the ESP32-CAM module to capture facial images. XGBoost-based emotion recognition algorithms classify emotions accurately. The system transmits identified emotions to a mobile app via Bluetooth. The app provides auditory cues to convey emotional context. A vibration motor in the glasses delivers tactile feedback corresponding to detected emotions. This multi-modal feedback ensures users perceive and respond to social cues effectively. Designed for accessibility, this device fosters social inclusion and independence, improving users' quality of life.