Real-time emotion detection NLP pipeline using OpenAI APIs, AWS Lambda, and Swift for haptic feedback systems.
EmotiConnect is an iOS application for Apple Watch that helps individuals with alexithymia and autism understand emotions through haptic feedback. The app uses OpenAI Whisper to convert multilingual speech to text, then processes the text with GPT-3.5 to extract emotions and their intensity. The emotional data is translated into distinct haptic patterns delivered through Apple Watch and Neosensory Buzz devices. Built with Swift and AWS infrastructure (S3, Lambda, API Gateway), the system provides real-time tactile feedback to bridge emotional communication gaps for approximately 10% of the global population affected by alexithymia.
Built during the BioxML Hackathon 2023.