Sensorium Ex - EmoSynth

Wearable/ Accessibility- Team Project

2023

Role Distribution

Lang Qin- Physical Computing
Junru Chen, Kassia Zheng- Fabrication
Emily Lei- TouchDesigner
Muqing Wang- Max

EmoSynth, a wearable sound device prototype, was developed by our team at the NYU Ability program specifically for the Sensorium Ex. The main focus of EmoSynth is to address performers' needs for real-time artistic expression and modulation, especially for those with cerebral palsy and/or limited speech capabilities. This innovative device is designed as a multi-sensory tool to enhance the performance experience for both performers and audiences. The project emphasizes both the physical aspects of voice and expression, as well as enabling social and democratic participation through voice.

Click here to know more about Sensorium Ex

Mission

Our primary goal is to create a rapid prototype based on the specific needs and conditions of the performers, exploring the potential of this wearable device format. We are focused on developing a non-intrusive device that considers the unique physical requirements of performers, stage conditions, and the nature of opera content.

Preliminary Information

The research group conducted interviews with 5 AAC users to explore their perceptions of current speech tools and techniques used for expression, vocalization, and communication. These insights were crucial in guiding the development of a prototype to address unmet needs and improve the user experience.

Key Takeaways

People use their bodies to communicate and express emotions.
The tone of the delivered message impacts the receiver and the communicator.

Assumption

Beyond exploring the form of wearable devices, we contemplated various factors influencing human voices, including gender, age, emotions, accents, and more. Our objective is to craft a device that not only addresses functional needs but also resonates on an emotional and expressive level.