Humans use their fingers for some of their most delicate communication. Typing on a keyboard or phone, conversing through sign language, or performing on a guitar or piano require finely-tuned movement and coordination between multiple digits. But many of the technologies intended to control or augment these activities have struggled to recreate the precise gestures and motions they require.
A new solution from the Human Computer Integration Laboratory directed by UChicago CS assistant professor Pedro Lopes solves this problem with a combination of electrical muscle stimulation (EMS) and mechanical brakes. DextrEMS, a haptic device invented and developed by Lopes’ students Romain Nith, Shan-Yuan Teng, Pengyu Li, and Yujie Tao, fits unobtrusively on a user’s hand. As EMS electrodes on the forearm move fingers to their desired position, ratchet brakes at the finger joints lock them in the target gesture and restrict unwanted movement from other fingers.
The work will be presented this week at the 2021 ACM Symposium on User Interface Software and Technology (UIST), one of the top human-computer interaction conferences.
“DextrEMS is a means to actuate human fingers through a computer,” said Nith, a 2nd-year PhD student in the Department of Computer Science. “It’s the same idea as a traditional exoskeleton, where we are providing force feedback to the fingers, but we wanted to tackle it through the perspective of miniaturizing everything. By combining EMS and brakes, we can actually create movements that weren’t possible before and users can move fingers independently.”