New Wearable Sticker Can Turn Hand Movements Into Communication — But How?

A recent development in wearable technology has introduced a new approach to communication and rehabilitation, utilizing a thin, flexible sticker capable of translating hand movements into communication without the need for spoken words or touchscreen interaction.

This innovative wearable sensor merges a soft and pliable material known as polydimethylsiloxane (PDMS) with an optical component called a fiber Bragg grating (FBG). The sensor, designed to be comfortable for extended wear, boasts high-precision movement detection capabilities.

"For someone recovering from a stroke, these sensors could monitor wrist, finger, or even facial movements to monitor their rehabilitation progression," said Kun Xiao from Beijing Normal University in China.

"For individuals with severe mobility or speech impairments, the sensors could translate gestures or facial expressions into words or commands, enabling them to communicate with others or interact with technology more easily," he added.

Wearable Sticker That Transforms Hand Gestures into Communication

A cross-disciplinary team of researchers from Beijing Normal University, Sun Yat-sen University, and Guilin University of Electronic Technology in China spearheaded this endeavor.

Their collaborative efforts resulted in sensors demonstrating remarkable sensitivity and accuracy in gesture recognition and communication support tasks.

According to Rui Min from Beijing Normal University, these adaptable sensors may find utility beyond movement detection, potentially monitoring other health metrics like respiratory or heart rate by tracking subtle body movements.

Furthermore, they could aid athletes or fitness enthusiasts in real-time form correction or integration into gaming systems for immersive experiences.

Inspired by the challenges confronting people with disabilities and stroke survivors, the project aims to address shortcomings of traditional assistive technologies, which often lack accuracy, versatility, or comfort.

The goal was to develop a wearable solution that is precise in gesture detection and suitable for extended use, offering personalized and adaptive rehabilitation and assistance.

The researchers devised patches made from PDMS, a skin-friendly silicone elastomer, to achieve this. These patches, embedded with FBGs, enable movement sensing by detecting alterations in light propagation through the fiber optic during motion.

Combination of PDMS with FBGs

The combination of PDMS with FBGs proved pivotal, with thicker PDMS patches enhancing sensitivity to subtle movements like finger bends or wrist twists. This synergy allows the optical sensors to discern precise gestures with remarkable accuracy.

Moreover, the sensors' versatility allows application to various body parts, facilitating a wide array of uses. According to the researchers, a meticulous calibration process ensures adaptability to individual users, enhancing their effectiveness across different scenarios.

The sensors exhibited exceptional sensitivity and accuracy in tests focusing on gesture recognition and communication assistance, successfully translating gestures into commands or messages. For instance, finger movements were utilized to spell words using Morse code, showcasing the sensors' potential as assistive technology.

The researchers are now refining the technology for practical deployment and further studies through clinical trials. These efforts include miniaturizing the sensor system for seamless integration, enhancing wireless communication capabilities, and bolstering durability to withstand daily wear.

Ultimately, these advancements promise to revolutionize communication and rehabilitation paradigms, offering a transformative tool for individuals with mobility or speech impairments and opening new avenues for human-computer interaction and assistive technology.

The findings of the study were published in the journal Biomedical Optics Express.