There are dozens of apps and services to help people of different languages communicate. However, it is not easy for people with hearing impairments to overcome the language barrier. To solve this problem, a group of researchers at the University of Texas has developed a special wearable band with sensors that track gestures and muscle movements, and then translate them into the appropriate text on a computer or mobile device.
The sensor system records the gestures, as well as the electromyography of a person, that is, the electrical activity of his muscles. The sensors are attached to the wrist, forearm and bicep. The electromyograph receives electrical signals generated by muscle cells when they are electrically or neurologically active.
For the system to work effectively, you first need to configure it using rather complex algorithms. It takes a certain amount of time for it to adapt to a specific person.
The device is currently transmitting information to a smartphone or computer via Bluetooth. In the future, the researchers intend to make a device the size of a wristwatch and program it to decipher not only individual words, but entire sentences as well.
It is assumed that the text will be dubbed by a synthetic voice of the announcer, which will allow 70 million deaf people around the world to expand their opportunities.