VNU-UET Repository

A Sign Language Recognition System Using Ionic Liquid Strain Sensor

Tran, Nhu Chi and Nguyen, Dang Phu and Nguyen, Thi Thanh Van and Tran, Thi Thuy Ha and Dau, Thanh Van and Bui, Thanh Tung (2021) A Sign Language Recognition System Using Ionic Liquid Strain Sensor. In: 3 rd International Symposium on Materials and Electrical Engineering Virtual Conference, 10 – 11 November 2021, Bandung-Indonesia.

[img]
Preview
PDF
Download (759kB) | Preview

Abstract

In this report, we develop a system converting sign language into voices and text. The system includes a glove attached self-developed ionic liquid-based strain sensors on each finger to detect the movement of them. When the hand move to express a letter lead to the resistance of the strain sensors on each finger change. Therefore, through the information from a set of sensors, the system can recognize the letter that user want to convey. A measuring and data acquisition circuit also are developed to receive and analyze data from the sensors. Furthermore, a data digitizing method is proposed as a solution for decoding purpose. The system is tested with 10 distinguished basic letters in American Sign Language table (ASL). The results show the accuracy of system is 98%. The system operates stably with the low power of 0.81W at rest state and 1.71W when working. Besides, applications on smartphone and PC are also built to translate the data into text and speech. These apps make it easier to communicate with deaf people. With achieved results, the system is fully extensible to detect more letters in ALS table in the future

Item Type: Conference or Workshop Item (Paper)
Subjects: Electronics and Communications
Electronics and Communications > Electronics and Computer Engineering
Divisions: Center for Electronics and Telecommunications Research (CETR)
Faculty of Electronics and Telecommunications (FET)
Depositing User: Trần Như Chí
Date Deposited: 21 Mar 2022 00:29
Last Modified: 21 Mar 2022 00:29
URI: http://eprints.uet.vnu.edu.vn/eprints/id/eprint/4705

Actions (login required)

View Item View Item