Wearable IOT based Malaysian sign language recognition and text translation system

Sign language recognition devices are gaining tremendous attention in recent years for helping speech and hearing-impaired community. The idea of fusing technology and sign language knowledge together to create a smart system is still being tried and developed all over the world with implementation with many different sign languages. In this paper, Malaysian Sign Language is given importance with 5 Malaysian Sign Language words being selected for recognition and prediction with new combination of sensor used compared to previous researches done for Malaysian Sign Language recognition and prediction. The combination of sensors used are 1 MPU9250, 1 MyoWare and 2 Force Sensitive Resistor sensors. 1D CNN time-series model is implemented with prediction accuracy ranging from 80 to 91 percentage.