Indonesian Sign Language (SIBI) Learning Media Application Based on Deep Learning Technology for Deaf Children
DOI:
https://doi.org/10.37802/joti.v5i1.384Keywords:
Deaf Children, Deep Learning, Image Recognition, Indonesian Sign Language (SIBI), Learning Media ApplicationAbstract
One of the main methods in teaching deaf children effectively is through visualization of learning materials. Previous research has developed augmented reality-based interactive learning media for deaf children. However, these learning media have limitations related to smartphone memory, dependence on certain flashcards, and limited amount of material due to flashcard limitations. Here, researchers innovate to develop SIBI learning media applications based on deep learning technology that material does not depend on a specific flashcard, but the application is able to detect real objects and various images. TensorFlow Lite is considered lighter but still allows the system to run deep learning on mobile devices with low latency. This application is designed to capture a real object or image through the camera, then the object or image will be processed and recognized using TensorFlow Lite. The object recognition process is carried out at the classification layer using switch-case syntax and global class synchronization with the YouTube API. After the image or object is recognized, the system will issue an output in the form of an Indonesian sign language video link from the object.
Downloads
References
SUPAS, “Hasil Survey Penduduk Antar Sensus.” Buletin, Badan Pusat Statistik, 2015.
Krasavina Y, et al., “Research-Based Teaching of Hearing-Impaired Students,” Proceeding IFTE-2019, 1387-1394 doi:10.3897/ap.1.e1316
Departemen Pendidikan Nasional, KAMUS Sistem Isyarat Bahasa Indonesia, Direktorat Pendidikan Luar Biasa Proyek Pengembangan Sistem dan Standar Pengelolaan Pendidikan Luar Biasa, Jakarta. 2001.
M. E. Anggraeni, W. Sarinastiti, S. Wati, “Indonesian Sign Language (SIBI) Vocabulary Learning Media Design Based on Augmented Reality for Hearing-Impaired Children” Jurnal EECCIS Vol. 12, No. 1, April 2019, pp 1-3, p-ISSN: 1978-3345, e-ISSN(Online): 2460-8122
M. E. Anggraeni, I. Maulania, W. Sarinastiti, “Interactive Learning Media for Hearing-Impaired Children using Indonesian Sign Language (SIBI) – Simple Sentence Arrangement,” IES 2020, Surabaya.
Siegel, L. (2000). The educational and communication needs of deaf and hard of hearing children: A statement of principle on fundamental educational change. American Annals of the Deaf, 145(2), 63-78. https://doi.org/10.1353/aad.2012.0813
Vesel, J. & Robillard, T. (2013). Teaching mathematics vocabulary with an interactive signing math dictionary. Journal of Research on Technology in Education, 45(4), 361-389. https://doi.org/10.1080/15391523.2013.10782610
Wicha, S., Sharp, B., Sureephong, P., Chakpitak, N. and Atkins, A. (2012). An animated dictionary for hearing-impaired students in Thailand. Journal of Research in Special Educational Needs, 12(4), 234–244. https://doi.org/10.1111/j.1471 3802.2012.01239.x
B. Baglama., H. Uzunboylu., M. Haksiz. (2018). Technologies Used in Education of Hearing Impaired Individuals, International Journal of Emerging Technologies in Learning (Ijet), September 2018, DOI: 10.3991/ijet.v13i09.8303.
Aziza Almutairi, etc. 2017. Augmented Reality for the Literacy Development of Deaf Children: A Preliminary Investigation. Proceeding of the 19th International ACM SIGACCESS Conference on Computer Accessibility Pages 359-360.
