Learning sign language with mixed reality applications - the exploratory case study with deaf students

Abstract

The current body of scholarly literature highlights the increasing importance of Mixed Reality (MR) in the field of education since it provides an alternative way through visual stimuli inside an immersive environment. In recent years, the possibility for educators to use Mixed Reality as an additional pedagogical instrument has witnessed notable growth. Furthermore, the implementation of MR technology enhances the perceived benefits of employing it as a solution to the challenges encountered in educating and acquiring sign language skills among children who have hearing impairments or are deaf. The development and testing of deaf-friendly techniques for teaching sign language to Deaf or Hard-of-Hearing (DHH) pupils utilizing modern MR technology is the key endeavor of our research. In light of the specific aspects of the pilot study and the suggestions and preferences expressed by the participants, as outlined in previous attempts, we have endeavored to develop a series of instructional modules on the topic of animals. These modules employ various methods of sign demonstration and incorporate visual representations and concise encyclopedic descriptions. To achieve our research objectives, a total of 21 deaf students, ranging in age from 9 to 14 years, were selected for this study. These students study in a mainstream school that have inclusive educational programs. The participants have been offered two options for evaluation: a laptop and the application specifically designed for the HoloLens 2.