Abstract
The latest estimates of the World Health Organization point that approximately 5% of world’s population presents disabling hearing loss (328 million adults and 32 million children). This situation becomes very complex in developing countries, where children with hearing loss and deafness rarely have access to schooling. On those grounds, in this paper we present an intelligent system to automatically generating video-summaries and captioning in sign language with the aim of creating accessible learning objects for children and youth with disabling hearing loss. Through our intelligent system, we propose a methodology that allows performing agile consumption of educational content (Learning Accessible Objects) that use videos. With the aim of determining the real feasibility of our proposal, we have performed a preliminary experiment with 7 educational videos of history, natural sciences and mathematics for deaf children and youth from 8 to 12 years. A team of 6 experts in sign language has evaluated several aspects our proposal (coherence of the summaries and captions, quality of the synchronization between the explicative elements in sign language and video execution, possible lost keywords/meanings, …).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
World Health Organization (WHO): Deafness and hearing loss (2017)
World Federation of the Deaf (WFD). https://wfdeaf.org/
Debevc, M., Milošević, D., Kožuh, I.: A comparison of comprehension processes in sign language interpreter videos with or without captions. PloS One 10 (2015)
Dorfman, M., Grondona, A., Mazza, N., Mazza, P.: Asistentes Virtuales de Clase como complemento a la educación universitaria presencial. In: SADIO-40 JAIIO (2011)
Uluer, P., Akalın, N., Köse, H.: A new robotic platform for sign language tutoring. Int. J. Soc. Robot. 7, 571–585 (2015)
Gamage, N., Kuang, Y.C., Akmeliawati, R., Demidenko, S.: Gaussian process dynamical models for hand gesture interpretation in sign language. Pattern Recognit. Lett. 32, 2009–2014 (2011)
Huang, J., Zhou, W., Li, H., Li, W.: Sign language recognition using real-sense. In: 2015 IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP), pp. 166–170 (2015)
Centelles Velilla, M., Vázquez Guzmán, C., Ribera, M., Pérez Pineda, I.: Asignación de metadatos de accesibilidad a vídeos docentes (2016)
Demirtas, K., Cicekli, I., Cicekli, N. K: Summarization of documentaries. In: Computer and Information Sciences, pp. 105–108 (2011)
Potapov, D., Douze, M., Harchaoui, Z., Schmid, C.: Category-specific video summarization. In: European Conference on Computer Vision, pp. 540–555 (2014)
Xu, J., Mukherjee, L., Li, Y., Warner, J., Rehg, J. M., Singh, V.: Gaze-enabled egocentric video summarization via constrained submodular maximization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2235–2244 (2015)
Kolb, P.: Experiments on the difference between semantic similarity and relatedness. In: Proceedings of the Ordic Conference on Computational Linguistics (ODALIDA), pp. 81–88 (2009)
Büchner, A.: Moodle 3 Administration. Packt Publishing Ltd, Birmingham (2016)
Guerreiro, J., Gonçalves, D., De Matos, D.M.: Towards a fair comparison between name disambiguation approaches. In: Proceedings of the 10th Conference on Open Research Areas in Information Retrieval, pp. 17–20 (2013)
Acknowledgements
This work was funded by the Cátedra UNESCO Tecnologías de Apoyo para la Inclusión Educativa of the Universidad Politécnica Salesiana.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Ingavélez-Guerra, P. et al. (2018). An Intelligent System to Automatically Generate Video-Summaries for Accessible Learning Objects for People with Hearing Loss. In: Andre, T. (eds) Advances in Human Factors in Training, Education, and Learning Sciences. AHFE 2017. Advances in Intelligent Systems and Computing, vol 596. Springer, Cham. https://doi.org/10.1007/978-3-319-60018-5_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-60018-5_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-60017-8
Online ISBN: 978-3-319-60018-5
eBook Packages: EngineeringEngineering (R0)