Skip to main content
SpringerLink
Log in

Multimodal Technology: Improving Accessibility of the Design of Home Appliances

  • Conference paper
  • First Online:
Advances in Usability, User Experience, Wearable and Assistive Technology (AHFE 2021)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 275))

Included in the following conference series:

  • 4186 Accesses

Abstract

This paper aims to present the potential of multimodal technology to increase accessibility in home appliances’ interfaces for people with visual impairments from the Inclusive Design perspective. The methodological procedure was based on a theoretical mapping (unsystematic and systematic literature review) which filtered publications between 2010 and 2020, indexed in the scientific databases ACM Digital Library, IEEE Xplore Digital Library, Science Direct, Scopus, Springer Link, and dissertations in the CAPES Theses and Dissertations Catalog, and Brazilian Digital Theses and Dissertations Library - BDTD. This study identified 19 relevant publications in the area of interaction, engineering, and software development, with a focus on multimodality, accessibility of interfaces that enable access to the web, mobile, and home appliances content. These publications address that the multimodal association favors the accessibility and usability of the products and that the multimodal resources are shown to be efficient to avoid cognitive overload during the interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Waller, S., Bradley, M., Hosking, I., Clarkson, P.J.: Making the case for inclusive design. Appl. Ergon. 46, 297–303 (2015)

    Article  Google Scholar 

  2. Connnell, B.J., et al.: The principles of universal design: Version 2.0. The Center for Universal Design (2001)

    Google Scholar 

  3. ATiA, A.T.I.A.: What is AT? - Assistive Technology. https://www.atia.org/home/at-resources/what-is-at/

  4. Keates, S., Clarkson, P.J.: Countering design exclusion. In: Keates, S., Patrick Langdon, P., Clarkson, J., Robinson, P. (eds.) Universal Access and Assistive Technology, pp. 33–42. Springer London, London (2002). https://doi.org/10.1007/978-1-4471-3719-1_4

    Chapter  Google Scholar 

  5. Han, S.H., Yun, M.H., Kwahk, J., Hong, S.W.: Usability of consumer electronic products. Int. J. Ind. Ergon. 28, 143–151 (2001)

    Article  Google Scholar 

  6. ABNT, A.B. de N.T.: NBR ISO 20282-1:2016 - Facilidade de operação de produtos de uso diário Parte 1: Requisitos de projeto (2016)

    Google Scholar 

  7. ABNT, A.B. de N.T.: NBR ISO 9241-171 - Ergonomia da interação humano-sistema Parte 171: Orientações sobre acessibilidade de software (2018)

    Google Scholar 

  8. Senado, A.: Pessoas com deficiência visual cobram eletrodomésticos adaptados—Senado Notícias. https://www12.senado.leg.br/noticias/materias/2019/08/20/pessoas-com-deficienciavisual-cobram-eletrodomesticos-adaptados

  9. Brasil: Lei no 13.146. Lei Brasileira de Inclusão da Pessoa com Deficiência (2015)

    Google Scholar 

  10. Oviatt, S., et al.: Designing the user interface for multimodal speech and pen-based gesture applications. Hum. Comput. Interact. 15, 263–322 (2000)

    Article  Google Scholar 

  11. Sebillo, M., Vitiello, G., De Marsico, M.: Multimodal Interfaces. In: Ling Liu, M., Özsu, T. (eds.) Encyclopedia of Database Systems, pp. 1838–1843. Springer, Boston (2009). https://doi.org/10.1007/978-0-387-39940-9_880

    Chapter  Google Scholar 

  12. Dumas, B., Lalanne, D., Oviatt, S.: Multimodal interfaces: a survey of principles, models and frameworks. In: Lalanne, D., Kohlas, J. (eds.) Human Machine Interaction, pp. 3–26. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-00437-7_1

    Chapter  Google Scholar 

  13. Nesbitt, K.V: A framework to support the designers of haptic, visual and auditory displays (2005)

    Google Scholar 

  14. Chang, D., Nesbitt, K.V: Developing gestalt-based design guidelines for multi-sensory displays (2006)

    Google Scholar 

  15. Freeman, E., Wilson, G., Vo, D.-B., Ng, A., Politis, I., Brewster, S.: Multimodal feedback in HCI: haptics, non-speech audio, and their applications (2017)

    Google Scholar 

  16. Park, J., et al.: Development of a web-based user experience evaluation system for home appliances. Int. J. Ind. Ergon. 67, 216–228 (2018). https://doi.org/10.1016/j.ergon.2018.05.017

    Article  Google Scholar 

  17. Park, C.W., Alderman, J.: Designing Across Senses: A Multimodal Approach to Product Design. O’Rilley Media Inc., Sebastopol (2018)

    Google Scholar 

  18. Barthelmess, P., Oviatt, S.: Multimodal interfaces. In: HCI Beyond the GUI, pp. 391–444. Elsevier (2008). https://doi.org/10.1016/B978-0-12-374017-5.00012-2

    Chapter  Google Scholar 

  19. Dresh, A., Lacerda, D.P., Antunes, J.: Design Science Research: Método de Pesquisa para Avanço da Ciência e Tecnologia. Bookman, São Paulo (2015)

    Google Scholar 

  20. Qian, H., Kuber, R., Sears, A.: Towards developing perceivable tactile feedback for mobile devices. Int. J. Hum. Comput. Stud. 69(11), 705–719 (2011). https://doi.org/10.1016/j.ijhcs.2011.06.003

    Article  Google Scholar 

  21. Palani, H.P., Giudice, N.A.: Principles for designing large-format refreshable haptic graphics using touchscreen devices: an evaluation of nonvisual panning methods. ACM Trans. Access. Comput. 9(3), 1–25 (2017). https://doi.org/10.1145/3035537

    Article  Google Scholar 

  22. Palani, H.P., Giudice, G.B., Giudice, N.A.: Haptic information access using touchscreen devices: design guidelines for accurate perception of angular magnitude and line orientation (2018)

    Google Scholar 

  23. Palani, H.P., Tennison, J.L., Giudice, G.B., Giudice, N.A.: Touchscreen-based haptic information access for assisting blind and visually-impaired users: perceptual parameters and design guidelines. In: Ahram, T., Falcão, C. (eds.) Advances in Usability, User Experience and Assistive Technology, AHFE 2018. Advances in Intelligent Systems and Computing, vol. 794. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-94947-5_82

  24. Shimomura, Y., Hvannberg, E.T., Hafsteinsson, H.: Accessibility of audio and tactile interfaces for young blind people performing everyday tasks. Univ. Access Inf. Soc. 9(4), 297–310 (2010). https://doi.org/10.1007/s10209-009-0183-y

    Article  Google Scholar 

  25. Warnock, D., McGee-Lennon, M.R., Brewster, S.: The impact of unwanted multimodal notifications (2011)

    Google Scholar 

  26. de Oliveira, T.A.B.: Estímulos sensoriais: Potencialidade na interação de usuários cegos em painéis de eletrodomésticos (2018)

    Google Scholar 

  27. Raposo, N.O.: Elementos estruturantes para o projeto de interfaces multimodais, (2015)

    Google Scholar 

  28. Rezende, M.H.D.M.: Modelo do projetista e modelo do usuário no design de produtos: um estudo da atividade de lavar roupas (2014)

    Google Scholar 

  29. Aguiar, V.C. de: O desenvolvimento da usabilidade de interfaces em projetos - um estudo de caso em lavadora de roupa (2004)

    Google Scholar 

  30. Turunen, M., et al.: Accessible multimodal media center application for blind and partially sighted people. Comput. Entertain. 8(3), 1–30 (2010). https://doi.org/10.1145/1902593.1902595

    Article  Google Scholar 

  31. Coelho, J., Duarte, C.: The contribution of multimodal adaptation techniques to the GUIDE interface. In: Stephanidis, C. (ed.) UAHCI 2011. LNCS, vol. 6765, pp. 337–346. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21672-5_37

    Chapter  Google Scholar 

  32. Sullivan, H.T., Sahasrabudhe, S.: Envisioning inclusive futures: technology-based assistive sensory and action substitution. Futures 87, 140–148 (2017). https://doi.org/10.1016/j.futures.2016.06.006

    Article  Google Scholar 

  33. Oviatt, S., Schuller, B., Cohen, P.R., Sonntag, D., Potamianos, G., Krüger, A.: The Handbook of Multimodal-Multisensor Interfaces: Foundations, User Modeling, and Common Modality Combinations, vol. 1. ACM (2017)

    Google Scholar 

  34. Geronazzo, M., Bedin, A., Brayda, L., Campus, C., Avanzini, F.: Interactive spatial sonification for non-visual exploration of virtual maps. Int. J. Hum. Comput. Stud. 85, 4–15 (2016). https://doi.org/10.1016/j.ijhcs.2015.08.004

    Article  Google Scholar 

  35. Charoenchaimonkon, E., Janecek, P.: Characterizing non-visual target acquisition tasks with the aid of a tactile display: investigating factors beyond the classical Fitts’ theorem. Univ. Access Inf. Soc. 14, 459–475 (2015). https://doi.org/10.1007/s10209-014-0352-5

    Article  Google Scholar 

  36. Huang, P.-H., Chiu, M.-C.: Integrating user centered design, universal design and goal, operation, method and selection rules to improve the usability of DAISY player for persons with visual impairments. Appl. Ergon. 52, 29–42 (2016)

    Article  Google Scholar 

  37. Miñón, R., Moreno, L., Martínez, P., Abascal, J.: An approach to the integration of accessibility requirements into a user interface development method. Sci. Comput. Program. 86, 58–73 (2014). https://doi.org/10.1016/j.scico.2013.04.005

    Article  Google Scholar 

  38. Coelho, J., Duarte, C.: A literature survey on older adults’ use of social network services and social applications. Comput. Hum. Behav. 58, 187–205 (2016). https://doi.org/10.1016/j.chb.2015.12.053

    Article  Google Scholar 

Download references

Acknowledgments

This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior – Brasil (CAPES) – Finance Code 001.

Author information

Authors and Affiliations

  1. Federal University of Paraná, Curitiba, Brazil

    Dominique Leite Adam & Maria Lúcia Leite Ribeiro Okimoto

Authors
  1. Dominique Leite Adam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maria Lúcia Leite Ribeiro Okimoto
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute for Advanced Systems Engineering, University of Central Florida, Orlando, FL, USA

    Tareq Z. Ahram

  2. Doctorate Researcher in Design, Recife-PE, Brazil

    Christianne S. Falcão

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Adam, D.L., Okimoto, M.L.L.R. (2021). Multimodal Technology: Improving Accessibility of the Design of Home Appliances. In: Ahram, T.Z., Falcão, C.S. (eds) Advances in Usability, User Experience, Wearable and Assistive Technology. AHFE 2021. Lecture Notes in Networks and Systems, vol 275. Springer, Cham. https://doi.org/10.1007/978-3-030-80091-8_53

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-80091-8_53

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-80090-1

  • Online ISBN: 978-3-030-80091-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation