Skip to main content
SpringerLink
Log in

Research on the Brain Mechanism of Visual-Audio Interface Channel Modes Affecting User Cognition

  • Conference paper
  • First Online:
Advances in Neuroergonomics and Cognitive Engineering (AHFE 2018)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 775))

Included in the following conference series:

Abstract

In multi-channel design, the combination of visual-audio dual channels is the most widely used way. This article elaborated on the characteristics of visual and audio channel, clarified the complementary relationship between visual and audio channels, and analysed the combination methods of visual and audio channels. EEG/ERP technology was used to carry out experiments and some alarm information designs of a real-time monitoring software system were used as an example to compare the cognitive differences caused by the combination of visual and audio channels’ combination. Through the quantitative analysis of indicators such as reaction time, brain wave peak value, and latency, the interface information design and evaluation methods for visual-audio dual channels were developed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Li, T., Wang, D., Peng, C., Yu, C., Zhang, Y.: Speed-accuracy tradeoff of fingertip force control with visual/audio/haptic feedback. Int. J. Hum. Comput. Stud. 110, 33–44 (2018)

    Article  Google Scholar 

  2. Grega, J., Christina, D., Jaka, S.: A user study of auditory, head-up and multi-modal displays in vehicles. Appl. Ergon., Part A 46, 184–192 (2015)

    Article  Google Scholar 

  3. Andrea, B., Ian, O., Dong, S.K.: Counting clicks and beeps: exploring numerosity based haptic and audio PIN entry. Interact. Comput. 24(5), 409–422 (2012)

    Article  Google Scholar 

  4. Hans-Jörg, S., Steffen, H.: Preset-based generation and exploration of visualization designs. J. Vis. Lang. Comput., Part A 31, 9–29 (2015)

    Article  Google Scholar 

  5. Abbate, A.J., Bass, E.J.: A formal methods approach to semiotic engineering. Int. J. Hum. Comput. Stud. 115, 20–39 (2018)

    Article  Google Scholar 

  6. Hooten, E.R., Hayes, S.T., Julie, A.A.: Communicative modalities for mobile device interaction. Int. J. Hum. Comput. Stud. 71(10), 988–1002 (2013)

    Article  Google Scholar 

  7. Antonio, M.R.: A multimedia ontology model based on linguistic properties and audio-visual features. Inf. Sci. 277, 234–246 (2014)

    Article  Google Scholar 

  8. Timothy, E.R., Ian, P., David, D.: Toward mobile entertainment: A paradigm for narrative-based audio only games. Sci. Comput. Program. 67(1), 76–90 (2007)

    Article  MathSciNet  Google Scholar 

  9. Gabrielle, L.H., Eric, L., Cara, E.S.: Effects of augmentative visual training on audio-motor mapping. Hum. Mov. Sci. 35, 145–155 (2014)

    Article  Google Scholar 

  10. Jeffrey Jr., L.C., Robert, H.G., Brian, D.S.: The VERITAS facility: a virtual environment platform for human performance research. IFAC Proc. 46(15), 357–362 (2013)

    Article  Google Scholar 

Download references

Acknowledgments

This paper is supported by Science and Technology on Avionics Integration Laboratory and Aeronautical Science Fund (No. 20165569019).

Author information

Authors and Affiliations

  1. Science and Technology on Avionics Integration Laboratory, Chinese Aeronautical Radio Electronics Research Institute (CARERI), 432 Gui Ping Road, Shanghai, China

    Wenqing Xi & Huijuan Chen

  2. School of Mechanical Engineering, Southeast University, 2 Dong Nan Da Xue Road, Jiangning District, Nanjing, China

    Lei Zhou, Jian Ma & Yueting Chen

Authors
  1. Wenqing Xi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lei Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Huijuan Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jian Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yueting Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lei Zhou .

Editor information

Editors and Affiliations

  1. Drexel University, Philadelphia, Pennsylvania, USA

    Hasan Ayaz

  2. University of North Carolina-Chapel Hill, Chapel Hill, North Carolina, USA

    Lukasz Mazur

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Xi, W., Zhou, L., Chen, H., Ma, J., Chen, Y. (2019). Research on the Brain Mechanism of Visual-Audio Interface Channel Modes Affecting User Cognition. In: Ayaz, H., Mazur, L. (eds) Advances in Neuroergonomics and Cognitive Engineering. AHFE 2018. Advances in Intelligent Systems and Computing, vol 775. Springer, Cham. https://doi.org/10.1007/978-3-319-94866-9_20

Download citation

Publish with us

Policies and ethics

Search

Navigation