Skip to main content
SpringerLink
Log in

Handover Assist in Highly Automated Vehicles: How Vocal Communication Guides Visual Attention

  • Conference paper
  • First Online:
Advances in Human Aspects of Transportation (AHFE 2018)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 786))

Included in the following conference series:

Abstract

Automated vehicles that require human intervention will inevitably require the transition of control and responsibility between driver and automation. These ‘handovers’ represent a vulnerability in the driving system due to factors such as reduced situation awareness. As a solution, handover assistants have been proposed to alleviate these drawbacks and facilitate better communication between vehicle and driver. We present findings from a vocal-handover task between two drivers, conducted in a driving simulator, to explore how visually scanning the environment can be encouraged using different vocal interactions. The data revealed trends such as how mentioning location may encourage more efficient visual gaze. Conversely, no vocal interaction may result in little-to-no visual gaze towards certain areas of the driving environment. Further study could explore how vocal interaction can work in conjunction with visual displays to guide visual attention during the handover task.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Audi (2018). https://www.audi.co.uk/content/dam/audi/production/PDF/PriceAndSpecGuides/a8.pdf

  2. SAE On-road Automated Vehicles Standards Committee: Taxonomy and Definitions for Terms Related to On-Road Motor Vehicle Automated Driving Systems (2015). http://standards.sae.org/j3016_201401/

  3. Mccall, R., Mcgee, F., Meschtscherjakov, A., Louveton, N., Engel, T.: Towards a taxonomy of autonomous vehicle handover situations. In: Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 193–200. ACM, Ann Arbor (2016)

    Google Scholar 

  4. Endsley, M.R.: Measurement of situation awareness in dynamic systems. Hum. Factors 37(1), 65–84 (1995)

    Article  Google Scholar 

  5. De Winter, J.C.F., Happee, R., Martens, M.H., Stanton, N.A.: Effects of adaptive cruise control and highly automated driving on workload and situation awareness: a review of the empirical evidence. Transp. Res. Part F Traffic Psychol. Behav. 27, 196–217 (2014)

    Article  Google Scholar 

  6. Salmon, P.M., Stanton, N.A., Walker, G.H., Jenkins, D.P.: Distributed Situation Awareness. Ashgate, Farnham (2009)

    Google Scholar 

  7. Plocher, T., Yin, S.Q., Laberge, J., Thompson, B., Telner, J.: Effective shift handover. Eng. Psychol. Cogn. Ergon. 6781, 332–341 (2011)

    Article  Google Scholar 

  8. Pezzolesi, C., Manser, T., Schifano, F., Kostrzewski, A., Pickles, J., Harriet, N., Warren, I., Dhillon, S.: Human factors in clinical handover: development and testing of a ‘handover performance tool’ for doctors’ shift handovers. Int. J. Qual. Health Care 25, 58–65 (2013)

    Article  Google Scholar 

  9. Arora, V.M., Johnson, J.K., Meltzer, D.O., Humphrey, H.J.: A theoretical framework and competency-based approach to improving handoffs. Qual. Saf. Health Care 17(1), 11–14 (2013)

    Article  Google Scholar 

  10. Strand, N., Nilsson, J., Karlsson, I.C.M., Nilsson, L.: Semi-automated versus highly automated driving in critical situations caused by automation failures. Transp. Res. Part F Traffic Psychol. Behav. 27, 218–228 (2014)

    Article  Google Scholar 

  11. Walch, M., Lange, K., Baumann, M., Weber, M.: Autonomous driving: Investigating the feasibility of car-driver handover assistance. In: Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 11–18. ACM, USA (2015)

    Google Scholar 

  12. Koo, J., Kwac, J., Ju, W., Steinert, M., Leifer, L., Nass, C.: Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance. Int. J. Interact. Des. Manuf. 9(4), 269–275 (2015)

    Article  Google Scholar 

  13. Walch, M., Sieber, T., Hock, P., Baumann, M., Weber, M.: Towards cooperative driving: involving the driver in an autonomous vehicle’s decision making. In: Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 261–268. ACM, USA (2016)

    Google Scholar 

  14. Volvo Group (2015). https://www.youtube.com/watch?v=xYqtu39d3CU

  15. Eriksson, A., Banks, V.A., Stanton, N.A.: Transition to manual: comparing simulator with on-road control transitions. Accid. Anal. Prev. 102, 227–234 (2017)

    Article  Google Scholar 

  16. Reeves, B., Nass, C.: How People Treat Computers, Television, and New Media like Real People and Places. Cambridge University Press, Cambridge (1996)

    Google Scholar 

  17. Brennan, S.E., Clark, H.H.: Conceptual pacts and lexical choice in conversation. J. Exp. Psychol. Learn. Mem. Cogn. 22(6), 1482–1493 (1996)

    Article  Google Scholar 

  18. Coco, M.I., Dale, R., Keller, F.: Performance in a collaborative search task: The role of feedback and alignment. 10, pp. 55–79. Topics in cognitive science. (2017)

    Google Scholar 

  19. Garrod, S., Anderson, A.: Saying what you mean in dialogue: a study in conceptual and semantic co-ordination. Cognition 27(2), 181–218 (1987)

    Article  Google Scholar 

  20. Garrod, S., Pickering, M.J.: Joint action, interactive alignment, and dialog. Top. Cogn. Sci. 1(2), 292–304 (2009)

    Article  Google Scholar 

  21. Staudte, M., Crocker, M.W.: Visual attention in spoken human-robot interaction. In: 4th ACM/IEEE International Conference on Human-Robot Interaction, pp. 77–84. IEEE (2009)

    Google Scholar 

  22. Clark, H.H., Brennan, S.E.: Grounding in communication. Perspect. Soc. Shared Cogn. 13, 127–149 (1991)

    Article  Google Scholar 

  23. Hills, B.L.: Vision, visibility, and perception in driving. Perception 9(2), 183–216 (1980)

    Article  Google Scholar 

  24. Neale, V.L., Dingus, T.A., Klauer, S.G., Sudweeks, J., Goodman, M.: An overview of the 100-car naturalistic study and findings. In: Proceedings of the 19th International Technical Conference on the Enhanced Safety of Vehicles. National Highway Traffic Safety Administration, Washington, DC (2005)

    Google Scholar 

  25. Griffin, Z.M., Bock, K.: What the eyes say about speaking. Psychol. Sci. 11(4), 274–279 (2000)

    Article  Google Scholar 

  26. Meyer, A.S., Belke, E., Telling, A.L., Humphreys, G.W.: Early activation of object names in visual search. Psychon. Bull. Rev. 14(4), 710–716 (2007)

    Article  Google Scholar 

  27. Yang, H., Zelinsky, G.J.: Visual search is guided to categorically-defined targets. Vis. Res. 49(16), 2095–2103 (2009)

    Article  Google Scholar 

  28. Lupyan, G., Spivey, M.J.: Redundant spoken labels facilitate perception of multiple items. Attention, Percept. Psychophys. 72(8), 2236–2253 (2010)

    Article  Google Scholar 

  29. Treisman, A.M., Gelade, G.: A feature-integration theory of attention. Cogn. Psychol. 12(1), 97–136 (1980)

    Article  Google Scholar 

  30. Wolfe, J.M., Gray, W.: Guided search 4.0. Integrated models of cognitive systems, pp. 99–119 (2007)

    Google Scholar 

  31. Pereira, E.J., Castelhano, M.S.: Peripheral guidance in scenes: the interaction of scene context and object content. J. Exp. Psychol. Hum. Percept. Perform. 40(5), 2056–2072 (2014)

    Article  Google Scholar 

  32. Large, D.R., Clark, L., Quandt, A., Burnett, G., Skrypchuk, L.: Steering the conversation: a linguistic exploration of natural language interactions with a digital assistant during simulated driving. Appl. Ergon. 63, 53–61 (2017)

    Article  Google Scholar 

  33. Riesenberg, L.A., Leitzsch, J., Little, B.W.: Systematic review of handoff mnemonics literature. Am. J. Med. Qual. 24(196), 196–204 (2009)

    Article  Google Scholar 

  34. Institute of Advanced Motorists: How to Be an Advanced Driver: Pass Your Advanced Driving Test. IAM, London (2004)

    Google Scholar 

  35. Stanton, N.A., Walker, G.H., Young, M.S., Kazi, T., Salmon, P.M.: Changing drivers’ minds: the evaluation of an advanced driver coaching system. Ergonomics 50(8), 1209–1234 (2007)

    Article  Google Scholar 

  36. Walker, G.H., Stanton, N.A., Baber, C., Wells, L., Gibson, H., Salmon, P., Jenkins, D.: From ethnography to the EAST method: a tractable approach for representing distributed cognition in air traffic control. Ergonomics 53(2), 184–197 (2010)

    Article  Google Scholar 

  37. Wilkinson, J., Lardner, R.: Pass it on! Revisiting shift handover after buncefield. Hazards XXIII Symp. Ser. 158, 108–116 (2012)

    Google Scholar 

  38. Boyd, M., Cumin, D., Lombard, B., Torrie, J., Civil, N., Weller, J.: Read-back improves information transfer in simulated clinical crises. BMJ Q. Saf. 23(12), 989–993 (2014)

    Article  Google Scholar 

  39. Bickmore, T., Cassell, J.:Relational agents: a model and implementation of building user trusted. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 396–403. ACM, USA (2012)

    Google Scholar 

  40. Rayo, M.F., Mount-Campbell, A.F., O’brien, J.M., White, S.E., Butz, A., Evans, K., Patterson, E.S.: Interactive questioning in critical care during handovers: a transcript analysis of communication behaviours by physicians, nurses and nurse practitioners. BMJ Q. Saf. 23(6), 483–489 (2014)

    Google Scholar 

Download references

Acknowledgements

This work was supported by Jaguar Land Rover and the UK-EPSRC grant EP/N011899/1 as part of the jointly funded Towards Autonomy: Smart and Connected Control (TASCC) Programme.

Author information

Authors and Affiliations

  1. Human Factors Engineering, University of Southampton, Building 176, Boldrewood Innovation Campus, Burgess Road, Southampton, SO16 7QF, UK

    Jediah Clark, Neville Stanton & Kirsten Revell

Authors
  1. Jediah Clark
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Neville Stanton
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kirsten Revell
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jediah Clark .

Editor information

Editors and Affiliations

  1. Faculty of Engineering and the Environment, Transportation Research Group, University of Southampton, Southampton, UK

    Neville Stanton

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Clark, J., Stanton, N., Revell, K. (2019). Handover Assist in Highly Automated Vehicles: How Vocal Communication Guides Visual Attention. In: Stanton, N. (eds) Advances in Human Aspects of Transportation. AHFE 2018. Advances in Intelligent Systems and Computing, vol 786. Springer, Cham. https://doi.org/10.1007/978-3-319-93885-1_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-93885-1_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-93884-4

  • Online ISBN: 978-3-319-93885-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation