Abstract
Mental overload and mental fatigue are two degraded cognitive states that are known to promote cognitive incapacitation. We adopted a neuroergonomics approach to investigate these states that remain difficult to induce under laboratory settings thus impeding their measurement. Two experiments were conducted under real flight conditions to respectively measure the electrophysiological correlates of mental fatigue and mental overload with a 32 channel-dry EEG system. Our findings revealed that the occurrence of mental fatigue was related to higher theta and alpha band power. Mental overload was associated with higher beta band power over frontal sites. We performed single trial classification to detect mental fatigue and over-load states. Classification accuracy reached 76.9% and 89.1%, respectively, in discriminating mental fatigue vs. no fatigue and mental overload vs. low-high load. These preliminary results provide evidence for the feasibility of detecting neural correlates of cognitive fatigue and load during real flight conditions and provide promising perspectives on the implementation of neuroadaptive technology especially in the context of single pilot-operation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Gateau, T., Ayaz, H., Dehais, F.: In silico versus over the clouds: on-the-fly mental state estimation of aircraft pilots, using a functional near infrared spectroscopy based passive-BCI. Front. Hum. Neurosci. 12, 187 (2018)
Wickens, C.D., Dehais, F.: Expertise in Aviation (2019)
Somon, B., Campagne, A., Delorme, A., Berberian, B.: Performance monitoring applied to system supervision. Front. Hum. Neurosci. 11, 360 (2017)
Baddeley, A.D., Hitch, G.: Working memory. In: Bower, G.A. (ed.) Recent Advances in Learning and Motivation, vol. 8 (1974)
Harrivel, A.R., Weissman, D.H., Noll, D.C., Peltier, S.J.: Monitoring attentional state with fNIRS. Front. Hum. Neurosci. 7, 861 (2013)
Dehais, F., et al.: Momentary lapse of control: a cognitive continuum approach to understanding and mitigating perseveration in human error. Neurosci. Biobehav., Rev (2019)
Hettinger, L.J., Branco, P., Encarnacao, L.M., Bonato, P.: Neuroadaptive technologies: applying neuroergonomics to the design of advanced interfaces. Theor. Issues Ergon. Sci. 4, 220–237 (2003)
Liu, J., Gardi, A., Ramasamy, S., Lim, Y., Sabatini, R.: Cognitive pilot-aircraft interface for single-pilot operations. Knowl.-Based Syst. 112, 37–53 (2016)
Roy, R.N., Bonnet, S., Charbonnier, S., Campagne, A.: Mental fatigue and working memory load estimation: interaction and implications for EEG-based passive BCI. In: 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 6607–6610. IEEE (2013)
Borghini, G., Astolfi, L., Vecchiato, G., Mattia, D., Babiloni, F.: Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci. Biobehav. Rev. 44, 58–75 (2014)
Durantin, G., Gagnon, J.-F., Tremblay, S., Dehais, F.: Using near infrared spectroscopy and heart rate variability to detect mental overload. Behav. Brain Res. 259, 16–23 (2014)
Ewing, K.C., Fairclough, S.H., Gilleade, K.: Evaluation of an adaptive game that uses EEG measures validated during the design process as inputs to a biocybernetic loop. Front. Hum. Neurosci. 10, 223 (2016)
Fairclough, S.H., Burns, C., Kreplin, U.: FNIRS activity in the prefrontal cortex and motivational intensity: impact of working memory load, financial reward, and correlation-based signal improvement. Neurophotonics 5, 035001 (2018)
Ayaz, H., Dehais, F.: Neuroergonomics: The Brain at Work and in Everyday Life. Academic Press, Cambridge (2018)
Callan, D.E., Gateau, T., Durantin, G., Gonthier, N., Dehais, F.: Disruption in neural phase synchrony is related to identification of inattentional deafness in real-world setting. Hum. Brain Map. 39(6), 2596–2608 (2018)
Dehais, F., Roy, R. N., Durantin, G., Gateau, T., Callan, D.: EEG-engagement index and auditory alarm misperception: an inattentional deafness study in actual flight condition (2017)
Callan, D., Durantin, G., Terzibas, C.: Classification of single-trial auditory events using dry-wireless EEG during real and motion simulated flight. Front. Syst. Neurosci. 9, 11 (2015)
Dehais, F., et al.: A pBCI to predict attentional error before it happens in real flight conditions. In: 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), pp. 4155–4160. IEEE (2019)
Dehais, F., et al.: Monitoring pilot’s cognitive fatigue with engagement features in simulated and actual flight conditions using an hybrid fNIRS-EEG passive BCI. In: 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 544–549. IEEE (2018)
Dehais, F., et al.: Monitoring pilot’s mental workload using ERPs and spectral power with a six-dry-electrode EEG System in real flight conditions. Sensors 19, 1324 (2019)
Mullen, T., et al.: Real-time modeling and 3D visualization of source dynamics and connectivity using wearable EEG. In: 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 2184–2187. IEEE (2013)
Lotte, F.: Signal processing approaches to minimize or suppress calibration time in oscillatory activity-based brain–computer interfaces. Proc. IEEE 103, 871–890 (2015)
Okogbaa, O.G., Shell, R.L., Filipusic, D.: On the investigation of the neurophysiological correlates of knowledge worker mental fatigue using the EEG signal. Appl. Ergon. 25, 355–365 (1994)
Dehais, F., Callan, D.E.: A neuroergonomics approach to human performance in aviation. Improving aviation performance through applying engineering psychology. Adv. Aviat. Psychol. 3, 123 (2019)
Acknowledgments
This study was supported by AID (Agence Innovation de la Défense) and ANITI ANR-19-PI3A-0004 and the AXA research fund (Neuroergonomics chair).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Dehais, F., Somon, B., Mullen, T., Callan, D.E. (2021). A Neuroergonomics Approach to Measure Pilot’s Cognitive Incapacitation in the Real World with EEG. In: Ayaz, H., Asgher, U. (eds) Advances in Neuroergonomics and Cognitive Engineering. AHFE 2020. Advances in Intelligent Systems and Computing, vol 1201. Springer, Cham. https://doi.org/10.1007/978-3-030-51041-1_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-51041-1_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-51040-4
Online ISBN: 978-3-030-51041-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)