Skip to main content
SpringerLink
Log in

Neurofeedback for Personalized Adaptive Training

  • Conference paper
  • First Online:
Advances in Neuroergonomics and Cognitive Engineering (AHFE 2017)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 586))

Included in the following conference series:

Abstract

Learning of complex skills can be enhanced if the training can adapt to the learner. Earlier studies utilized behavioral performance based adaptation; however, behavioral performance assessment is limited and does not take into account the mental effort and the brain plasticity changes during the acquisition of complex skills. In this study, we utilized objective brain based measures for the assessment and adaptation of a four-day training program with three piloting tasks on four participants using a low fidelity flight simulator. Functional near-infrared spectroscopy (fNIRS) from prefrontal cortex was measured to adapt the difficulty levels of the training trials of the tasks with the aim of optimizing the cognitive workload. Participants also performed reference practice trials that had the same difficulty across sessions. Preliminary results identified specific brain areas within prefrontal cortex for each reference tasks that corroborates earlier task practice studies. Furthermore, the same brain areas were responsive to the adaptive training trials as well. The results overall suggest task specific brain areas are coupled with the behavioral performance. This study outlines a new neurofeedback based training paradigm using the wearable and portable fNIRS. Future uses of such personalized training could help prevent unnecessary over-training or insufficient under-training.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Hancock, P.A., Parasuraman, R.: Human factors and safety in the design of intelligent vehicle-highway systems (IVHS). J. Saf. Res. 23, 181–198 (1992)

    Article  Google Scholar 

  2. Hancock, P.A., Verwey, W.B.: Fatigue, workload and adaptive driver systems. Accid. Anal. Prev. 29, 495–506 (1997)

    Article  Google Scholar 

  3. Parasuraman, R., Wilson, G.F.: Putting the brain to work: neuroergonomics past, present, and future. Hum. Factors 50, 468–474 (2008)

    Article  Google Scholar 

  4. Parasuraman, R., Christensen, J., Grafton, S.: Neuroergonomics: the brain in action and at work. Neuroimage 59, 1–3 (2012)

    Article  Google Scholar 

  5. Parasuraman, R.: Neuroergonomics. Curr. Dir. Psychol. Sci. 20, 181–186 (2011)

    Article  Google Scholar 

  6. Leff, D.R., Orihuela-Espina, F., Elwell, C.E., Athanasiou, T., Delpy, D.T., Darzi, A.W., Yang, G.-Z.: Assessment of the cerebral cortex during motor task behaviours in adults: a systematic review of functional near infrared spectroscopy (fNIRS) studies. NeuroImage 54, 2922–2936 (2011)

    Article  Google Scholar 

  7. Prakash, R.S., De Leon, A.A., Mourany, L., Lee, H., Voss, M.W., Boot, W.R., Basak, C., Fabiani, M., Gratton, G., Kramer, A.F.: Examining neural correlates of skill acquisition in a complex videogame training program. Front. Hum. Neurosci. 6, 115 (2012)

    Article  Google Scholar 

  8. Ayaz, H., Onaral, B., Izzetoglu, K., Shewokis, P.A., McKendrick, R., Parasuraman, R.: Continuous monitoring of brain dynamics with functional near infrared spectroscopy as a tool for neuroergonomic research: empirical examples and a technological development. Front. Hum. Neurosci. 7, 1–13 (2013)

    Article  Google Scholar 

  9. Ayaz, H., Çakir, M.P., Izzetoglu, K., Curtin, A., Shewokis, P.A., Bunce, S.C., Onaral, B.: Monitoring expertise development during simulated UAV piloting tasks using optical brain imaging. In: 2012 IEEE Aerospace Conference, pp. 1–11 (2012)

    Google Scholar 

  10. Ayaz, H., Onaral, B., Izzetoglu, K., Shewokis, P.A., McKendrick, R., Parasuraman, R.: Continuous monitoring of brain dynamics with functional near infrared spectroscopy as a tool for neuroergonomic research: empirical examples and a technological development. Front. Hum. Neurosci. 7, 871 (2013)

    Article  Google Scholar 

  11. McKendrick, R., Ayaz, H., Olmstead, R., Parasuraman, R.: Enhancing dual-task performance with verbal and spatial working memory training: continuous monitoring of cerebral hemodynamics with NIRS. NeuroImage 85(Part 3), 1014–1026 (2014)

    Article  Google Scholar 

  12. Wickens, C.D., Hutchins, S., Carolan, T., Cumming, J.: Effectiveness of part-task training and increasing-difficulty training strategies: a meta-analysis approach. Hum. Factors 55, 461–470 (2013)

    Article  Google Scholar 

  13. Yuksel, B.F., Oleson, K.B., Harrison, L., Peck, E.M., Afergan, D., Chang, R., Jacob, R.J.: Learn piano with BACh: an adaptive learning interface that adjusts task difficulty based on brain state. In: CHI 2016 (2016)

    Google Scholar 

  14. Ayaz, H., Willems, B., Bunce, S., Shewokis, P.A., Izzetoglu, K., Hah, S., Deshmukh, A., Onaral, B.: Estimation of cognitive workload during simulated air traffic control using optical brain imaging sensors. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) Foundations of Augmented Cognition. Proceedings of the 6th International Conference on Directing the Future of Adaptive Systems, FAC 2011, Held as Part of HCI International 2011, Orlando, FL, USA, 9–14 July 2011, pp. 549–558. Springer, Heidelberg (2011)

    Google Scholar 

  15. Solovey, E.T., Zec, M., Garcia Perez, E.A., Reimer, B., Mehler, B.: Classifying driver workload using physiological and driving performance data: two field studies. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems, pp. 4057–4066. ACM (2014)

    Google Scholar 

  16. Shewokis, P., Ayaz, H., Izzetoglu, M., Bunce, S., Gentili, R., Sela, I., Izzetoglu, K., Onaral, B.: Brain in the loop: assessing learning using fNIR in cognitive and motor tasks. In: Schmorrow, D., Fidopiastis, C. (eds.) Foundations of Augmented Cognition. Directing the Future of Adaptive Systems, vol. 6780, pp. 240-249. Springer, Heidelberg (2011)

    Google Scholar 

  17. Rypma, B., Berger, J.S., Prabhakaran, V., Martin Bly, B., Kimberg, D.Y., Biswal, B.B., D’Esposito, M.: Neural correlates of cognitive efficiency. NeuroImage 33, 969–979 (2006)

    Article  Google Scholar 

  18. Neubauer, A.C., Fink, A.: Intelligence and neural efficiency. Neurosci. Biobehav. Rev. 33, 1004–1023 (2009)

    Article  Google Scholar 

  19. Sibi, S., Ayaz, H., Kuhns, D.P., Sirkin, D.M., Ju, W.: Monitoring driver cognitive load using functional near infrared spectroscopy in partially autonomous cars. In: 2016 IEEE Intelligent Vehicles Symposium (IV), pp. 419–425 (2016)

    Google Scholar 

  20. Afergan, D., Peck, E.M., Solovey, E.T., Jenkins, A., Hincks, S.W., Brown, E.T., Chang, R., Jacob, R.J.K.: Dynamic difficulty using brain metrics of workload. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems, Toronto, Ontario, Canada, pp. 3797–3806. ACM (2014)

    Google Scholar 

  21. Bunce, S.C., Izzetoglu, K., Ayaz, H., Shewokis, P., Izzetoglu, M., Pourrezaei, K., Onaral, B.: Implementation of fNIRS for monitoring levels of expertise and mental workload. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) Foundations of Augmented Cognition. Proceedings of the 6th International Conference on Directing the Future of Adaptive Systems, FAC 2011, Held as Part of HCI International 2011, Orlando, FL, USA, 9–14 July 2011, pp. 13–22. Springer, Heidelberg (2011)

    Google Scholar 

  22. Ayaz, H., Shewokis, P.A., Bunce, S., Onaral, B.: An optical brain computer interface for environmental control. In: 2011 IEEE Proceedings of the Conference on Engineering in Medicine and Biology Society, pp. 6327–6330 (2011)

    Google Scholar 

  23. Mckendrick, R., Parasuraman, R., Murtza, R., Formwalt, A., Baccus, W., Paczynski, M., Ayaz, H.: Into the wild: neuroergonomic differentiation of hand-held and augmented reality wearable displays during outdoor navigation with functional near infrared spectroscopy. Front. Hum. Neurosci. 10, 216 (2016). doi:10.3389/fnhum.2016.00216

    Article  Google Scholar 

  24. McKendrick, R., Mehta, R., Ayaz, H., Scheldrup, M., Parasuraman, R.: Prefrontal hemodynamics of physical activity and environmental complexity during cognitive work. Hum. Factors 59, 147–162 (2017)

    Article  Google Scholar 

  25. Ayaz, H., Shewokis, P.A., Bunce, S., Izzetoglu, K., Willems, B., Onaral, B.: Optical brain monitoring for operator training and mental workload assessment. Neuroimage 59, 36–47 (2012)

    Article  Google Scholar 

  26. Durantin, G., Dehais, F., Delorme, A.: Characterization of mind wandering using fNIRS. Front. Syst. Neurosci. 9, 45 (2015)

    Article  Google Scholar 

  27. Gateau, T., Durantin, G., Lancelot, F., Scannella, S., Dehais, F.: Real-time state estimation in a flight simulator using fNIRS. PLoS One 10, e0121279 (2015)

    Article  Google Scholar 

  28. Mandrick, K., Chua, Z., Causse, M., Perrey, S., Dehais, F.: Why a comprehensive understanding of mental workload through the measurement of neurovascular coupling is a key issue for neuroergonomics? Front. Hum. Neurosci. 10, 250 (2016)

    Article  Google Scholar 

  29. Herff, C., Heger, D., Fortmann, O., Hennrich, J., Putze, F., Schultz, T.: Mental workload during n-back task-quantified in the prefrontal cortex using fNIRS. Front. Hum. Neurosci. 7, 935 (2013)

    Google Scholar 

  30. Choe, J., Coffman, B.A., Bergstedt, D.T., Ziegler, M., Phillips, M.E.: Transcranial direct current stimulation modulates neuronal activity and learning in pilot training. Front. Hum. Neurosci. 10, 34 (2016). doi:10.3389/fnhum.2016.00034

    Article  Google Scholar 

  31. Ayaz, H., Shewokis, P.A., Curtin, A., Izzetoglu, M., Izzetoglu, K., Onaral, B.: Using mazesuite and functional near infrared spectroscopy to study learning in spatial navigation. J. Vis. Exp. (56), 3443 (2011). doi:10.3791/3443

  32. Mandrick, K., Derosiere, G., Dray, G., Coulon, D., Micallef, J.-P., Perrey, S.: Utilizing slope method as an alternative data analysis for functional near-infrared spectroscopy-derived cerebral hemodynamic responses. Int. J. Ind. Ergon. 43, 335–341 (2013)

    Article  Google Scholar 

  33. Yumie, O., Jack Adam, N., Xian, Z., Yasunori, N., Tatsuya, S., Sotaro, S., Atsumichi, T., Shaw, B., Joy, H.: Motor learning and modulation of prefrontal cortex: an fNIRS assessment. J. Neural Eng. 12, 066004 (2015)

    Article  Google Scholar 

  34. Hernandez-Meza, G., Slason, L., Ayaz, H., Craven, P., Oden, K., Izzetoglu, K.: Investigation of functional near infrared spectroscopy in evaluation of pilot expertise acquisition. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) Foundations of Augmented Cognition, vol. 9183, pp. 232–243. Springer, Heidelberg (2015)

    Google Scholar 

  35. Harrison, J., Izzetoglu, K., Ayaz, H., Willems, B., Hah, S., Ahlstrom, U., Woo, H., Shewokis, P.A., Bunce, S.C., Onaral, B.: Cognitive workload and learning assessment during the implementation of a next-generation air traffic control technology using functional near-infrared spectroscopy. IEEE Trans. Hum.-Mach. Syst. 44, 429–440 (2014)

    Article  Google Scholar 

Download references

Acknowledgments

This investigation was in part funded by Lockheed Martin. The views, opinions, and/or findings contained in this article are those of the authors and should not be interpreted as representing the official views or policies, either expressed or implied, of the funding agency.

Author information

Authors and Affiliations

  1. School of Biomedical Engineering, Science, and Health Systems, Drexel University, Philadelphia, PA, USA

    Jesse Mark, Neha Thomas & Hasan Ayaz

  2. Advanced Technology Laboratories, Lockheed Martin, Arlington, VA, USA

    Amanda Kraft, William D. Casebeer & Matthias Ziegler

  3. Department of Family and Community Health, University of Pennsylvania, Philadelphia, PA, USA

    Hasan Ayaz

  4. Division of General Pediatrics, Children’s Hospital of Philadelphia, Philadelphia, PA, USA

    Hasan Ayaz

Authors
  1. Jesse Mark
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Neha Thomas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Amanda Kraft
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. William D. Casebeer
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Matthias Ziegler
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hasan Ayaz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hasan Ayaz .

Editor information

Editors and Affiliations

  1. Department of Psychology, Human Factors and Applied Cognition, George Mason University, Fairfax, Virginia, USA

    Carryl Baldwin

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Cite this paper

Mark, J., Thomas, N., Kraft, A., Casebeer, W.D., Ziegler, M., Ayaz, H. (2018). Neurofeedback for Personalized Adaptive Training. In: Baldwin, C. (eds) Advances in Neuroergonomics and Cognitive Engineering. AHFE 2017. Advances in Intelligent Systems and Computing, vol 586. Springer, Cham. https://doi.org/10.1007/978-3-319-60642-2_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-60642-2_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-60641-5

  • Online ISBN: 978-3-319-60642-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation