Abstract
Brain computer interface (BCI) technology is an alternate communication option for individuals with neuromuscular impairments. There are several challenges to optimal BCI use including positioning of the screen, ease of use, independence in access, and calibration. Our study is directed at the development of a practical, accessible, at-home use BCI system that addresses these obstacles. Our design utilizes an augmented reality (AR) head-mounted display as a solution to provide BCI stimuli and output. We used a battery-operated Bluetooth-connected 8-channel portable EEG system and a custom P300 selection matrix displaying icons corresponding to various home control actions. Finally, the BCI system is integrated with a built-in smart assistant (Google Assistant) which allows the user to control their environment. In this paper, we describe the engineering of this home-use BCI system designed specifically for people with Amyotrophic Lateral Sclerosis, a neuromuscular disease causing severe motor deficits and loss of mobility.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Shih, J.J., Krusienski, D.J., Wolpaw, J.R.: Brain-computer interfaces in medicine. Mayo. Clin. Proc. 87, 268–279 (2012)
Farwell, L.A., Donchin, E.: Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr. Clin. Neurophysiol. 70, 510–523 (1988)
Fazel-Rezai, R., Allison, B.Z., Guger, C., Sellers, E.W., Kleih, S.C., Kübler, A.: P300 brain computer interface: current challenges and emerging trends. Front. Neuroeng. 5, 14 (2012)
Li, F., et al.: Different contexts in the oddball paradigm induce distinct brain networks in generating the P300. Front. Hum. Neurosci. 12, 520 (2018)
Brown, R.H., Al-Chalabi, A.: Amyotrophic lateral sclerosis. New England J. Med. 377(2), 162–172 (2017)
Zhang, R., et al.: A BCI-based environmental control system for patients with severe spinal cord injuries. IEEE Trans. Biomed. Eng. 64, 1959–1971 (2017)
Kosmyna, N., Tarpin-Bernard, F., Bonnefond, N., Rivet, B.: Feasibility of BCI control in a realistic smart home environment. Front. Hum. Neurosci. 10, 1–10 (2016)
Ou, C.-Z., Lin, B.-S., Chang, C.-J., Lin, C.-T.: Brain computer interface-based smart environmental control system. In: 2012 Eighth International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Piraeus, pp. 281–284 (2012)
Soofi, A.Y., Kho, M.E., Bello-Haas, V.D., Letts, L.: The impact of rehabilitation interventions on quality of life in individuals with amyotrophic lateral sclerosis: a systematic review. Int. J. Neurodegener. Dis. 27(4), 845–856 (2017)
Brumberg, J.S., Pitt, K.M., Mantie-Kozlowski, A., Burnison, J.D.: Brain-computer interfaces for augmentative and alternative communication: a tutorial. Am. J. Speech. Lang. Pathol. 27, 1–12 (2018)
Lotte, F.: Signal processing approaches to minimize or suppress calibration time in oscillatory activity-based brain-computer interfaces. Proc. IEEE 103, 871–890 (2015)
Burakgazi, A.Z., Richardson, P.K., Abu-Rub, M.: Dropped head syndrome due to neuromuscular disorders: Clinical manifestation and evaluation. Neurol. Int. 11, 8198 (2019)
Parekh, P., Patel, S., Patel, N., Shah, M.: Systematic review and meta-analysis of augmented reality in medicine, retail, and games. Vis. Comput. Ind. Biomed. Art 3(1), 1–20 (2020). https://doi.org/10.1186/s42492-020-00057-7
Jurcak, V., Tsuzuki, D., Dan, I.: 10/20, 10/10, and 10/5 systems revisited: their validity as relative head-surface-based positioning systems. Neuroimage 34, 1600–1611 (2007)
Mellinger, J. Schalk, G.: BCI2000: a general-purpose software platform for BCI research. In: Dornhege, G, Millán, J.R., Hinterberger, T., McFarland, D.J., Müller, K.-R. (eds.) Toward Brain-Computer Interfacing. MIT Press (2007)
National Center for Adaptive Neurotechnologies, BCI2000 User Reference Manual - P300 Classifier. www.bci2000.org/mediawiki/index.php/User_Reference:P300Classifier
Curtin, A., Ayaz, H., Yichuan, L., Shewokis, P.A., Onaral, B.: A P300-based EEG-BCI for spatial navigation control. IEEE Eng. Med. Biol. Soc. (EMBC) 2012, 3841–3844 (2012)
Jin, J., et al.: The study of generic model set for reducing calibration time in P300-based brain-computer interface. IEEE Trans. Neural Syst. Rehabil. Eng. 28, 3–12 (2020)
Yuan, J., Liberman, M., Cieri, C.: Towards an integrated understanding of speaking rate in conversation. In: International Conference on Spoken Language Processing (2006)
Mattout, J., Perrin, M., Bertrand, O., Maby, E.: Improving BCI performance through co-adaption: applications to the P300-speller. Ann. Phys. Rehabil. Med. 58, 23–28 (2015)
Acknowledgments
We would like to acknowledge the ALS Hope Foundation and all of the students who contributed to the development process: M. Miah, Z. Acosta, R. Chen, M. Gomba, A. John, A. Guiliano.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Sahal, M., Dryden, E., Halac, M., Feldman, S., Heiman-Patterson, T., Ayaz, H. (2021). Augmented Reality Integrated Brain Computer Interface for Smart Home Control. In: Ayaz, H., Asgher, U., Paletta, L. (eds) Advances in Neuroergonomics and Cognitive Engineering. AHFE 2021. Lecture Notes in Networks and Systems, vol 259. Springer, Cham. https://doi.org/10.1007/978-3-030-80285-1_11
Download citation
DOI: https://doi.org/10.1007/978-3-030-80285-1_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-80284-4
Online ISBN: 978-3-030-80285-1
eBook Packages: EngineeringEngineering (R0)