Abstract
Visual communication, and especially that based on gestures, can be an alternative to radio-based command and control links to small unmanned aerial vehicles (UAVs). In order to allow this natural form of communication to be an equivalent substitute to a conventional data link with regard to the efficient transfer of task data, the human-UAV-interaction must consist of as few gestural parameters as possible to keep the mental load for the user low, but at the same time provide enough information for the UAV to estimate the users intention. For this purpose, an experimental study under laboratory conditions with N = 20 German-speaking participants has been conducted to generate a dataset with 120 verbal formulations for six common UAV related tasks. The collected data has been evaluated regarding the distribution of sentences, words and parts of speech. Results indicate that users prefer short task descriptions prioritizing verbs and nouns (84.15%) with a mean number of 2.55 (SD = 1.57) words per sentence. All tasks considered were described with an average of 1.73 sentences (SD = 1.00). A slot filling approach is presented to map parameters in user intents.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Schelle, A., Stütz, P.: Gestural transmission of tasking information to an airborne UAV. In: Yamamoto, S., Mori, H. (eds.) HIMI 2018. LNCS, vol. 10904, pp. 318–335. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-92043-6_27
Peshkova, E., et al.: Exploring intuitiveness of metaphor-based gestures for UAV navigation. In: 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Lisbon, pp. 175–182. IEEE (2017). https://doi.org/10.1109/ROMAN.2017.8172298
Sanders, B., Vincenzi, D., Shen, Y.: Investigation of Gesture Based UAV Control. In: Chen, J. (ed.) Advances in Human Factors in Robots and Unmanned Systems. Advances in Intelligent Systems and Computing, vol. 595, pp. 205–215. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-60384-1_20
Chandarana, M., et al.: A natural interaction interface for UAVs using intuitive gesture recognition. In: Savage-Knepshield, P., Chen, J. (eds.) Advances in Human Factors in Robots and Unmanned Systems. Advances in Intelligent Systems and Computing, vol. 499, pp. 387–398. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-41959-6_32
Xu, P.: Gesture-based Human-robot Interaction for Field Programmable Autonomous Underwater Robots. arXiv preprint arXiv:1709.08945 (2017)
Coucke, A., et al.: Snips Voice Platform: An embedded Spoken Language Understanding system for private-by-design voice interfaces (2018). http://arxiv.org/pdf/1805.10190v3
McTear, M., Callejas, Z., Griol, D.: The Conversational Interface. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-32967-3
Loper, E., Bird, S.: NLTK: The Natural Language Toolkit (2002). http://arxiv.org/pdf/cs/0205028v1
Kiss, T., Strunk, J.: Unsupervised multilingual sentence boundary detection. Comput. Linguist. 32, 485 (2006). https://doi.org/10.1162/coli.2006.32.4.485
Taylor, A., Marcus, M., Santorini, B.: The Penn Treebank: An Overview. In: Ide, N., Véronis, J., Abeillé, A. (eds.) Treebanks. Text, Speech and Language Technology, vol. 20, pp. 5–22. Springer Netherlands, Dordrecht (2003). https://doi.org/10.1007/978-94-010-0201-1_1
Wartena, C.: A Probabilistic Morphology Model for German Lemmatization (2019)
Petrov, S., Das, D., McDonald, R.: A Universal Part-of-Speech Tagset. http://arxiv.org/pdf/1104.2086v1 (2011)
Bibliographisches Institut GmbH: Die Verteilung der Wortarten im Rechtschreibduden (2020). https://cdn.duden.de/public_files/2020-10/Verteilung-der-Wortarten_2020.svg. Accessed 22 Jan 2021
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Schelle, A., Stütz, P. (2021). Visual Communication with UAS: Estimating Parameters for Gestural Transmission of Task Descriptions. In: Zallio, M., Raymundo Ibañez, C., Hernandez, J.H. (eds) Advances in Human Factors in Robots, Unmanned Systems and Cybersecurity. AHFE 2021. Lecture Notes in Networks and Systems, vol 268. Springer, Cham. https://doi.org/10.1007/978-3-030-79997-7_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-79997-7_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-79996-0
Online ISBN: 978-3-030-79997-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)