Abstract
The goal of this position paper is to explore an existing structured gestural language, called Soundpainting, to control and direct a swarm of autonomous drones. Soundpainting already integrates the notion of groups of entities and makes it possible to address one single entity of a set/subset, still being able to address the set as a whole. The key point is that Soundpainting has been designed for directing a set of improvising live performers, and, thus, we link this ability of improvisation to the capacity of decision of the autonomous drones. Indeed, Soundpainting allows a real exchange and an adaptive dialogue between the soundpainter and the group, enabling contextual interpretation by each individual, and generating rich interaction and dialogue. With a systematical analysis of the Soundpainting gestures, we show that it is perfectly adaptable to the context of the flying swarms of drones.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
We have kept the word used page 120 of [4].
References
John, C., Liam, Y.: Loop ≫ 60hz. The Barbican, London (2014)
Thompson, W.: Soundpainting: the art of live composition. In: Thompson, W. (ed.) Workbook 1 (2006)
Thompson, W.: Soundpainting: the art of live composition. In: Thompson, W. (ed.) Workbook 2 (2009)
Thompson, W.: Soundpainting: the art of live composition. In: Thompson, W. (ed.) Workbook 3 (2014)
Draper, M., Calhoun, G., Ruff, H., Williamson, D., Barry, T.: Manual versus speech input for unmanned aerial vehicle control station operations. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 47, pp. 109–113. SAGE Publications (2003)
Kinect homepage. http://developer.microsoft.com/en-us/windows/kinect/hardware
Wigdor, D., Wixon, D.: Brave NUI World: Designing Natural User Interfaces for Touch and Gesture, 1st edn. Morgan Kaufmann Publishers Inc., San Francisco (2011)
Monajjemi, V.M., Wawerla, J., Vaughan, R., Mori, G.: Hri in the sky: creating and commanding teams of Uavs with a vision-mediated gestural interface. In: Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS’13), Tokyo, Japan (November 2013)
Sanna, A., Lamberti, F., Paravati, G., Henao Ramirez, E.A., Manuri, F.: A Kinect-Based Natural Interface for Quadrotor Control, pp. 48–56. Springer, Berlin (2012)
Mashood, A., Noura, H., Jawhar, I., Mohamed, N.: A gesture based kinect for quadrotor control. In: 2015 International Conference on Information and Communication Technology Research (ICTRC), pp. 298–301 (May 2015)
Nagi, J., Giusti, A., Gambardella, L.M., Caro, G.A.D.: Human-swarm interaction using spatial gestures. In: 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA, September 14–18, 2014, pp. 3834–3841. IEEE (2014)
Pourmehr, S., Monajjemi, V., Vaughan, R., Mori, G.: “You two! Take Off!”: Creating, modifying and commanding groups of robots using face engagement and indirect speech in voice commands. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2013)
Morgan, D., Subramanian, G.P., Chung, S.J., Hadaegh, F.Y.: Swarm assignment and trajectory optimization using variable swarm, distributed auction assignment and sequential convex programming. Int J Rob Res 35, 1261–1285 (2016)
LaFleur, K., Cassady, K., Doud, A., Shades, K., Rogin, E., He, B.: Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain computer interface. J. Neural Eng. 10(4), 046003 (2013)
Base, Spotify: The party drone. Belgium festivals (2014)
Hoertner, H.: Drone 100 Project. Flugplatz Ahrenlohe, Tornesch (2015)
i-score homepage: http://i-score.org
Acknowledgements
Authors would like to thank the “Initiative d’Excellence” of Bordeaux University and Euskampus for their support, Baptiste Audemard (ESTIA Engineering School, France) for his contribution in the formatting of this article, Joseph Canou (ESTIA, France) for his advices in the design of drones, and Shlomo Dubnov (University of California, San Diego, US), Pierre Cauchart (SCRIME, Talence, France), Jean-Michaël Celerier (LaBRI et Blue Yeti, Bordeaux, France) for their fruitful discussions.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Couture, N., Bottecchia, S., Chaumette, S., Cecconello, M., Rekalde, J., Desainte-Catherine, M. (2018). Using the Soundpainting Language to Fly a Swarm of Drones. In: Chen, J. (eds) Advances in Human Factors in Robots and Unmanned Systems. AHFE 2017. Advances in Intelligent Systems and Computing, vol 595. Springer, Cham. https://doi.org/10.1007/978-3-319-60384-1_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-60384-1_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-60383-4
Online ISBN: 978-3-319-60384-1
eBook Packages: EngineeringEngineering (R0)