Abstract
We have already developed a speech-driven embodied entrainment CG character system called “InterActor” which generates communicative motions and actions such as nods for entrained interaction from speech rhythm based on only voice input. Conventional InterActor performed the entrained communicative body movements and actions based on speech input without an audio back-channel feedback. In this study, we develop an embodied character system with the back-channel feedback based on the embodied interaction model. Moreover, the effectiveness of the system is demonstrated by the sensory evaluation in the experiment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kanda, T., Ishiguro, H.: Human-Robot Interaction in Social Robotics. CRC Press, Boca Raton (2017)
Pepper: https://www.softbank.jp/robot/consumer/products/. Accessed 28 Mar 2018
Kawamoto, S., Shimodaira, H., Nitta, T., Nishimoto, T., Nakamura, S., Itou, K., Morishima, S., Yotsukura, T., Kai, A., Lee, A., Yamashita, Y., Kobayashi, T., Tokuda, K., Hirose, K., Minematsu, N., Yamada, A., Den, Y., Utsuro T., Sagayama, S.: Design of software toolkit for anthropomorphic spoken dialog agent software with customization-oriented features. IPSJ J. 43(7), 2249–2263 (2002). (in Japanese)
Lee, A., Oura, K., Tokuda, K.: An Open-Source Toolkit Realizing Attractive Voice Interaction Systems: MMDAgent. IEICE Technical Report, NLC2011-51, SP2011-96, vol. 111, No. 364, pp. 159–164 (2011). (in Japanese)
Watanabe, T.: Human-entrained embodied interaction and communication technology. In: Emotional Engineering. Springer, London, pp. 161–177 (2011)
Yamamoto, M., Watanabe, T.: Timing control effects of utterance to communicative actions on embodied interaction with a robot and CG character. Int. J. Hum.-Comput. Interact. 24(1), 87–107 (2008)
Giannopulu, I., Terada, K., Watanabe, T.: Communication using robots: a perception-action scenario in moderate ASD. J. Exp. Theor. Artif. Intell. (2018). https://doi.org/10.1080/0952813x.2018.1430865
Watanabe, T., Okubo, M., Nakashige, M., Danbara, R.: InterActor: speech-driven embodied interactive actor. Int. J. Hum.-Comput. Interact. 17(1), 43–60 (2004)
Maynard, S.K.: Conversation Analysis. Kurosio Publishers, Tokyo (2002). (in Japanese)
Ohshima, N., Ohyama, Y., Odahara, Y., De Silva, P.R.S., Okada, M.: Talking-Ally: the influence of robot utterance generation mechanism on hearer behaviors. Int. J. Soc. Robot. 7(1), 51–62 (2014)
Krogsager, A., Segato, N., Rehm, M.: Backchannel head nods in danish first meeting encounters with a humanoid robot: the role of physical embodiment. In: Kurosu, M. (ed.) Human-Computer Interaction. Advanced Interaction Modalities and Techniques. HCI 2014. Lecture Notes in Computer Science, vol. 8511. Springer, Cham (2014)
Acknowledgments
This work was supported by JSPS KAKENHI Grant Number 16K00278.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Ishii, Y., Nishida, M., Watanabe, T. (2019). Development of a Speech-Driven Embodied Entrainment Character System with a Back-Channel Feedback. In: Fukuda, S. (eds) Advances in Affective and Pleasurable Design. AHFE 2018. Advances in Intelligent Systems and Computing, vol 774. Springer, Cham. https://doi.org/10.1007/978-3-319-94944-4_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-94944-4_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-94943-7
Online ISBN: 978-3-319-94944-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)