Skip to main content
SpringerLink
Log in

Storytelling-Based Hand Gesture Interaction in a Virtual Reality Environment

  • Conference paper
  • First Online:
Advances in Human Factors in Wearable Technologies and Game Design (AHFE 2017)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 608))

Included in the following conference series:

  • 1890 Accesses

Abstract

This paper focuses on emotional effects of storytelling-based hand gesture interaction in a VR (Virtual Reality) environment. Unlike using depth cameras like Kinect sensor, a wearable band is proposed to detect users’ hand gestures to create a virtual reality film. The VR film is created using a storytelling-based hand gesture recognition system and focuses on the users’ emotional effects. For the design, the hand gestures suitable for the story in the film are derived from research on users and are applied to the VR film titled ‘Not Alone’. In order to recognize the hand gestures of the user, the data collected from the wearable band is analyzed to classify movements of the hand through machine learning, which helps to solve problems of the existing hand gestures. This study proposes hand gesture interaction that is most suitable for users with two free hands in the head mounted display HMD (Head Mounted Display) based VR environment and tries to maximize users’ emotional responses in narrative-based film content by developing storytelling-based hand gesture interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. https://en.wikipedia.org/wiki/Oculus_VR

  2. Villaroman, N., Rowe, D., Swan, B.: Teaching natural user interaction using OpenNI and the Microsoft Kinect sensor. In: Proceedings of the 2011 Conference on Information Technology Education, pp. 227–232. ACM (2011)

    Google Scholar 

  3. Baudel, T., Beaudouin-Lafon, M.: Charade: remote control of objects using free-hand gestures. Commun. ACM 36(7), 28–35 (1993)

    Article  Google Scholar 

  4. Rekimoto, J.: Gesturewrist and gesturepad: unobtrusive wearable interaction devices. In: Proceedings of the Fifth International Symposium on Wearable Computers, 2001, pp. 21–27. IEEE (2001)

    Google Scholar 

  5. Kang, J.: Affective multimodal story-based interaction design for VR cinema. In: Chung, W., Shin, C.S. (eds.) Advances in Affective and Pleasurable Design. Advances in Intelligent Systems and Computing, pp. 593–604. Springer, Cham (2017)

    Chapter  Google Scholar 

  6. Norman, D.A.: The Design of Everyday Things, pp. 46–48. Doubleday, New York City (1990)

    Google Scholar 

  7. Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. IBM Syst. J. 39(3–4), 915–931 (2000)

    Article  Google Scholar 

Download references

Acknowledgments

This research was supported by the MSIP (Ministry of Science, ICT and Future Planning), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2015-0-00363) supervised by the IITP (Institute for Information & communications Technology Promotion).

Author information

Authors and Affiliations

  1. Dankook University, 152, Jukheon-ro, Suji-gu, Yongin-si, Gyeonggi-do, 16890, Korea

    Jiyoung Kang & Jongkuk Lim

Authors
  1. Jiyoung Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jongkuk Lim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiyoung Kang .

Editor information

Editors and Affiliations

  1. Catholic University of Pernambuco, Boa Vista, Recife, Brazil

    Tareq Ahram

  2. Catholic University of Pernambuco, Boa Vista, Recife, Brazil

    Christianne Falcão

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Cite this paper

Kang, J., Lim, J. (2018). Storytelling-Based Hand Gesture Interaction in a Virtual Reality Environment. In: Ahram, T., Falcão, C. (eds) Advances in Human Factors in Wearable Technologies and Game Design. AHFE 2017. Advances in Intelligent Systems and Computing, vol 608. Springer, Cham. https://doi.org/10.1007/978-3-319-60639-2_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-60639-2_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-60638-5

  • Online ISBN: 978-3-319-60639-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation