Skip to main content

Mu-musicplay: How the Interactive Use of Games and Music Influence the Capacity of Autistic Children to Recognize Emotions in Videos and Music

  • Conference paper
  • First Online:
Advances in Human Factors and Ergonomics in Healthcare and Medical Devices (AHFE 2021)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 263))

Included in the following conference series:

  • 2228 Accesses

Abstract

It is difficult for autistic children to assess other people emotions and social behavior by observing non-verbal social cues, making the situation challenging to respond in a socially appropriate manner. Therefore, by utilizing the indirect means of contextual game and musical interactions in a group setting blended with social contexts from videos, autistic children may be able to gain better understanding of certain social cues and contexts. In this paper, computer programs utilized to design a game called “Mu-musicplay” and conduct social-context interaction to help children recognize and better identify emotions and social scenarios. This study was carried-out with three non-autistic children of age five as the subjects to obtain a baseline and foundation for a future study with autistic children. Results indicates that, while playing a game in which the children tried to recognize emotions from videos and music, they were better able to complete their task with the help of verbal guidance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    MakeyMakey is a circuit control panel invented by two doctoral students, Jay Silver and Eric Rosenbaum, of the Massachusetts Institute of Technology. The combination of Scratch and MakeyMakey made the creation of a game quite simple.

References

  1. Song, W.-Z.: Behavioral characteristics of autism. Taitung Spec. Educ. Newslett. 14, 1–5 (2001)

    Google Scholar 

  2. Charman, T., Swettenham, J., Baron-Cohen, S.: Infants with autism: an investigation of empathy, pretend play, joint attention, and imitation - psycnet.apa.org. (1997)

    Google Scholar 

  3. Baron-Cohen, S.: Do people with autism understand what causes emotion? Child Development, April 1991

    Google Scholar 

  4. Nally, B., Houlton, B., Ralph, S.: Researches in Brief: The Management of Television and Video by Parents of Children with Autism’ September 1 (2000)

    Google Scholar 

  5. Dvira, T., Lotanb, N., Vidermana, R., Elefanta, C.: The body communicates: Movement synchrony during music therapy with children diagnosed with ASD. Arts Psychother. 69, July 2020

    Google Scholar 

  6. Lara, J.: Autism Movement Therapy (R) Method: Waking up the Brain! P9 (2015)

    Google Scholar 

  7. Whipple, J.: Music in intervention for children and adolescents with autism: a meta-analysis. J. Music Ther. 41(2), 90–106 (2004)

    Google Scholar 

  8. Martin, N., Lawrence, K.S.: Art therapy and autism: overview and recommendations. Art Ther. J. Am. Art Ther. Assoc. 26(4), 187–190 (2009)

    Google Scholar 

  9. Henley, D.R.: Therapeutic and aesthetic application of video with the developmentally disabled. Arts Psychother. 18(5), 441–447 (1991)

    Article  Google Scholar 

  10. Partinson, B.: Emotions are social. British J. Psychol. (1996)

    Google Scholar 

  11. Lilia Villafuerte, M.S., Markova, S.J.: Acquisition of social abilities through musical tangible user interface: children with autism spectrum condition and the reactable. In: CHI 2012, Austin, Texas, USA, 5–10 May (2012)

    Google Scholar 

  12. Dvira, T., Lotanb, N., Vidermana, R., Elefanta, C.: The body communicates: Movement synchrony during music therapy with children diagnosed with ASD. Arts Psychother. 69, 101658 (2020)

    Google Scholar 

  13. Albo-Canals, J., et al.: A pilot study of the KIBO robot in children with severe ASD. Int. J. Soc. Robot. 10, 371–383 (2018)

    Google Scholar 

Download references

Acknowledgments

This work is supported by the Ministry of Science and Technology of Taiwan (109-2221-E-027-069-MY2). The authors thank the referees for their valuable comments and suggestions on this research.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Ting Liang or I-Jui Lee .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liang, T., Lee, IJ. (2021). Mu-musicplay: How the Interactive Use of Games and Music Influence the Capacity of Autistic Children to Recognize Emotions in Videos and Music. In: Kalra, J., Lightner, N.J., Taiar, R. (eds) Advances in Human Factors and Ergonomics in Healthcare and Medical Devices. AHFE 2021. Lecture Notes in Networks and Systems, vol 263. Springer, Cham. https://doi.org/10.1007/978-3-030-80744-3_44

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-80744-3_44

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-80743-6

  • Online ISBN: 978-3-030-80744-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics