Skip to main content

Technology-Mediated Assessment in Crossover Learning Assessment Design (CLAD): A Case from Sustainable Engineering Design Education

  • Living reference work entry
  • First Online:
Handbook of Mobile Teaching and Learning

Abstract

Crossover Learning Assessment Designs (CLADs) are unique in their coordination of formal and informal learning through technology-mediated assessment of curricular concepts. This chapter captures the research-based design of one CLAD that employed technology-mediated assessments driven by an augmented reality learning (ARL) platform to provide high school students an exposure to sustainable engineering design concepts. These assessments were embedded in the learning content that drew on the Next Generation Science Standards (NGSS) and spread across the real-world setting of a solar house. Learners interacted with the overlaid augmented content and assessments on their mobile devices as they physically navigated the GPS-marked locations across the solar house. Analytics on the learners’ performance on these assessments were secured on the ARL platform for further analyses. Data collected through iterative usability cycles helped improve the design of technology-mediated assessments that are essentially: (1) place-based, (2) curriculum-focused, and (3) technology-driven. Most importantly, the design of these assessments is deeply rooted in the conceptual distinction of informal and formal learning based on the emphasis on experiential and explanatory knowledge respectively. This chapter proposes CLAD as a pedagogical solution that coordinates explanatory (formal) and experiential (informal) learning through technology-mediated assessments. The chapter also presents the design framework of technology-mediated assessments within a particular CLAD with the hope that educational researchers and practitioners will draw upon this framework in their efforts to bridge formal and informal learning experiences.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Similar content being viewed by others

References

  • Arena, D.A., and D.L. Schwartz. 2014. Experience and explanation: Using videogames to prepare students for formal instruction in statistics. Journal of Science Education and Technology 23 (4): 538–548.

    Article  Google Scholar 

  • Barr, S., K. Leigh, and B. Dunbar. 2011. Green schools that teach: Whole-school sustainability. In Greenbuild Conference Proceedings. Toronto: US Green Building Council.

    Google Scholar 

  • Bellocchi, A., D.T. King, and S.M. Ritchie. 2016. Context-based assessment: Creating opportunities for resonance between classroom fields and societal fields. International Journal of Science Education 38 (8): 1304–1342.

    Article  Google Scholar 

  • Bransford, J.D., and D.L. Schwartz. 1999. Rethinking transfer: A simple proposal with multiple implications. Review of Research in Education 24: 61–101.

    Google Scholar 

  • Bybee, R.W. 2013. The case for STEM education: Challenges and opportunities. Arlington: National Science Teachers Association.

    Google Scholar 

  • Cardiel, C.L.B., S.A. Pattison, M. Benne, and M. Johnson. 2016. Science on the move: A design-based research study of informal STEM learning in public spaces. Visitor Studies 19 (1): 39–59.

    Article  Google Scholar 

  • Chen, C.H., and G.J. Hwang. 2017. Effects of the team competition-based ubiquitous gaming approach on students’ interactive patterns, collective efficacy and awareness of collaboration and communication. Educational Technology & Society 20 (1): 87–98.

    Google Scholar 

  • Cook, J. 2007. Generating new learning contexts: Novel forms of reuse and learning on the move. Invited talk at ED-MEDIA 2007 – World Conference on Educational Multimedia, Hypermedia & Telecommunications, June 25–29, Vancouver, Canada.

    Google Scholar 

  • Cope, B., and M. Kalantzis, eds. 2009. Ubiquitous learning. Urbana: Illinois Press.

    Google Scholar 

  • Craig, S., S. Barr, V. Loftness, A. Aziz, and E. Cochran. 2012. Buildings as teaching tools: Strategies to maximize the pedagogical potential of a sustainably built environment. In The 9th Greening of the campus conference. Muncie: Ball State University.

    Google Scholar 

  • Crook, C. 2002. Children’s computer use at home and at school: Context and continuity. British Educational Research Journal 28 (6): 751–771.

    Article  Google Scholar 

  • Datoo, A., and Z. Chagani. 2011. Street Theatre: Critical pedagogy for social studies education. Social Studies Research & Practice 6 (2): 21–30.

    Google Scholar 

  • Davis, K., and S. Singh. 2015. Digital badges in afterschool learning: Documenting the perspectives and experiences of students and educators. Computers & Education 88: 72–83.

    Article  Google Scholar 

  • Diamantopoulou, S., and D. Christidou. 2016. The choreography of the museum experience: Visitors’ designs for learning. The International Journal of Arts Education 11 (3): 1–13. https://doi.org/10.18848/2326-9944/CGP/v11i03/1-13.

    Article  Google Scholar 

  • Dohn, N.B. 2010. The formality of learning science in everyday life: A conceptual literature review. NorDina: Nordic Studies in Science Education 6 (2): 144–154.

    Article  Google Scholar 

  • Eraut, M. 2004. Informal learning in the workplace. Studies in Continuing Education 26 (2): 247–273.

    Article  Google Scholar 

  • Falk, J.H. 2005. Free choice environmental learning: Framing the discussion. Environmental Education Research 11 (3): 265–280.

    Article  Google Scholar 

  • Falk, J.H., and L.D. Dierking. 2000. Learning from museums: Visitor experiences and the making of meaning. Lanham: AltaMira Press.

    Google Scholar 

  • Freeman, S., S.L. Eddy, M. McDonough, M.K. Smith, N. Okoroafor, H. Jordt, and M.P. Wenderoth. 2014. Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences 111 (23): 8410–8415. https://doi.org/10.1073/pnas.1319030111.

    Article  Google Scholar 

  • Goff, E., K.L. Mulvey, M. Irvin, and A. Hartstone-Rose. 2018. Applications of augmented reality in informal science learning sites: A review. Journal of Science Education and Technology 27: 433. https://doi.org/10.1007/s10956-018-9734-4.

    Article  Google Scholar 

  • Hofstein, A., and S. Rosenfeld. 1996. Bridging the gap between formal and informal science learning. Studies in Science Education 28 (1): 87–112.

    Article  Google Scholar 

  • Hsu, Y.C., H.N.J. Ho, C.C. Tsai, G.J. Hwang, H.C. Chu, C.Y. Wang, et al. 2012. Research trends in technology-based learning from 2000 to 2009: A content analysis of publications in selected journals. Educational Technology & Society 15 (2): 354–370.

    Google Scholar 

  • Hwang, G.J. and Tsai, C.C. 2011. Research trends in mobile and ubiquitous learning: a review of publications in selected journals from 2001 to 2010. British Journal of Educational Technology 42(4). E65–E70.

    Article  Google Scholar 

  • Ito, M., K. Gutiérrez, S. Livingstone, B. Penuel, J. Rhodes, K. Salen, et al. 2013. Connected learning: An agenda for research and design. Digital Media and Learning Research Hub. http://dmlhub.net/sites/default/files/ConnectedLearning_report.pdf

  • Käser, T., N.R. Hallinen, and D.L. Schwartz. 2017. Modeling exploration strategies to predict student performance within a learning environment and beyond. In Proceedings of the seventh international learning analytics & knowledge conference (LAK ‘17), 31–40. New York: ACM. https://doi.org/10.1145/3027385.3027422.

    Chapter  Google Scholar 

  • Klopfer, E., and J. Perry. 2014. UbiqBio: Adoptions and outcomes of mobile biology games in the ecology of school. Computers in Schools 31: 43–64.

    Article  Google Scholar 

  • Lanir, J., T. Kuflik, J. Sheidin, N. Yavin, and K. Leiderman. 2017. Visualising museum visitors’ behavior: Where do they go and what do they do there? Personal and Ubiquitous Computing 21: 313–326. https://doi.org/10.1007/s00779-016-0994-9.

    Article  Google Scholar 

  • Manca, S., and M. Ranieri. 2016. Is Facebook still a suitable technology-enhanced learning environment? An updated critical review of the literature from 2012 to 2015. Journal of Computer Assisted Learning 32 (6): 503–528.

    Article  Google Scholar 

  • McClain, L.R., and H.T. Zimmerman. 2014. Prior experiences shaping family science conversations at a nature center. Science Education 98 (6): 1009–1032. https://doi.org/10.1002/sce.21134.

    Article  Google Scholar 

  • Mclennan, J. F. 2004. Philosophy of Sustainable Design. Kansas, MO: Ecotone Publishing.

    Google Scholar 

  • National Research Council. 2012. A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas. Board on Science Education, Division of Behavioral and Social Sciences and Education. Washington, DC: The National Academies Press.

    Google Scholar 

  • National Research Council. 2015. Identifying and supporting productive programs in out-of-school settings. Committee on Successful Out-of-School STEM Learning, Board on Science Education, Division of Behavioral and Social Science and Education. Washington, DC: The National Academies Press.

    Google Scholar 

  • Newell, S. 2017. Optimizing daily fantasy sports contests through stochastic integer programming. Unpublished Master thesis, Kansas State University.

    Google Scholar 

  • NGSS Lead States. 2013. Next generation science standards: For states, by states. Washington, DC.

    Google Scholar 

  • Plummer, J.D., S. Schmoll, K.C. Yu, and C. Ghent. 2015. A guide to conducting research in the Planetarium. Planetarium 44 (2): 8–24.

    Google Scholar 

  • Rivet, A.E., and J.S. Krajcik. 2008. Contextualizing instruction: Leveraging students’ prior knowledge and experiences to foster understanding of middle school science. Journal of Research in Science Teaching 45 (1): 79–100. https://doi.org/10.1002/tea.

    Article  Google Scholar 

  • Rogers, A., and J. Rock. 2017. Testing a mobile platform for community co-created exhibitions. Curator, the Museum Journal 60 (3): 335–349.

    Article  Google Scholar 

  • Sahin, A., M.C. Ayar, and T. Adiguzel. 2014. STEM related after-school program activities and associated outcomes on student learning. Educational Sciences: Theory and Practice 14 (1): 309–322.

    Google Scholar 

  • Salman, F.H., and D.R. Riley. 2016. Augmented reality crossover gamified design for sustainable engineering education. In Future Technologies Conference 2016. San Francisco. http://ieeexplore.ieee.org/document/7821781/

  • Salman, F.H., H.T. Zimmerman, and S.M. Land. 2014. Collective problem solving in a technologically mediated science learning experience: A case study in a garden. In Proceedings of the 11th international conference of the learning sciences, vol. 1, 378–384. http://www.isls.org/icls2014/downloads/ICLS%202014%20Volume%201%20(PDF)-wCover.pdf

  • Schwartz, D., D. Sears, and J.D. Bransford. 2005. Efficiency and innovation in transfer. In Transfer of learning from a modern multidisciplinary perspective, ed. J. Mestre, 1–51. Greenwich: Information Age Publishing.

    Google Scholar 

  • Sharples, M., A. Adams, N. Alozie, R. Ferguson, E. FitzGerald, M. Gaved, P. McAndrew, B. Means, J. Remold, B. Rienties, J. Roschelle, K. Vogt, D. Whitelock, and L. Yarnall. 2015. Innovating Pedagogy 2015: Open University Innovation Report 4. Milton Keynes: The Open University.

    Google Scholar 

  • Smith, B., P. Sharma, and P. Hooper. 2006. Decision making in online fantasy sports communities. Interactive Technology and Smart Education 3 (4): 347–360. https://doi.org/10.1108/17415650680000072s.

    Article  Google Scholar 

  • Stephen, R., S.L. David, and D.M. James. 2008. Using technology of university buildings in engineering education. International Journal of Engineering Education 24 (3): 521–528.

    Google Scholar 

  • Sun, D., and C.-K. Looi. 2018. Boundary interaction: Towards developing a mobile technology-enabled science curriculum to integrate learning in the informal spaces. British Journal of Educational Technology 49 (3): 505–515.

    Article  Google Scholar 

  • Uzick, R., and P.G. Patrick. 2017. Family discourse on an arboretum nature trail: Explorers, protectors, rememberers, and sticky features. International Journal of Science Education, Part B 8 (1): 76–93. https://doi.org/10.1080/21548455.2017.1393119.

    Article  Google Scholar 

  • Vahey, P., D. Tatar, and J. Roschelle. 2007. Using handheld technology to move between private and public interactions in the classroom. In Ubiquitous computing in education: Invisible technology, visible impact, ed. M. van’t Hooft and K. Swan, 187–210. Mahwah: Lawrence Erlbaum Associates.

    Google Scholar 

  • Vos, N., H. van der Meijden, and E. Denessen. 2011. Effects of constructing versus playing an educational game on student motivation and deep learning strategy use. Computers & Education 56 (1): 127–137. https://doi.org/10.1016/j.compedu.2010.08.013.

    Article  Google Scholar 

  • Wang, M., S. Derry, and X. Ge. 2017. Guest editorial: Fostering deep learning in problem-solving contexts with the support of technology. Educational Technology & Society 20 (4): 162–165.

    Google Scholar 

  • Wardrip, P.S., and L. Brahms. 2015. Learning practices of making: Developing a framework for design. In Proceedings of the 14th international conference on interaction design and children(IDC’15). ACM, New York, NY, USA. 375–378. https://doi.org/10.1145/2771839.2771920

  • Wardrip, P.S., and B.R. Shapiro. 2016. Digital media and data: Using and designing technologies to support learning in practice. Learning, Media and Technology 41 (2): 187–192.

    Article  Google Scholar 

  • Zimmerman, H.T., S.M. Land, L.R. McClain, M.R. Mohney, G.-W. Choi, and F.H. Salman. 2015. Tree investigators: Supporting families and youth to coordinate observations with scientific knowledge. International Journal of Science Education 5 (1): 44–67. https://doi.org/10.1080/21548455.2013.832437.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fariha Hayat Salman .

Editor information

Editors and Affiliations

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer-Verlag GmbH Germany, part of Springer Nature

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Salman, F.H., Riley, D.R. (2019). Technology-Mediated Assessment in Crossover Learning Assessment Design (CLAD): A Case from Sustainable Engineering Design Education. In: Zhang, Y., Cristol, D. (eds) Handbook of Mobile Teaching and Learning. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41981-2_120-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-41981-2_120-1

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-41981-2

  • Online ISBN: 978-3-642-41981-2

  • eBook Packages: Springer Reference Social SciencesReference Module Humanities and Social SciencesReference Module Business, Economics and Social Sciences

Publish with us

Policies and ethics