Abstract
Mobile learning is viewed by many institutional leaders as the solution for a student cohort that is demanding an increasing flexibility in study options. These students are fitting study around other aspects of their lives including work and caring responsibilities, or they are studying at a geographical location far removed from the university campus. With ubiquitous connectivity available in many parts of the world and with the incremental improvements in design and affordability of mobile devices, many students are using mobile technologies to access course materials and activities. Even so, there are relatively few formal mobile learning initiatives underway and even fewer evaluations of those initiatives. This is significant because without a rigorous evaluation of mobile learning, it is impossible to determine whether it provides a viable and cost-effective way of accessing courses for both the student and the institution. This chapter examines the broad groupings of uses for mobile devices for learning, before considering the evaluation frameworks that are currently in use. The characteristics, affordances, and issues of these frameworks are briefly discussed. A project to develop a Mobile Learning Evaluation Framework is introduced, which will consider evaluation from four aspects: (1) pedagogical learning, (2) pedagogical teaching, (3) technical, and (4) organizational.
Similar content being viewed by others
References
Biggs, B., and R. Justice. 2011. M-learning: The next evolution. Chief Learning Officer 10(4): 38–41.
Botcicki, I., C.-K. Looi, and L.-H. Wong. 2011. Supporting mobile collaborative activities through Scaffolded Flexible grouping. Educational Technology & Society 14(3): 190–202.
Carter, L., and V. Salyers. 2013. E-learning as educational innovation in universities. In The Routledge international handbook of innovation education, ed. L.V. Shavinina, 456–470. Abingdon: Routledge.
Cheung, W., and K. Hew. 2009. A review of research methodologies used in studies on mobile handheld devices in K-12 and higher education settings. Australasian Journal of Educational Technology 25(2): 153–183.
Cochrane, T. 2012. Critical success factors for transforming pedagogy with mobile Web 2.0. British Journal of Educational Technology 45(1): 65–82. doi:10.1111/j.1467-8535.2012.01384.x.
Cochrane, T., and R. Bateman. 2010. Smartphones give you wings: Pedagogical affordances of mobile Web 2.0. Australasian Journal of Educational Technology 26(1): 1–14.
Cooper, K.J. 2012. An iPad education? Diverse: Issues in Higher Education 29(3): 10–11.
Dahlstrom, E. 2012. Study of undergraduate students and information technology. Louisville: EDUCAUSE Center for Applied Research.
Davis, F.D., R.P. Bagozzi, and P.R. Warshaw. 1989. User acceptance of computer technology: A comparison of two theoretical models. Management Science 35(8): 982–1003.
Davis, F.D., R.P. Bagozzi, and P.R. Warshaw. 1992. Extrinsic and intrinsic motivation to use computers in the workplace. Journal of Applied Social Psychology 22(14): 1111–1132.
Dyson, L.E., A. Litchefield, E. Lawrence, R. Raban, and P. Leijdekkers. 2009. Advancing the m-learning research agenda for active, experiential learning: Four case studies. Australasian Journal of Educational Technology 25(2): 250–267.
Elias, T. 2011. Universal instructional design principles for M-learning. International Review of Research in Open and Distance Learning 12(2): 143–156.
Engel, G., R. Palloff, and K. Pratt. 2011. Using mobile technology to empower student learning. Paper presented at the 27th annual conference on distance teaching and learning, University of Wisconsin.
Estrella, M. 2000. Learning from change. In Learning from change: Issues and experiences in participatory monitoring and evaluation, ed. M. Estrella, J. Blauert, D. Campilan, J. Gaventa, J. Gonsalves, I. Guijt, D. Johnson, and R. Ricafort. London: IDRC (International Development Research Centre).
Eyadat, W.M., and Y.A. Eyadat. 2010. Instructional technology and creativity among university students: The missing link. World Journal on Educational Technology 2(2): 87–99.
Farley, H., A. Murphy, and S. Rees. 2013. Revisiting the definition of mobile learning. Paper presented at the proceedings of the 30th Australasian society for computers in learning in tertiary education conference (ASCILITE 2013), Sydney.
Fishbein, M., and I. Ajzen. 1975. Belief, attitude, intention and behavior: An introduction to theory and research. Reading: Addison-Wesley.
Fishbein, M., and I. Ajzen. 2010. Predicting and changing behaviour: The reasoned action approach. New York: Taylor & Francis.
Flood, A. 2014. Readers absorb less on kindles than on paper, study finds. The Guardian. August 20. Retrieved from http://www.theguardian.com/books/2014/aug/19/readers-absorb-less-kindles-paper-study-plot-ereader-digitisation
Franklin, T. 2011. Mobile learning: At the tipping point. Turkish Online Journal of Educational Technology 10(4): 261–275.
Frohberg, D., C. Göth, and G. Schwabe. 2009. Mobile learning projects – A critical analysis of the state of the art. Journal of Computer Assisted Learning 25(4): 307–331.
Garrison, D.R. 2011. Elearning in the 21st century, 2nd ed. New York: Routledge Falmer.
Gkatzidou, S., and E. Pearson. 2009. The potential for adaptable accessible learning objects: A case study in accessible vodcasting. Australasian Journal of Educational Technology 25(2): 292–307.
Godfrey, J. 2013. New survey finds 85 percent of educational institutions allow BYOD despite security concerns [Press release]. Retrieved from http://www.bradfordnetworks.com/new-survey-finds-85-percent-of-educational-institutions-allow-byod-despite-security-concerns/
Griffith, C. 2012a. University to roll out 11,000 Apple iPads. The Australian. 20 December. Retrieved from http://www.theaustralian.com.au/technology/university-to-roll-out-11000-apple-ipads/story-e6frgakx-1226540975375
Griffith, C. 2012b. Union slams university plan to buy 11,000 iPads. The Australian. 21 December. Retrieved from http://www.theaustralian.com.au/technology/union-slams-university-plan-to-buy-11000-ipads/story-e6frgakx-1226541812872#
Herro, D., D. Kiger, and C. Owens. 2013. Mobile technology: Case-based suggestions for classroom integration and teacher educators. Journal of Digital Learning in Teacher Education 30(1): 30–40. doi:10.1080/21532974.2013.10784723.
Hildmann, H., and J. Hildmann. 2009. A critical reflection on the position of mobile device based tools to assist in the professional evaluation and assessment of observable aspects of learning or (Game) playing. Paper presented at the 3rd European Conference on Games-Based Learning, Graz, Austria. http://www.research.ed.ac.uk/portal/files/16315943/2009_Hildmann_Hildmann_A_critical_reflection.pdf
Jeng, Y.-L., T.-T. Wu, Y.-M. Huang, Q. Tan, and S.J.H. Yang. 2010. The add-on impact of mobile applications in learning strategies: A review study. Journal of Educational Technology & Society 13(3): 3–11.
Kearney, M., S. Schuck, K. Burden, and P. Aubusson. 2012. Viewing mobile learning from a pedagogical perspective. Research in Learning Technology 20(1): 1–17. doi:10.3402/rlt.v20i0/14406.
Kissinger, J.S. 2013. The social & mobile learning experiences of students using mobile E-books. Journal of Asynchronous Learning Networks 17(1): 153–169.
Kukulska-Hulme, A., J. Pettit, L. Bradley, A.A. Carvalho, A. Herrington, D.M. Kennedy, and A. Walker. 2011. Mature students using mobile devices in life and learning. International Journal of Mobile and Blended Learning 3(1): 18–52.
Lam, S.L., K. Wong, J. Mohan, D. Xu, and P. Lam. 2011. Classroom communication on mobile phones – First experiences with web-based ‘clicker’ system. Paper presented at the Changing Demands, Changing Directions: ascilite Hobart 2011, Hobart. http://www.leishman-associates.com.au/ascilite2011/downloads/papers/Lam-full.pdf
Laurillard, D. 2002. Rethinking university teaching: A framework for the effective use of learning technologies. 2nd ed. Abingdon: Routledge Falmer. http://dx.doi.org/10.4324/9780203304846
Laurillard, D. 2007. Pedagogical forms for mobile learning: Framing research questions. In Mobile learning: Towards a research agenda, ed. N. Pachler, 153–175. London: IoE.
Lennie, J. 2006. Increasing the rigour and trustworthiness of participatory evaluations: Learnings from the field. Evaluation Journal of Australasia 6(1): 27–35.
McGarr, O. 2009. A review of podcasting in higher education: Its influence on the traditional lecture. Australasian Journal of Educational Technology 25(3): 309–321.
Manuguerra, M., and P. Petocz. 2011. Promoting student engagement by integrating new technology into tertiary education: The role of the iPad. Asian Social Science 7(11): 61–65.
Murphy, A., H. Farley, A. Koronios, C. Johnson, M. Lane, A. Hafeez-Baig, . . . S. Dekeyser. 2014. Embracing student mobility: Understanding, enabling and facilitating the mobile aspirations of higher education students. Paper presented at the Digital Rural Futures Conference, Toowoomba.
Murphy, G.D. 2011. Post-PC devices: A summary of early iPad technology adoption in tertiary environments. E-Journal of Business Education & Scholarship of Teaching 5(1): 18–32.
Ng, W., and H. Nicholas. 2013. A framework for sustainable mobile learning in schools. British Journal of Educational Technology 44(5): 695–715. doi:10.1111/j.1467-8535.2012.01359.x.
Park, Y. 2011. A pedagogical framework for M-learning: Categorizing educational applications of mobile technologies into four types. International Review of Research in Open and Distance Learning 12(2): 78–102.
Pask, G. 1975. Minds and media in education and entertainment: Some theoretical comments illustrated by the design and operation of a system for exteriorizing and manipulating individual theses. In Progress cybernetics and systems research IV, ed. R. Trappland and G. Pask, 38–50. Washington, DC/London: Hemisphere Publishing.
Patten, B., I. Arnedillo Sánchez, and B. Tangney. 2006. Designing collaborative, constructionist and contextual applications for handheld devices. Computers & Education 46(3): 294–308.
Quinton, S., M. Pachman, and R. He. 2010. Evaluation of the TELT platform: Essential elements and methodologies. Trans. Teaching, L. Sydney: University of New South Wales.
Rogers, P.L. 2000. Barriers to adopting emerging technologies in education. Journal of Educational Computing Research 22(4): 455–472.
Roschelle, J. 2003. Unlocking the learning value of wireless mobile devices. Journal of Computer Assisted Learning 19(3): 260–272.
Sharples, M., J. Taylor, and G. Vavoula. 2007. A theory of learning for the mobile age. In The Sage handbook of e-learning research, ed. Richard Andrews and Caroline Haythornthwaite. London: SAGE.
Squire, K., and E. Klopfer. 2007. Augmented reality simulations on handheld computers. Journal of the Learning Sciences 16(3): 371–413. doi:10.1080/10508400701413435.
Stav, J., K. Nielsen, G. Hansen-Nygard, and T. Thorseth. 2010. Experiences obtained with integration of student response systems for iPod touch and iPhone into e-Learning environments. Electronic Journal of e-Learning 8(2): 179–190.
Terkowsky, C., T. Haertel, E. Bielski, and D. May. 2013. Creativity@School: Mobile learning environments involving remote labs and E-portfolios. A conceptual framework to foster the inquiring mind in secondary STEM education. In IT Innovative practices in secondary schools: Remote experiments, ed. J.G. Zubíaand and O. Dziabenko, 255–280. Bilbao: University of Deusto.
Thompson, R.L., C.A. Higgins, and J.M. Howell. 1991. Personal computing: Toward a conceptual model of utilization. MIS Quarterly 15(1): 124–143.
Traxler, J. 2007. Defining, discussing, and evaluating mobile learning: The moving finger writes and having writ…. International Review of Research in Open and Distance Learning 8(2): 1–12.
Traxler, J. 2010. Distance education and mobile learning: Catching up, taking stock. Distance Education 31(2): 129–138.
Venkatesh, V., M.G. Morris, G.B. Davis, and F.D. Davis. 2003. User acceptance of information technology: Toward a unified view. MIS Quarterly 27(3): 425–478.
Williams, P., W.-L. Wong, H. Webb, and S. Borbosi. 2011. Mobile technologies in the field: iPads – Rescuer or rescuee? Paper presented at the changing demands, changing directions: Ascilite Hobart 2011, Hobart. http://www.ascilite.org.au/conferences/hobart11/procs/Williams-concise.pdf
Wishart, J., and D. Green. 2010. Identifying emerging issues in mobile learning in higher and further education: A report to JISC. University of Bristol.
Wong, W. 2012. Tools of the trade: How mobile learning devices are changing the face of higher education. Community College Journal 82(5): 54–61.
Wood, D., and C. Bilsborow. 2014. “I am not a Person with a Creative Mind”: Facilitating creativity in the undergraduate curriculum through a design-based research approach. The Electronic Journal of e-Learning and Instruction 12(1): 111–125.
Wu, H.-K., S.W.-Y. Lee, H.-Y. Chang, and J.-C. Liang. 2013. Current status, opportunities and challenges of augmented reality in education. Computers & Education 62: 41–49. doi:10.1016/j.compedu.2012.10.024.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer-Verlag Berlin Heidelberg
About this entry
Cite this entry
Farley, H. et al. (2015). Moving Toward the Effective Evaluation of Mobile Learning Initiatives in Higher Education Institutions. In: Zhang, Y. (eds) Handbook of Mobile Teaching and Learning. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41981-2_17-1
Download citation
DOI: https://doi.org/10.1007/978-3-642-41981-2_17-1
Received:
Accepted:
Published:
Publisher Name: Springer, Berlin, Heidelberg
Online ISBN: 978-3-642-41981-2
eBook Packages: Springer Reference Social SciencesReference Module Humanities and Social SciencesReference Module Business, Economics and Social Sciences