Elaboration and validation of the scale to measure the experience on gamification in education (EGAMEDU)

  1. María Elena Parra González 1
  2. Adrián Segura Robles 1
  3. Antonio José Moreno Guerrero 1
  4. Jesús López-Belmonte 1
  1. 1 Universidad de Granada
    info

    Universidad de Granada

    Granada, España

    ROR https://ror.org/04njjy449

Revista:
JOTSE

ISSN: 2013-6374

Año de publicación: 2022

Volumen: 12

Número: 1

Páginas: 217-229

Tipo: Artículo

DOI: 10.3926/JOTSE.1505 DIALNET GOOGLE SCHOLAR lock_openDialnet editor

Otras publicaciones en: JOTSE

Resumen

Nowadays, we talk about the use of gamification in education, an active methodology that consists of the use of mechanics, design or game structures in class. With this type of methodology, the effort is rewarded, which is treated as a motivating tool in class. There is no valid or well-structured instrument to measure gamification properly in education. This research arises from the need to develop and validate an instrument to measure the experience on gamification in educational contexts (EGAMEDU) as a useful tool of diagnosis so that the teaching staff can guide their teaching practice toward the use of this methodology. The sample used for the validation of the questionnaire is composed of 401 participants related to education and gamified experiences. The results show good validity indexes and a factorial structure according to the one proposed in the theory.

Referencias bibliográficas

  • Alias, R., Ismail, M., & Sahiddan, N. (2015). A Measurement Model for Leadership Skills Using Confirmatory Factor Analysis (CFA). Procedia - Social And Behavioral Sciences, 172, 717-724. https://doi.org/10.1016/j.sbspro.2015.01.424
  • Anguas-Gracia, A., Subiron-Valera, A.B., Anton-Solanas, I., Rodríguez-Roca, B., Satustegui-Dorda, P.J., & Urcola-Pardo, F. (2021). An evaluation of undergraduate student nurses’ gameful experience while playing an escape room game as part of a community health nursing course. Nurse Education Today, 103, 1-7. https://doi.org/10.1016/j.nedt.2021.104948
  • Area-Moreira, M., & González, C. (2015). De la enseñanza con libros de texto al aprendizaje en espacios online gamificados. Educatio Siglo XXI, 33(3), 15. https://doi.org/10.6018/j/240791
  • Ato, M., López-García, J., & Benavente, A. (2013). Un sistema de clasificación de los diseños de investigación en psicología. Anales De Psicología, 29(3). https://doi.org/10.6018/analesps.29.3.178511
  • Ayén, F. (2017). ¿Qué es la gamificación y el ABJ? Iber: Didáctica de las ciencias sociales, geografía e historia, 86, 7-15.
  • Banfield, J., & Wilkerson, B. (2014). Increasing student intrinsic motivation and self-efficacy through gamification pedagogy. Contemporary Issues in Education Research, 7(4), 291-298. https://doi.org/10.19030/cier.v7i4.8843
  • Berenguer, C. (2016). Acerca de la utilidad del aula invertida o flipped classroom. In Tortosa, M., Grau, S.. & Álvarez, J. (Eds.), XIV Jornadas de redes de investigación en docencia universitaria. Investigación, innovación y enseñanza universitaria: enfoques pluridisciplinares (1466- 1480). Alicante, España: Universitat d’Alacant.
  • Berk, R. (1990). Importance of Expert Judgment in Content-Related Validity Evidence. Western Journal Of Nursing Research, 12(5), 659-671. https://doi.org/10.1177/019394599001200507
  • Bernal, M.C., & Martínez, M.S. (2009). Metodologías activas para la enseñanza y el aprendizaje. Revista de Pedagogía Saberes y quehaceres del pedagogo, 14, 101-106.
  • Bruder, P. (2015). Game on: gamification in the classroom. Education Digest, 80(7), 50-56.
  • Byrne, B.M. (2012). Structural Equation Modeling with Mplus: basic concepts, applications, and programming. New York: Taylor & Francis Group. https://doi.org/10.4324/9780203807644
  • Cangur, S., & Ercan, I. (2015). Comparison of Model Fit Indices Used in Structural Equation Modeling Under Multivariate Normality. Journal Of Modern Applied Statistical Methods, 14(1), 152-167. https://doi.org/10.22237/jmasm/1430453580
  • Caponneto, I., Earp, J., & Ott, M. (2014). Gamification and education: a literature review [Conference presentation]. European conference on games-based learning 8. Berlín, University of Applied Sciences.
  • Contreras, R. (2016). Digital games and gamification applied to education. RIED. Revista Iberoamericana de Educación a Distancia, 19(2), 27-33. https://doi.org/10.5944/ried.19.2.16143
  • Cruz-Miguel, E.E., Rodriguez-Resendiz, J., Garcia-Martinez, J.R., Camarillo-Gomez, K.A., & Perez-Soto, G.I. (2019). Field-programmable gate array-based laboratory oriented to control theory courses. Computer Applications In Engineering Education, 27(5), 1253-1266. https://doi.org/10.1002/cae.22149
  • De Sousa-Borges, S., Durelli, V.H.S., Reis, H.M., & Isotani, S. (2014). A systematic mapping on gamification applied to education. In Proceedings of the 29th Annual ACM Symposium on Applied Computing (216-222). https://doi.org/10.1145/2554850.2554956
  • De Vargas, E. (2006). La situación de enseñanza y aprendizaje como sistema de actividad: el alumno, el espacio de interacción y el profesor. Revista Iberoamericana de Educación, 39(4).
  • Delgado-Rico, E., Carretero-Dios, H., & Ruch, W. (2012). Content validity evidence in test development: An applied perspective. International Journal of Clinical and Health Psychology, 12(3), 449-459.
  • Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness: defining gamification. In Proceedings of the 15th International Academic MindTrek Conference (9-15). https://doi.org/10.1145/2181037.2181040
  • Deterding, S., Sicart, M., Nacke, L., O’Hara, K., & Dixon, D. (2011). Gamification: using game-design elements in non-gaming contexts. In Proceedings of the 2011 Annual Conference of Human Factors in Computing Systems (2425-2428). https://doi.org/10.1145/1979742.1979575
  • Dunn, T., Baguley, T., & Brunsden, V. (2013). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399-412. https://doi.org/10.1111/bjop.12046
  • Eppmann, R., Bekk, M., & Klein, K. (2018). Gameful Experience in Gamification: Construction and Validation of a Gameful Experience Scale [GAMEX]. Journal of Interactive Marketing, 43, 98-115. http://doi.org/10.1016/j.intmar.2018.03.002
  • Erenli, K. (2013). The impact of gamification: Recommending education scenarios. International Journal of Emerging Technologies in Learning, 8(1), 15-21. https://doi.org/10.3991/ijet.v8iS1.2320
  • Foncubierta, J.M., & Rodríguez, C. (2016). Didáctica de la gamificación en la clase de español. Madrid: Edinumen.
  • Fuentes-Cabrera, A., López-Belmonte, J., Parra-González, M.E., & Morales-Cevallos, M.B. (2020). Diseño, validación y aplicación de un cuestionario para medir la influencia de factores exógenos sobre la eficacia del aprendizaje invertido. Psychology, Society, & Education, 12(1), 1-16. https://doi.org/10.25115/psye.v0i0.2334
  • Garduno-Aparicio, M., Rodriguez-Resendiz, J., Macias-Bobadilla, G., & Thenozhi, S. (2018). A Multidisciplinary Industrial Robot Approach for Teaching Mechatronics-Related Courses. IEEE Transactions on Education, 61(1), 55-62. https://doi.org/10.1109/TE.2017.2741446
  • Gayá, V. (2016). Enseñar a pensar: Las nuevas metodologías colocan al alumno como parte activa de su propio aprendizaje. El siglo de Europa, 1177, 36-37.
  • Gorrostieta, E., Vargas-Soto, E., Zuñiga-Aviles, L.A., Rodríguez-Resendiz, J., Tovar-Arriaga, S. (2015). Mechatronics methodology: 15 years of experience. Ingenieria e Investigacion, 35(3), 107-350. https://doi.org/10.15446/ing.investig.v35n3.47543
  • Gutiérrez, C.A.G., Reséndiz, J.R., Santibáñez, J.D.M., Bobadilla, G.M. (2014). A model and 352 simulation of a _ve-degree-of-freedom robotic arm for mechatronic courses. IEEE Latin America 353 Transactions, 12(2), 78-86. http://doi.org/10.1109/TLA.2014.6749521
  • Hainey, T., Westera, W., Connolly, T., Boyle, L., Baxter, G., Beeby, R. et al. (2013). Students’ attitudes toward playing games and using games in education: Comparing Scotland and the Netherlands. Computers & Education, 69, 474-484. https://doi.org/10.1016/j.compedu.2013.07.023
  • Hair, J., & Gomez-Suarez, M. (2010). Análisis multivariante. Madrid: Prentice Hall.
  • Hair, J., Black, W., Babin, B., & Anderson, R. (2014). Multivariate data analysis. NJ: Prentice Hall.
  • Henseler, J., Ringle, C., & Sarstedt, M. (2014). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal Of The Academy Of Marketing Science, 43(1), 115-135. https://doi.org/10.1007/s11747-014-0403-8
  • Heo, M., Kim, N., & Faith, M. (2015). Statistical power as a function of Cronbach alpha of instrument questionnaire items. BMC Medical Research Methodology, 15(1), 1-9. https://doi.org/10.1186/s12874-015-0070-6
  • Hernandez-Nieto, R., & Pulido, J. (2014). Instrumentos de Recoleccion de Datos: Validez y Confiabilidad. Editorial Academica Espanola.
  • Hinojo-Lucena, F.J., Gómez-García, G., Marín-Marín, J.A., & Romero-Rodríguez, J.M. (2021). Gamificación por insignias para la igualdad y equidad de género en Educación Superior. Prisma Social, 35, 184-198.
  • Hogarty, K., Hines, C., Kromrey, J., Ferron, J., & Mumford, K. (2005). The Quality of Factor Solutions in Exploratory Factor Analysis: The Influence of Sample Size, Communality, and Overdetermination. Educational And Psychological Measurement, 65(2), 202-226. https://doi.org/10.1177/0013164404267287
  • Kaiser, H. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31-36. https://doi.org/10.1007/bf02291575
  • Kapp, K.M. (2012). The Gamification of learning and Instruction. San Francisco: John Wiley.
  • Kirillov, A.V., Vinichenko, M.V., Melnichuk, A.V., Melnichuk, Y.A., & Vinogradova, M.V. (2016). Improvement in the Learning Environment through Gamification of the Educational Process. International Electronic Journal of Mathematics Education, 11(7), 2071-2085.
  • Kline, R.B. (2005). Methodology in the social sciences. Principles and practice of structural equation modeling. New York: Guilford Press.
  • Korn, O., & Schmidt A. (2015). Gamification of Business Processes: Re-designing Work in Production and Service Industry. Procedia Manufacturing, 3(1), 3424-3431. https://doi.org/10.1016/j.promfg.2015.07.616
  • Lavoué, E., Monterrat, B., Desmarais, M., & George, S. (2019) Adaptive Gamification for Learning Environments. IEEE Transactions on Learning Technologies, 12(1), 16-28. https://doi.org/10.1109/TLT.2018.2823710
  • Lee, J.J., & Hammer, J. (2011). Gamification in Education: What, How, Why Bother. Academic Exchange Quaterly, 15(2).
  • Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada. Anales De Psicología, 30(3), 1151-1169. https://doi.org/10.6018/analesps.30.3.199361
  • López-Belmonte, J., Parra-González, M.E., Segura-Robles, A., & Pozo-Sánchez, S. (2020). Scientific Mapping of Gamification in Web of Science. European Journal of Investigation in Health, Psychology and Education, 10, 832-847. https://doi.org/10.3390/ejihpe10030060
  • López-Belmonte, J., Segura-Robles, A., Fuentes-Cabrera, A., & Parra-González, M.E. (2020). Evaluating Activation and Absence of Negative Effect: Gamification and Escape Rooms for Learning. International Journal of Environmental Research and Public Health, 17(7), 1-12. https://doi.org/10.3390/ijerph17072224
  • López, J. (2015). Experiencia docente mediante la metodología de Aprendizaje Basado en Problemas. Ikastorratza, e-Revista de didáctica, 14, 72-85.
  • Malone, T.W., & Lepper, M.R. (1987). Making learning fun: A taxonomy of intrinsic motivations for learning. Aptitude, learning, and instruction, 3, 223-253.
  • Malone, T.W. (1980). What makes things fun to learn? Heuristics for designing instructional computer games. In Proceedings of the 3rd ACM SIGSMALL Symposium and the First SIGPC Symposium on Small Systems (162-169). https://doi.org/10.1145/800088.802839
  • Marín-Marín, J.A., Campos-Soto, M.N., Navas-Parejo, M.R., & Gómez-García, G. (2022). Gamification as a Motivational and Socio-educational Resource in Classrooms with Students at Risk of Social Exclusion. In: De la Prieta F., Gennari, R., Temperini, M., Di Mascio, T., Vittorini, P., Kubincova, Z. et al. (Eds.), Methodologies and Intelligent Systems for Technology Enhanced Learning. 11th International Conference. MIS4TEL 2021. Lecture Notes in Networks and Systems, 326. Cham: Springer. https://doi.org/10.1007/978-3-030-86618-1_19
  • Márquez-Hernández, V.V., Garrido-Molina, J.M., Gutiérrez-Puertas, L., García-Viola, A., Aguilera-Manrique, G., & Granados-Gámez, G. (2019). How to measure gamification experiences in nursing? Adaptation and validation of the Gameful Experience Scale. Nurse Education Today, 81, 34-38. https://doi.org/10.1016/j.nedt.2019.07.005
  • Montaner-Marco, J. (2019). Gamification Strategies as Socialization Tools in the Context of Pediatric Hospitalization. Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (35-39). https://doi.org/10.1145/3341215.3356328
  • Moreno-Guerrero, A., Soler-Costa, R., Marín-Marín, J., & López-Belmonte, J. (2021). Flipped learning and good teaching practices in secondary education. Comunicar, 68, 107-117. https://doi.org/10.3916/C68-2021-09
  • Morillas-Barrio, C., Munoz-Organero, M., & Sanchez Soriano, J. (2016). Can Gamification Improve the Benefits of Student Response Systems in Learning? An Experimental Study. IEEE Transactions on Emerging Topics in Computing, 4(3), 429-438. https://doi.org/10.1109/TETC.2015.2497459
  • Ortiz-Colón, A., Jordán, J., & Agreda, M. (2018). Gamificación en educación: una panorámica sobre el estado de la cuestión. Educaçao E Pesquisa, 44, 1-17. https://doi.org/10.1590/s1678-4634201844173773
  • Palacios, S., & Medrano, M. (2007). Elaboración y validación de la escala de dominios de valores televisivos (EDVT). Revista De Investigación Educativa, 25(2), 403-420.
  • Parra-González, M.E., López-Belmonte, J., Segura-Robles, A., & Moreno-Guerrero, A.J. (2021). Spanish Adaptation and Validation of the Teaching and Learning Experiences Questionnaire. International Journal of Environmental Research and Public Health, 18, 3518. https://doi.org/10.3390/ijerph18073518
  • Parra-González, M.E., Segura-Robles, A., & Gómez-Barajas, E.R. (2020). Assessing Gamified Experiences in Physical Education Teachers and Students. IJERI. International Journal of Educational Research and Innovation, (13), 166-176. https://doi.org/10.46661/ijeri.4595
  • Piaget, J. (1962). Play, dreams and imitation in childhood. New York: W.W. Norton & Co.
  • Pintrich, P.R., & Schunk, D.H. (2006). Motivación en contextos educativos. Teoría, investigación y aplicaciones. Madrid: Pearson Prentice Hall.
  • Pozo-Sánchez, S., López-Belmonte, J., Fuentes-Cabrera, A., & López-Núñez, J.A. (2020). Gamification as a Methodological Complement to Flipped Learning–An Incident Factor in Learning Improvement. Multimodal Technologies and Interaction, 4(2), 1-13. https://doi.org/10.3390/mti4020012
  • Robson, K., Plangger, K., Kietzmann, J., McCarthy, I., & Pitt, L. (2016). Game on: Engaging customers and employees through gamification. Business Horizons, 59(1), 29-36. https://doi.org/10.1016/j.bushor.2015.08.002
  • Seaborn, K., & Fels, D. (2015). Gamification in theory and action: A survey. International Journal of Human-Computer Studies, 74, 14-31. https://doi.org/10.1016/j.ijhcs.2014.09.006
  • Segura-Robles, A., Fuentes-Cabrera, A., Parra-González, M.E., & López-Belmonte, J. (2020). Effects on Personal Factors Through Flipped Learning and Gamification as Combined Methodologies in Secondary Education. Frontiers in Psychology, 11, 1-8. https://doi.org/10.3389/fpsyg.2020.01103
  • Segura-Robles, A., Moreno-Guerrero, A.J., Parra-González, M.E., & López-Belmonte, J. (2021). Adaptation and Validation of the Motivated Strategies for Learning Questionnaire for Spanish Adolescents. European Journal of Investigation in Health, Psychology and Education, 11, 142-153. https://doi.org/10.3390/ejihpe11010012
  • Simpson, E., & Clem, F. (2008). Video Games in the Middle School Classroom. Middle School Journal, 39(4), 4-11. https://doi.org/10.1080/00940771.2008.11461638
  • Tabachnick, B.G., & Fidell, L.S. (2007). Using multivariate statistics (5th ed.). Boston, MA: Pearson Education.
  • Thompson, B. (2005). Exploratory and confirmatory factor analysis. Washington, DC: American Psychological Association.
  • Wang, A.I. (2015). The wear out effect of a game-based student response system. Computers & Education, 82, 217-227. https://doi.org/10.1016/j.compedu.2014.11.004
  • Weston, R., & Gore Jr., P.A., (2006). A Brief Guide to Structural Equation Modeling. The Counseling Psychologist, 34(5), 719-751. https://doi.org/10.1177/0011000006286345
  • Zichermann, G., & Cunningham, C. (2011). Gamification by Design: Implementing Game Mechanics in Web and Mobile Apps. Cambridge: O’Reilly Media
  • Quintero, L., Jiménez, F., & Area, M. (2018). Más allá del libro de texto. La gamificación mediada con TIC como alternativa de innovación en Educación Física. Retos: nuevas tendencias en educación física, deporte y recreación, 34, 343-348. https://doi.org/10.47197/retos.v0i34.65514
  • Ratnawati, N., Sukamto, S., Ruja, I., & Wahyuningtyas, N. (2020). “Defense of the Ancients”, Gamification in Learning: Improvement of Student’s Social Skills. International Journal of Emerging Technologies in Learning (IJET), 15(7), 132-140. https://doi.org/10.3991/ijet.v15i07.13221