Digital rubric-based assessment of oral presentation competence with technological resources for preservice teachers

  1. Ana-Belén Pérez-Torregrosa 1
  2. María-Jesús Gallego-Arrufat 2
  3. Manuel Cebrián-de-la-Serna 3
  1. 1 Departamento de Didáctica y Organización Escolar, Facultad de Ciencias de la Educación, Universidad de Málaga
  2. 2 Departamento de Didáctica y Organización Escolar, Facultad de Ciencias de la Educación, Universidad de Granada
  3. 3 Departamento de Didáctica y Organización Escolar, Facultad de Ciencias de la Educación
Mostrar afiliaciones +
Revista:
ESE: Estudios sobre educación.

ISSN: 1578-7001

Año de publicación: 2022

Número: 43

Páginas: 177-198

Tipo: Artículo

DOI: 10.15581/004.43.009 DIALNET GOOGLE SCHOLAR lock_openAcceso abierto editor

Otras publicaciones en: ESE: Estudios sobre educación.

Resumen

Evaluación basada en rúbricas digitales de la competencia de presentación oral con recursos tecnológicos para profesorado en formación Este estudio está dirigido a la e-evaluación de la competencia de presentación oral utilizando recursos tecnológicos en un modelo activo que combina aprendizaje basado en proyectos y aula invertida. Este estudio aplica el uso de una rúbrica digital para la evaluación de la competencia en presentación oral en diferentes situaciones de evaluación activa y progresiva de 99 futuros docentes en las que la participación es opcional u obligatoria. Los resultados muestran que la rúbrica digital empleada en varios momentos es una metodología y una tecnología que facilita el proceso de retroalimentación y diálogo entre docentes y estudiantes sobre los criterios de evaluación. Los resultados apoyan futuras decisiones de diseño metodológico de evaluación formativa apropiadas en entornos de aprendizaje online.

Referencias bibliográficas

  • Biggs, J. B. (2003). Teaching for quality learning at university: What the student does. Open University Press.
  • Bower, M., Cavanagh, M., Moloney, R., and Dao, M. (2011). Developing communication competence using an online video reflection system: Pre-service teachers' experiences. Asia-Pacific Journal of Teacher Education, 39(4), 311-326. https://doi.org/10.1080/1359866X.2011.614685
  • Campbell, K. S., Mothersbaugh, D. L., Brammer, C., and Taylor, T. (2001). Peer versus self assessment of oral business presentation performance. Business Communication Quarterly, 64(3), 23-40. https://doi.org/10.1177/108056990106400303
  • Cebrián-de-la-Serna, M., and Bergman, M. E. (2014). Formative Assessment with eRubrics: an Approach to the State of the Art. REDU. Revista de Docencia Universitaria, 12(1). 15-29. https://doi.org/10.4995/redu.2014.6427
  • Cohen, L. M., Mannion, L. L., and Morrison, K. (2011). Research methods in education. New York.
  • Crawford, A. R., Johnson, E. S., Zheng, Y. Z., and Moylan, L. A. (2020). Developing an understanding procedures observation rubric for mathematics intervention teachers. School Science and Mathematics, 120(3), 153-164. https://doi.org/10.1111/ssm.12393
  • Creswell, J. W., and Creswell, J. D. (2018). Research design: qualitative, quantitative, and mixed methods approaches. SAGE.
  • De Grez, L., Valcke, M., and Roozen, I. (2009a). The impact of an innovative instructional intervention on the acquisition of oral presentation skills in higher education. Computers and Education, 53(1), 112-120. https://doi.org/10.1016/j.compedu.2009.01.005
  • De Grez, L., Valcke, M., and Roozen, I. (2009b). The impact of goal orientation, self-reflection and personal characteristics on the acquisition of oral presentation skills. European Journal of Psychology of Education, 24(3), 293-306. https://doi.org/10.1007/BF03174762
  • De Grez, L., Valcke, M., and Roozen, I. (2012). How effective are self-and peer assessment of oral presentation skills compared with teachers' assessments? Active Learning in Higher Education, 13(2), 129-142. https://doi.org/10.1177/1469787412441284
  • Delgado, M. A., and Fonseca-Mora, M. C. (2010). The use of co-operative work and rubrics to develop competences. Education for Chemical Engineers, 5(3), e33-e39. https://doi.org/10.1016/j.ece.2010.05.002
  • Dunbar, N. E., Brooks, C. F., and Kubicka-Miller, T. (2006). Oral communication skills in higher education: Using a performance-based evaluation rubric to assess communication skills. Innovative Higher Education, 31(2), 115-128. https://doi.org/10.1007/s10755-006-9012-x
  • Falchikov, N., and Goldfinch, J. (2000). Student peer assessment in higher education: A meta-analysis comparing peer and teacher marks. Review of Educational Research, 70(3), 287-322. https://doi.org/10.3102/00346543070003287
  • Fernández-Medina, C., Luque-Guerrero, C., Ruiz-Rey, F., Rivera-Rogel, D., Andrade Vargas, L., and Cebrián-de-la-Serna, M. (2021). Assessment oral competence with digital rubrics for the Ibero-American Knowledge Space. Pixel-Bit. Revista de Medios y Educación, 62, 71-106. https://doi.org/10.12795/pixelbit.83050
  • Galván-Sánchez, I., Verano-Tacoronte, D., González-Betancor, S. M., Fernández- Monroy, M., and Bolívar-Cruz, A. (2017). Assessing oral presentation skills in Electrical Engineering: Developing a valid and reliable rubric. International Journal of Electrical Engineering Education, 54(1), 17-34. https://doi.org/10.1177/0020720916659501
  • Haanstad, E. J. (2020). Collaborative Ethnographic Assessment: An Anthropological Rubric for a Community Ecosystem. Teaching Anthropology, 9(2), 1-8. https://doi.org/10.22582/ta.v9i2.528
  • Houston, D., and Thompson, J. N. (2017). Blending Formative and Summative Assessment in a Capstone Subject:'It's not your tools, it's how you use them'. Journal of University Teaching and Learning Practice, 14(3), 2. https://doi.org/10.53761/1.14.3.2
  • Jönsson, A., and Panadero, E. (2017). The use and design of rubrics to support assessment for learning. In D. Carless, S.M. Bridges, C.K.Y. Chan and R. Glofcheski R (Eds.), Scaling up assessment for learning in higher education (pp. 99-111). Springer. https://doi.org/10.1007/978-981-10-3045-1_7
  • Li, H., Xiong, Y., Zang, X., L. Kornhaber, M., Lyu, Y., Chung, K. S., and K. Suen, H. (2016). Peer assessment in the digital age: A meta-analysis comparing peer and teacher ratings. Assessment and Evaluation in Higher Education, 41(2), 245- 264. https://doi.org/10.1080/02602938.2014.999746
  • Madruga, T., Thiam, S., Vasquez, A., Kothari, R., and Krauss, G. G. (2020). Reviewer perspective impact on design review feedback. The International Journal of Engineering Education, 36(2), 675-686.
  • Magin, D., and Helmore, P. (2001). Peer and teacher assessments of oral presentation skills: how reliable are they? Studies in Higher Education, 26(3), 287-298. https://doi.org/10.1080/03075070120076264
  • Menéndez-Varela, J. L., and Gregori-Giralt, E. (2016). The contribution of rubrics to the validity of performance assessment: a study of the conservationrestoration and design undergraduate degrees. Assessment and Evaluation in Higher Education, 41(2), 228-244. https://doi.org/10.1080/02602938.2014.998169
  • Meyers, N. M., and Nulty, D. D. (2009). How to use (five) curriculum design principles to align authentic learning environments, assessment, students' approaches to thinking and learning outcomes. Assessment and Evaluation in Higher Education, 34(5), 565-577. https://doi.org/10.1080/02602930802226502
  • Morreale, S. P., Valenzano, J. M., and Bauer, J. A. (2017). Why communication education is important: A third study on the centrality of the discipline's content and pedagogy. Communication Education, 66(4), 402-422. https://doi.org/10.1080/03634523.2016.1265136
  • Montalvão, D., and Baker, T. (2015). Correlating peer and tutor assessment on a lowstakes engineering assignment. International Journal of Mechanical Engineering Education, 43(3), 168-179. https://doi.org/10.1177/0306419015603008
  • Mulder, M. (2014). Conceptions of professional competence. In S. Billett, C. Harteis, and H. Gruber (Eds.), International handbook of research in professional and practice-based learning (pp. 107-137). Springer. https://doi.org/10.1007/978-94-017-8902-8_5
  • Nordrum, L., Evans, K., and Gustafsson, M. (2013). Comparing student learning experiences of in-text commentary and rubric-articulated feedback: strategies for formative assessment. Assessment and Evaluation in Higher Education, 38(8), 919-940. https://doi.org/10.1080/02602938.2012.758229
  • Pathak, A., and Le Vasan, M. (2015). Developing Oral Presentation Competence in Professional Contexts: A Design-Based Collaborative Approach. International Journal of Evaluation and Research in Education, 4(4), 179-184. https://doi.org/10.11591/ijere.v4i4.4509
  • Redecker, C. (2017). European framework for the digital competence of educators: Dig- CompEdu. Report for the European Union no. JRC107466. Joint Research Centre.
  • Romero-García, C., Buzón-García, O., Sacristán-San-Cristóbal, M., and Navarro- Asencio, E. (2020). Evaluation of a Program for the Improvement of Learning and Digital Competence in Future Teachers Utilizing Active Methodologies. Estudios sobre Educación, 39, 179-205. https://doi.org/10.15581/004.39.179-205
  • Skovholt, K., Nordenström, E., and Stokoe, E. (2019). Evaluative conduct in teacher- student supervision: When students assess their own performance. Linguistics and Education, 50, 46-55. https://doi.org/10.1016/j.linged.2019.03.001
  • van Ginkel, S., Gulikers, J., Biemans, H., and Mulder, M. (2015). Towards a set of design principles for developing oral presentation competence: A synthesis of research in higher education. Educational Research Review, 14, 62-80. https://doi.org/10.1016/j.edurev.2015.02.002
  • van Ginkel, S., Gulikers, J., Biemans, H., and Mulder, M. (2017). The impact of the feedback source on developing oral presentation competence. Studies in Higher Education, 42(9), 1671-1685. https://doi.org/10.1080/03075079.2015.1117064
  • van Ginkel, S., Laurentzen, R., Mulder, M., Mononen, A., Kyttä, J., and Kortelainen, M. J. (2017). Assessing oral presentation performance: Designing a rubric and testing its validity with an expert group. Journal of Applied Research in Higher Education, 9(3), 474-486. https://doi.org/10.1108/JARHE-02-2016-0012
  • Zheng, L., Chen, N. S., Cui, P., and Zhang, X. (2019). A Systematic Review of Technology-Supported Peer Assessment Research: An Activity Theory Approach. International Review of Research in Open and Distributed Learning, 20(5), 168-191. https://doi.org/10.19173/irrodl.v20i5.4333
Fuente de los datos: Dialnet