Self-assessment vs. external evaluation of proficiency in English as a foreign language among student teachers

  1. Carlos L. Salvadores Merino 1
  1. 1 Universidad de Granada
    info

    Universidad de Granada

    Granada, España

    ROR https://ror.org/04njjy449

Revista:
ReiDoCrea: Revista electrónica de investigación y docencia creativa

ISSN: 2254-5883

Año de publicación: 2019

Título del ejemplar: Monográfico especial sobre perspectivas transnacionales en la enseñanza de lenguas

Volumen: 8

Páginas: 324-337

Tipo: Artículo

DOI: 10.30827/DIGIBUG.58464 DIALNET GOOGLE SCHOLAR lock_openAcceso abierto editor

Otras publicaciones en: ReiDoCrea: Revista electrónica de investigación y docencia creativa

Resumen

Uno de los objetivos de la Educación Superior es la promoción del aprendizaje a lo largo de la vida y la autoevaluación puede considerarse como uno de sus pilares fundamentales. Sin embargo, existen serias dudas sobre su fiabilidad y validez como herramienta de evaluación. El objetivo de este estudio correlacional es explorar la precisión de la autoevaluación contrastada con las pruebas objetivas comparando los resultados de las correlaciones entre las pruebas de autoevaluación realizadas por 46 estudiantes universitarios de inglés como lengua extranjera y su evaluación externa, corregida por el profesorado, a fin de comprobar la precisión de la autoevaluación. Como instrumento de autoevaluación se utilizaron los impresos de la Biografía del PEL y para la evaluación externa un modelo tipo de las pruebas del FCE administradas por UCLES. Los resultados globales mostraron altos coeficientes de correlación, demostrando que los estudiantes fueron precisos en la autoevaluación de su dominio de la lengua inglesa, siendo éstos mayores en las destrezas orales pero más bajos en las escritas. Los resultados también revelaron correlaciones más altas en las destrezas de expresión que en las de comprensión. Este estudio contribuye a confirmar la precisión y validez de la autoevaluación como instrumento de evaluación.

Referencias bibliográficas

  • Ackerman, P.L., Beier, M.E. & Bowen, K.R. (2002) What we really know about our abilities and our knowledge. Personality and Individual Differences, 33, 587-605.
  • Alderson, C.J. & Huhta, A. (2005) The Development of a Suite of ComputerBased Diagnostic Tests Based on the Common European Framework. Language Testing, 22, 301-320.
  • Bachman, L.F. & Palmer, A.S. (1989) The construct validation of self-ratings of communicative language ability. Language Testing, 6 (1), 14-29.
  • Bachman, L.F. (2000) Modern language testing at the turn of the century: assuring that what we count counts. Language Testing, 17, 1-42.
  • Bachman, L.F. (2004) Statistical Analysis for Language Assessment. Cambridge: Cambridge University Press.
  • Bailey, K.M. (1996) Working for washback: a review of the washback concept in language testing. Language Testing, 13, 257-279.
  • Baleghizadeh, S. & Hajizadeh, T. (2014) Self- and Teacher-Assessment in an EFL Writing Class 1, Gist Education and Learning Research Journal, 8(8), 99-117.
  • Blanche, P. & Merino, B. (1989) Self-Assessment of Foreign-Language Skills: Implications for Teachers and Researchers. Language Learning: A Journal of Applied Linguistics, 39, 313-340.
  • Blue, G.M. (1988) Self-assessment – the limits of learner independence. In A. Brookes (ed.) Individualisation and Autonomy in Language Learning. ELT Documents 131. London: Modern English Publications/British Council.
  • Boud, D. & Falchicov, N. (1989) Quantitative studies of students’ selfassessment in higher education: a critical analysis of findings. Higher Education, 18, 529-549.
  • Boud, D. & Falchicov, N. (2006) Aligning assessment with long-term learning. Assessment and Evaluation in Higher Education, 31, 399-413.
  • Boud, D., Lawson R. & Thompson, D. (2013) Does student engagement in selfassessment calibrate their judgement over time? Assessment & Evaluation in Higher Education , 38:8, 941-956, DOI: 10.1080/02602938.2013.769198
  • Brantmeier, C., Vanderplank, R., & Strube, M. (2012) What about me? Individual self-assessment by skill and level of language instruction. System, 40(1), 144-160.
  • Brown, J.D. & Hudson, T (1998) The Alternatives in Language Assessment. TESOL Quarterly, 32, 653-675.
  • Brown, D.H. (2004) Language Assessment: Principles and Classroom Practice. New York: Pearson Education.
  • Brown, N. A., Dewey, D. P., & Cox, T. L. (2014). Assessing the validity of can-do statements in retrospective (then-now) self-assessment. Foreign Language Annals, 47(2), 261-285.
  • Chen, Y. (2008) Learning to self-assess oral performance in English: A longitudinal case study. Language Teaching Research, 12, 235-262.
  • Cohen, J. (1977) Statistical Power Analysis for the Behavioral Sciences (revised edition). New York: Academic Press.
  • Cohen, & Manion, (1990) Métodos de Investigación Educativa. Madrid: Ediciones la Muralla.
  • Council of Europe. (2001) The Common European Framework of Reference for Languages: Learning, teaching, assessment. Cambridge: Cambridge University Press.
  • Council of Europe. (2018). Common European Framework of Reference for Languages: learning, teaching, assessment companion volume with new descriptors. Strasbourg: Council of Europe. Retrieved from https://rm.coe.int/cefr-companion-volume-with-newdescriptors2018/1680787989
  • Davidson, F. & Henning, G. (1985) A self-rating scale of English difficulty: Rasch scalar analysis. Language Testing, 2; 164-169.
  • Delgado, P., Guerrero, G., Goggin, J. & Ellis, B. (1999) Self-Assessment of linguistic skills by bilingual Hispanics. Hispanic Journal of Behavioural Sciences, 21 (1), 34-46.
  • Dickinson, L. (1987) Self-Instruction in Language Learning. Cambridge: Cambridge University Press.
  • Dobson, A. (2006) Algunos aspectos de las políticas del Consejo de Europa para la educación lingüística: el Marco Común Europeo de Referencia y el Portfolio Europeo de las Lenguas. In El Portfolio Europeo de las Lenguas y sus Aplicaciones en el Aula. Madrid: Subdirección General de Información y Publicaciones del MEC.
  • Dochy, F., Segers, M. & Sluijsmans, D. (1999) The use of self-, peer and coassessment in higher education: a review. Studies in Higher Education, 24, 331-350.
  • Dolosic, H. N., Brantmeier, C., Strube, M., & Hogrebe, M. C. (2016). Living language: Self-assessment, oral production, and domestic immersion. Foreign Language Annals, 49(2), 302-316. Edele, A.,
  • Falchikov, N. & Boud, D. (1989) Student Self-Assessment in Higher Education: A Meta-Analysis. Review of Educational Research, 59, 395-430.
  • Finch, A. (2003) Reflective Instruments for Self-Assessment in Korean EFL Classrooms. The Korean TESOL Journal, 6, 63-86.
  • Finnie, R. & Meng, R. (2005) Literacy and labour market outcomes: Selfassessment versus test score measures. Applied Economics, 37(17), 1935-1951.
  • García, F., Guillén, C., González Piñero, M., González Porto, J., Serna, I. & Vez, J.M. (2004) Marco y Portafolio: Porta Linguarum para los Europeos, Porta Linguarum, 2, 69-92.
  • Gardner, R.C. (2003) Estadística para Psicología Usando SPSS para Windows. Traducción de Roberto Escalona García. Pearson Educación: México.
  • Harris, M. (1997) Self-assessment of language learning in formal settings. In ELT Journal Vol. 51/1, pp. 12-20. Oxford: Oxford University Press.
  • Heilenman, L.K. (1990) Self-assessment of second language ability: the role of response effects. Language Testing, 7, 174-201.
  • Henner-Stanchina, C. & Holec, H. (1985) Evaluation in an autonomous learning scheme. In P. Riley (ed.) Discourse and Learning. London: Longman.
  • Holec, H. (1980) Autonomy in Foreign Language Learning. Oxford: Pergamon.
  • Jansen-van Dieten, A. (1989) The development of a test of Dutch as a foreign language: the validity of self-assessment by inexperienced subjects. Language Testing, 6, 30-46.
  • Jiménez Jiménez, M.A. (2003) La competencia lingüística de los alumnos de la titulación de Maestro- Especialidad de Lengua extranjera (Inglés). Estudio de casos. Unpublished doctoral thesis, University of Granada.
  • Knowles, M.S. (1975) Self-directed Learning. New York: Association Press.
  • LeBlanc, R. & Painchaud, G. (1985) Self-Assessment as a Second Language Placement Instrument. TESOL Quarterly, 19 (4), 673-686.
  • Little, D. (2002). The European Language Portfolio: Structure, origins, implementation and challenges. Language Teaching, 35(3), 182-189. doi:10.1017/S0261444802001805
  • Little, D. (2005). The Common European Framework and the European Language Portfolio: involving learners and their judgements in the assessment process. Language Testing, 22(3), 321–336. https://doi.org/10.1191/0265532205lt311oa
  • Liu, H., & Brantmeier, C. (2019). “I know English”: Self-assessment of foreign language reading and writing abilities among young Chinese learners of English. System, 80, 60-72. https://doi.org/10.1016/j.system.2018.10.013
  • Ma, W., & Winke, P. (2019). Self-assessment: How reliable is it in assessing oral proficiency over time?. Foreign Language Annals, 52(1), 66-86. https://doi.org/10.1111/flan.12379
  • Malabonga, V., Kenyon, D. M., & Carpenter, H. (2005). Self-assessment, preparation and response time on a computerized oral proficiency test. Language Testing, 22(1), 59-92.
  • Ministerio de Educación, Ciencias y Deporte (2002) Marco Común Europeo de Referencia de la Lenguas: Aprendizaje, Enseñanza y Evaluación. Madrid: Secretaría General Técnica del MECD y Grupo Anaya.
  • Mirici, I. H. (2008). Development and validation process of a European language portfolio model for young learners. Online Submission, 9(2), 26-34Nunan, D. (1988) Syllabus Design. Oxford. Oxford University Press.
  • Oscarsson, M. (1978) Approaches to Self-assessment in Foreign Language Learning. Council of Europe: Pergamon Press.
  • Oscarsson, M. (1984) Self-Assessment of Foreign Language Skills: a Survey of Research and Development Work. Strasbourg: Council of Europe.
  • Oscarsson, M. (1989) Self-assessment of language proficiency: rationale and implications. In RELC Journal, 19 (1), 75-93.
  • Oscarsson, M. (2013). Self-Assessment in the Classroom. In The Companion to Language Assessment, A. J. Kunnan (Ed.). doi:10.1002/9781118411360.wbcla046
  • Peirce, B.N., Swain, M. & Hart, D. (1993) Self-assessment, French immersion and locus of control. Applied Linguistics. 14 , 25-42. Portfolio Adultos (de 16 o más años) - Modelo acreditado 59.2004. PEL Adultos impresos 2004, available from http://sepie.es/doc/portfolio/pelAdultosimpresos2004.pdf, accessed 24 september, 2017
  • Real Decreto 1629/2006, de 29 de diciembre, por el que se fijan los aspectos básicos del currículo de las enseñanzas de idiomas de régimen especial reguladas por la Ley Orgánica 2/2006, de 3 de mayo, de Educación, num. 4,pp 465-473, available from https://www.boe.es/boe/dias/2007/01/04/pdfs/A00465-00473.pdf, accessed 20 October, 2017
  • Román, S. N., & Soriano, S. A. (2015). Autonomous Learning and SelfAssessment through the European Language Portfolio (elp): A Pilot Study on Primary Education. The Journal of Language Learning and Teaching, 5(2), 37-53.
  • Ross, S. (1998) Self-assessment in second language testing: a meta-analysis and analysis of experimental factors. Language Testing, 15 (1) 1-20.
  • Runnels, J. (2016) Self-Assessment Accuracy: Correlations between Japanese English Learners' Self-Assessment on the CEFR--Japan's Can Do Statements and Scores on the TOEIC®. Taiwan Journal of TESOL, v13 n1 p105-137.
  • Savignon, S.J. (1983) Communicative Competence: Theory and Classroom Practice. Massachusetts: Addison-Wesley Publishing Company.
  • Seuring, J., Kristen, C. & Stanat, P. (2015) Why bother with testing? The validity of immigrants’ self-assessed language proficiency. Social Science Research, 52, 99-123.
  • Stefani, L.A.J. (1994) Peer, self and tutor assessment: relative reliabilities. Studies in Higher Education. 19, 69-75.
  • Sundstroem, A. (2005) Self-assessment of knowledge and abilities: A literatura study. EM, 54, 1-36., available from http://www.nmd.umu.se/digitalAssets/60/60577_em541.pdf, accessed 4 November, 2017.
  • Von Elek, T. (1981) Self-Assessment of Swedish as a Second Language. Göteborg: University of Göteborg (The Language Teaching Research Centre, Work Paper No. 30).
  • Wilson, K.M. (1999) Validity of Global Self-ratings of ESL Proficiency based on an FSI/ILR-Referenced Scale. ETS Report No. RR-99-13, ETS Research Report Series. Statistics & Research Division, Princeton, NJ.
Fuente de los datos: Dialnet