Consideraciones metodológicas sobre uso del impacto normalizado en convocatorias Severo Ochoa y María de Maeztu

  1. Daniel Torres-Salinas 1
  2. Nicolás Robinson-García 1
  3. Enrique Herrera-Viedma 1
  4. Evaristo Jiménez-Contreras 1
  1. 1 Universidad de Granada
    info

    Universidad de Granada

    Granada, España

    ROR https://ror.org/04njjy449

Journal:
El profesional de la información

ISSN: 1386-6710,  1699-2407

Year of publication: 2018

Issue Title: Indicadores I

Volume: 27

Issue: 2

Pages: 367-374

Type: Article

DOI: 10.3145/EPI.2018.MAR.15 DIALNET GOOGLE SCHOLAR lock_openOpen access editor

More publications in: El profesional de la información

Sustainable development goals

Abstract

In 2011, the research programmes for Support and accreditation of Severo Ochoa Centers of Excellence and Units of Excellence María de Maeztu were launched for the first time. Since then, these accreditations have become one of the axes of the Spanish scientific policy. In these years, € 186 million have been distributed and 26 centers and 16 units have been accredited. At the bibliometric level, one of the most relevant evaluation criteria is the need for guarantor researchers to have a Normalized Impact of, at least, 1.5. In this work, we critically analyze the origin of this bibliometric indicator in the eighties, the variants that have been proposed and the limitations of its use in this national call. Finally we offer a series of practical recommendations for a more accurate use of the Normalized Impact indicator for evaluative purposes.

Bibliographic References

  • Cabezas-Clavijo, Álvaro; Torres-Salinas, Daniel (2015). Los sexenios de investigación. Barcelona: UOC, colección El profesional de la información, n. 29. ISBN: 978 84 9064 530 7
  • De-Bruin, Renger E.; Kint, André; Luwel, Mark; Moed, Henk F. (1993). “A study of research evaluation and planning: The University of Ghent”. Research evaluation, v. 3, n. 1, pp. 25-41. https://goo.gl/k3PFGX https://doi.org/10.1093/rev/3.1.25
  • Lundberg, Jonas (2007). “Lifting the crown—citation z-score”. Journal of informetrics, v. 1, n. 2, pp. 145-154. https://www.researchgate.net/publication/220065906_ Lifting_the_crown_-_citation_z-score https://doi.org/10.1016/j.joi.2006.09.007
  • Moed, Henk F.; De-Bruin, Renger E.; Van-Leeuwen, Thed N. (1995). “New bibliometric tools for the assessment of national research performance: Database description, overview of indicators and first applications”. Scientometrics, v. 33, n. 3, pp. 381-422 https://goo.gl/QjBiWd https://doi.org/10.1007/BF02017338
  • Opthof, Tobias; Leydesdorff, Loet (2010). “Caveats for the journal and field normalizations in the CWTS (“Leiden”) evaluations of research performance”. Journal of informetrics, v. 4, n. 3 pp. 423-430. https://arxiv.org/abs/1002.2769 https://doi.org/10.1016/j.joi.2010.02.003
  • Robinson-García, Nicolás (2017). “Los resultados del REF2014 del Reino Unido marcan el camino a seguir en la evaluación científica”. Blok de BiD, 12 diciembre. http://www.ub.edu/blokdebid/es/node/831
  • Schubert, Andras; Glänzel, Wolfgang; Braun, Tibor (1983). “Relative citation rate: A new indicator for measuring the impact of publications”. En: Tomov, D.; Dimitrova, L. (eds.). Proceedings of the First national conf with intl participation on scientometrics and linguistics of scientific text, Varna, pp. 80-81. https://goo.gl/P1X3UU
  • Van-Raan, Anthony (1999). “Advanced bibliometric methods for the evaluation of universities”. Scientometrics, v. 45, n. 3, pp. 417-423. https://goo.gl/8dcnoK https://doi.org/10.1007/BF02457601
  • Van-Raan, Anthony; Van-Leeuwen, Thed N.; Visser, Martijn S.; Van-Eck, Nees J.; Waltman, Ludo (2010). “Rivals for the crown: Reply to Opthof and Leydesdorff”. Journal of informetrics, v. 4, n. 3, pp. 431-435. https://arxiv.org/pdf/1003.2113.pdf https://doi.org/10.1016/j.joi.2010.03.008
  • Vinkler, Peter (1986). “Evaluation of some methods for relative assessment of scientific publications”. Scientometrics, v. 10, n. 3-4, pp. 159-177. https://goo.gl/QuV9LB https://doi.org/10.1007/BF02026039
  • Waltman, Ludo; Van-Eck, Nees J.; Van-Leeuwen, Thed N.; Visser, Martijn S.; Van-Eck, Nees J. (2011a). “Towards a new crown indicator: Some theoretical considerations”. Journal of informetrics, v. 5, n. 1, pp. 37-47. https://arxiv.org/pdf/1003.2167.pdf https://doi.org/10.1016/j.joi.2010.08.001
  • Waltman, Ludo; Van-Eck, Nees J.; Van-Leeuwen, Thed N.; Visser, Martijn S.; Van-Eck, Nees J. (2011b). “Towards a new crown indicator: An empirical analysis”. Scientometrics, v. 87, n. 3, pp. 467-481. https://doi.org/10.1007/s11192-011-0354-5
Data source: Dialnet