Tools for Evaluating the Content, Efficacy, and Usability of Mobile Health Apps According to the Consensus-Based Standards for the Selection of Health Measurement Instruments: Systematic Review

  1. Muro Culebras, Antonio Luis
  2. Escriche Escuder, Adrián
  3. Martín Martín, Jaime 5
  4. Roldán Jiménez, Cristina 5
  5. Torres Sánchez, I. 6
  6. Ruiz-Muñoz, Maria
  7. González Sánchez, Manuel 35
  8. Mayoral, Fermín 27
  9. Biró, Attila
  10. Tang, Wen
  11. Nikolova, Borjanka
  12. Salvatore, Alfredo
  13. Cuesta Vargas, Antonio Ignacio 1234
  1. 1 Universidad de Málaga (2013)
  2. 2 Instituto de Investigación Biomédica de Málaga - IBIMA
  3. 3 Universidad de Jaén
    info

    Universidad de Jaén

    Jaén, España

    ROR https://ror.org/0122p5f64

  4. 4 Universidad Tecnológica de Queensland, Brisbane
  5. 5 Universidad de Málaga
    info

    Universidad de Málaga

    Málaga, España

    ROR https://ror.org/036b2ww28

  6. 6 Universidad de Granada
    info

    Universidad de Granada

    Granada, España

    ROR https://ror.org/04njjy449

  7. 7 Hospital Regional Universitario de Málaga
    info

    Hospital Regional Universitario de Málaga

    Málaga, España

    ROR https://ror.org/01mqsmm97

Revista:
JMIR mHealth and uHealth

ISSN: 2291-5222

Año de publicación: 2021

Volumen: 9

Número: 12

Páginas: e15433

Tipo: Artículo

DOI: 10.2196/15433 GOOGLE SCHOLAR lock_openAcceso abierto editor

Otras publicaciones en: JMIR mHealth and uHealth

Resumen

Background: There are several mobile health (mHealth) apps in mobile app stores. These apps enter the business-to-customer market with limited controls. Both, apps that users use autonomously and those designed to be recommended by practitioners require an end-user validation to minimize the risk of using apps that are ineffective or harmful. Prior studies have reviewed the most relevant aspects in a tool designed for assessing mHealth app quality, and different options have been developed for this purpose. However, the psychometric properties of the mHealth quality measurement tools, that is, the validity and reliability of the tools for their purpose, also need to be studied. The Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) initiative has developed tools for selecting the most suitable measurement instrument for health outcomes, and one of the main fields of study was their psychometric properties.Objective: This study aims to address and psychometrically analyze, following the COSMIN guideline, the quality of the tools that are used to measure the quality of mHealth apps.Methods: From February 1, 2019, to December 31, 2019, 2 reviewers searched PubMed and Embase databases, identifying mHealth app quality measurement tools and all the validation studies associated with each of them. For inclusion, the studies had to be meant to validate a tool designed to assess mHealth apps. Studies that used these tools for the assessment of mHealth apps but did not include any psychometric validation were excluded. The measurement tools were analyzed according to the 10 psychometric properties described in the COSMIN guideline. The dimensions and items analyzed in each tool were also analyzed.Results: The initial search showed 3372 articles. Only 10 finally met the inclusion criteria and were chosen for analysis in this review, analyzing 8 measurement tools. Of these tools, 4 validated ≥5 psychometric properties defined in the COSMIN guideline. Although some of the tools only measure the usability dimension, other tools provide information such as engagement, esthetics, or functionality. Furthermore, 2 measurement tools, Mobile App Rating Scale and mHealth Apps Usability Questionnaire, have a user version, as well as a professional version.Conclusions: The Health Information Technology Usability Evaluation Scale and the Measurement Scales for Perceived Usefulness and Perceived Ease of Use were the most validated tools, but they were very focused on usability. The Mobile App Rating Scale showed a moderate number of validated psychometric properties, measures a significant number of quality dimensions, and has been validated in a large number of mHealth apps, and its use is widespread. It is suggested that the continuation of the validation of this tool in other psychometric properties could provide an appropriate option for evaluating the quality of mHealth apps.

Información de financiación

European Union’s Horizon 2020 Research and Innovation Programme under the Marie Sklodowska-Curie actions (grant 823871 [Multi-dimensional Intervention Support Architecture for Gamified eHealth and mHealth Products]

Financiadores

Referencias bibliográficas

  • mHealth apps market size, share and trends analysis report by type (Fitness, Medical), by region (North America, APAC, Europe, MEA, Latin America), and segment forecasts, 2021 - 2028Grand View Research20212021-02-07https://www.grandviewresearch.com/industry-analysis/mhealth-app-market
  • 10.2196/mhealth.8758
  • (2019), WHO Guideline: Recommendations on Digital Interventions for Health System Strengthening, pp. 1
  • 10.5210/ojphi.v5i3.4814
  • 10.1111/j.1463-1318.2012.03088.x
  • 10.1016/j.amepre.2013.03.017
  • 10.1093/jamia/ocw166
  • 10.1186/2001-1326-2-10
  • 10.1093/jamia/ocy050
  • Brooke, J, (1996), Usability Evaluation in Industry. 1st ed, pp. 189
  • 10.1089/tmj.2014.0088
  • Gagliardi, A, (2002), Br Med J, 324, pp. 569, 10.1136/bmj.324.7337.569
  • 10.3389/fpsyg.2017.01482
  • Kohan, N, (2002), Rev Latinoam Psicol, 34, pp. 229
  • 10.1007/s11136-018-1798-3
  • 10.1007/s11136-018-1829-0
  • 10.1016/j.jclinepi.2009.06.005
  • 10.1016/j.jclinepi.2010.02.006
  • 10.2196/10308
  • 10.5681/hpp.2014.011
  • 10.1016/j.procs.2015.09.273
  • Brooke, J, (2013), J Usability Stud, 8, pp. 29
  • 10.2307/249008
  • Yen, P, (2010), AMIA Annu Symp Proc, 2010, pp. 917
  • 10.2196/11500
  • 10.1136/amiajnl-2013-001811
  • 10.2196/mhealth.8851
  • 10.1016/j.semerg.2015.12.001
  • 10.2196/mhealth.3422
  • 10.1016/j.ijmedinf.2019.06.005
  • 10.2196/mhealth.5849
  • 10.1080/17538157.2020.1837838
  • 10.2196/13019
  • 10.1515/cclm-2018-0710
  • 10.1111/mcn.12768
  • 10.1097/j.pain.0000000000002090
  • 10.2196/18339
  • 10.1016/j.urology.2020.08.040
  • 10.2196/13236