Mobile health app usability and quality rating scales: a systematic review

References

• Morse SS, Murugiah MK, Soh YC, et al. Mobile health applications for pediatric care: review and comparison. Ther Innov Regul Sci. 2018;52(3):383–391.
   PubMed Web of Science ®Google Scholar
• Research2Guidance. mHealth App Economics 2017/2018. 2017.
   Google Scholar
• Nussbaum R, Kelly C, Quinby E, et al. Systematic review of mobile health applications in rehabilitation. Arch Phys Med Rehabil. 2019;100(1):115–127.
   PubMed Web of Science ®Google Scholar
• Grundy QH, Wang Z, Bero LA. Challenges in assessing mobile health app quality: a systematic review of prevalent and innovative methods. Am J Prev Med. 2016;51(6):1051–1059.
   PubMed Web of Science ®Google Scholar
• Bindhim NF, Naicker S, Freeman B, et al. Apps promoting illicit drugs-a need for tighter regulation? [Article]. J Consum Health Internet. 2014;18(1):31–43.
   Google Scholar
• Singh K, Drouin K, Newmark LP, et al. Many mobile health apps target high-need, high-cost populations, but gaps remain. Health Affairs. 2016;35(12):2310–2318.
   PubMed Web of Science ®Google Scholar
• NHS. NHS Apps Library (beta) 2017. [cited 2018 22/05]. Available from: https://digital.nhs.uk/services/nhs-apps-library.
   Google Scholar
• Larsen ME, Nicholas J, Christensen H. Quantifying app store dynamics: longitudinal tracking of mental health apps. JMIR Mhealth Uhealth. 2016;4(3):e96.
   PubMed Web of Science ®Google Scholar
• Wicks P, Chiauzzi E. 'Trust but verify'–five approaches to ensure safe medical apps. BMC Med. 2015;13(1):205–205.
   PubMedGoogle Scholar
• Nouri R, R Niakan Kalhori S, Ghazisaeedi M, et al. Criteria for assessing the quality of mHealth apps: a systematic review. J Am Med Inform Assoc. 2018;25(8):1089–1098.
   PubMed Web of Science ®Google Scholar
• Fiore P. How to evaluate mobile health applications: a scoping review. Stud Health Technol Inform. 2017;234:109–114.
   PubMedGoogle Scholar
• Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg. 2010;8(5):336–341.
   PubMed Web of Science ®Google Scholar
• Dickersin K, Min YI, Meinert CL. Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards. Jama. 1992;267(3):374–378.
   PubMed Web of Science ®Google Scholar
• Scherer RW, Dickersin K, Langenberg P. Full publication of results initially presented in abstracts. A meta-analysis. Jama. 1994;272(2):158–162.
   PubMed Web of Science ®Google Scholar
• Neubauer NA, Azad-Khaneghah P, Miguel-Cruz A, et al. What do we know about strategies to manage dementia-related wandering? A scoping review. Alzheimer's Dement. 2018;10:615–628.
   Google Scholar
• BinDhim NF, Hawkey A, Trevena L. A systematic review of quality assessment methods for smartphone health apps. Telemed J E Health. 2015;21(2):97–104.
   PubMed Web of Science ®Google Scholar
• Letts L, Wilkins S, Law M, Stewart D, et al. Guidelines for Critical Review Form: Qualitative Studies (Version 2.0): McMaster Univerity; 2007. [cited 2018 28/11]. Available from: https://srs-mcmaster.ca/wp-content/uploads/2015/05/Guidelines-for-Critical-Review-Form-Qualitative-Studies.pdf.
   Google Scholar
• Law M, Stewart D, Pollock N, et al. Guidelines for critial review form-Quantitative studies: McMaster University; 1998. [cited 2018 28/11]. Available from: https://srs-mcmaster.ca/wp-content/uploads/2015/05/Guidelines-for-Critical-Review-Form-Quantitative-Studies.pdf.
   Google Scholar
• Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies [Article]. Health Info Libr J. 2009;26(2):91–108. 06//
   PubMed Web of Science ®Google Scholar
• Price M, Sawyer T, Harris M, et al. Usability evaluation of a mobile monitoring system to assess symptoms after a traumatic injury: a mixed-methods study. JMIR Mental Health. 2016;3(1):e3.
   PubMed Web of Science ®Google Scholar
• O’Malley G, Dowdall G, Burls A, et al. Exploring the usability of a mobile app for adolescent obesity management. Physiotherapy. 2016;102:e44–e45.
   Google Scholar
• Alnasser A, Kyle J, Alkhalifah A, et al. Relationship between evidence requirements, user expectations, and actual experiences: usability evaluation of the twazon arabic weight loss app. JMIR Hum Factors. 2018;5(2):e16.
   PubMedGoogle Scholar
• Bondaronek P, Alkhaldi G, Slee A, et al. Quality of publicly available physical activity apps: review and content analysis. JMIR Mhealth Uhealth. 2018;6(3):e53.
   PubMed Web of Science ®Google Scholar
• Brooks GC, Vittinghoff E, Iyer S, et al. Accuracy and Usability of a Self-Administered 6-minute walk test smartphone application. Circ Heart Fail. 2015;8(5):905–913.
   PubMed Web of Science ®Google Scholar
• Ehrler F, Weinhold T, Joe J, et al. A Mobile App (BEDSide Mobility) to Support Nurses' Tasks at the patient's bedside: usability study. JMIR Mhealth Uhealth. 2018;6(3):e57.
   PubMed Web of Science ®Google Scholar
• Fallah M, Yasini M. A medication reminder mobile app: does it work for different age ranges. Stud Health Technol Inform. 2017;235:68–72.
   PubMedGoogle Scholar
• Ginsburg AS, Delarosa J, Brunette W, et al. mPneumonia: development of an innovative mhealth application for diagnosing and treating childhood pneumonia and other childhood illnesses in low-resource settings. Plos One. 2015;10(10):e0139625–e0139625.
   PubMed Web of Science ®Google Scholar
• Grindrod K, Khan H, Hengartner U, et al. Evaluating authentication options for mobile health applications in younger and older adults. Plos One. 2018;13(1):e0189048–e0189048.
   PubMed Web of Science ®Google Scholar
• Isaković M, Sedlar U, Volk M, et al. Usability Pitfalls of Diabetes mHealth Apps for the Elderly [Article]. J Diabetes Res. 2016;2016:1–9.
   Web of Science ®Google Scholar
• Ithnin M, Mohd Rani MD, Abd Latif Z, et al. Mobile app design, development, and publication for adverse drug reaction assessments of causality, severity, and preventability. JMIR Mhealth Uhealth. 2017;5(5):e78.
   PubMed Web of Science ®Google Scholar
• Mattson DC. Usability assessment of a mobile app for art therapy [Empirical Study]; Interview; Quantitative Study. Art Psychother. 2015;43:1–6.
   Web of Science ®Google Scholar
• Nitsch M, Dimopoulos CN, Flaschberger E, et al. A guided online and mobile self-help program for individuals with eating disorders: an iterative engagement and usability study. J Med Internet Res. 2016;18(1):e7.
   PubMed Web of Science ®Google Scholar
• Sullivan PS, Driggers R, Stekler JD, et al. Usability and acceptability of a mobile comprehensive HIV prevention app for men who have sex with men: a pilot study. JMIR Mhealth Uhealth. 2017;5(3):e26.
   PubMed Web of Science ®Google Scholar
• Villalobos O, Lynch S, DeBlieck C, et al. Utilization of a mobile app to assess psychiatric patients with limited english proficiency. Hispanic J Behav Sci. 2017;39(3):369–380.
   Web of Science ®Google Scholar
• Mattson DC. Usability evaluation of the digital anger thermometer app. Health Informatics J. 2017;23(3):234–245.
   PubMed Web of Science ®Google Scholar
• Barrio P, Ortega L, Lopez H, et al. Self-management and shared decision-making in alcohol dependence via a mobile app: A pilot study. Intj Behav Med. 2017;24(5):722–727.
   PubMed Web of Science ®Google Scholar
• Ward G, Walker-Clarke A, Holliday N. Evaluation of a web-based app to assist home-hazard modification in falls prevention. Brit J Occup Ther. 2017;80(12):735–744.
   Google Scholar
• Martinez-Perez B, de la Torre-Diez I, Candelas-Plasencia S, et al. Development and evaluation of tools for measuring the quality of experience (QoE) in mHealth applications. J Med Syst. 2013;37(5):013–9976.
   Web of Science ®Google Scholar
• Martínez-Pérez B, de la Torre-Díez I, López-Coronado M. Experiences and results of applying tools for assessing the quality of a mHealth app named heartkeeper. J Med Syst. 2015;39(11):142–142.
   PubMed Web of Science ®Google Scholar
• Vélez O, Okyere PB, Kanter AS, et al. A usability study of a mobile health application for rural Ghanaian midwives. J Midwifery Womens Health. 2014;59(2):184–191.
   PubMed Web of Science ®Google Scholar
• Schnall R, Cho H, Liu J. Health information technology usability evaluation scale (Health-ITUES) for usability assessment of mobile health technology: validation study. JMIR Mhealth Uhealth. 2018;6(1):e4.
   PubMed Web of Science ®Google Scholar
• Stonbraker S, Hwayoung C, Hermosi G, et al. Usability testing of a mhealth app to support self-management of HIV-associated non-AIDS Related Symptoms. Stud Health Technol Inform. 2018;250:106–110.
   PubMedGoogle Scholar
• English LL, Dunsmuir D, Kumbakumba E, et al. The PAediatric Risk Assessment (PARA) mobile app to reduce postdischarge child mortality: design, usability, and feasibility for health care workers in Uganda. JMIR Mhealth Uhealth. 2016;4(1):e16.
   PubMed Web of Science ®Google Scholar
• Spook JE, Paulussen T, Kok G, et al. Monitoring dietary intake and physical activity electronically: feasibility, usability, and ecological validity of a mobile-based Ecological Momentary Assessment tool. J Med Internet Res. 2013;15(9):e214.
   PubMed Web of Science ®Google Scholar
• Arnhold M, Quade M, Kirch W. Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older. J Med Internet Res. 2014;16(4):e104.
   PubMed Web of Science ®Google Scholar
• Chenchen G, Lanshu Z, Zhihui L, et al. Mobile application for diabetes self-management in China: Do they fit for older adults? Int J Med Inform. 2017;101:68–74.
   PubMed Web of Science ®Google Scholar
• O'Connor E, Farrow M, Hatherly C. Randomized comparison of mobile and web-tools to provide dementia risk reduction education: use, engagement and participant satisfaction. JMIR Mental Health. 2014;1(1):e4.
   PubMedGoogle Scholar
• Al Ayubi SU, Parmanto B, Branch R, et al. A persuasive and social mHealth application for physical activity: a usability and feasibility study. JMIR Mhealth Uhealth. 2014;2(2):e25.
   PubMed Web of Science ®Google Scholar
• Kuhn E, Greene C, Hoffman J, et al. Preliminary evaluation of PTSD Coach, a smartphone app for post-traumatic stress symptoms. Mil Med. 2014;179(1):12–18.
   PubMed Web of Science ®Google Scholar
• Cho MJ, Sim JL, Hwang SY. Development of smartphone educational application for patients with coronary artery disease. Healthc Inform Res. 2014;20(2):117–124.
   PubMedGoogle Scholar
• Rizvi SL, Hughes CD, Thomas MC. The DBT Coach mobile application as an adjunct to treatment for suicidal and self-injuring individuals with borderline personality disorder: A preliminary evaluation and challenges to client utilization. Psychol Serv. 2016;13(4):380–388.
   PubMed Web of Science ®Google Scholar
• Wilson K, Atkinson KM, Westeinde J, et al. An evaluation of the feasibility and usability of a proof of concept mobile app for adverse event reporting post influenza vaccination. Hum Vaccin Immunother. 2016;12(7):1738–1748.
   PubMed Web of Science ®Google Scholar
• Tay I, Garland S, Gorelik A, et al. Development and testing of a mobile phone app for self-monitoring of calcium intake in young women. JMIR Mhealth Uhealth. 2017;5(3):e27.
   PubMed Web of Science ®Google Scholar
• de la Torre Díez I, Garcia-Zapirain B, López-Coronado M, et al. A new mHealth app for monitoring and awareness of healthy eating: development and user evaluation by spanish users. J Med Syst. 2017;41(7):109–109.
   PubMed Web of Science ®Google Scholar
• Ramos SR. User-centered design, experience, and usability of an electronic consent user interface to facilitate informed decision-making in an HIV clinic. Comput Inform Nurs. 2017;35(11):556–564.
   PubMed Web of Science ®Google Scholar
• Fiks AG, Fleisher L, Berrigan L, et al. Usability, acceptability, and impact of a pediatric teledermatology mobile health application. Telemed J E Health. 2018;24(3):236–245.
   PubMed Web of Science ®Google Scholar
• de la Vega R, Roset R, Galan S, et al. Fibroline: a mobile app for improving the quality of life of young people with fibromyalgia [Cognitive Therapy 3311]. J Health Psychol. 2018;23(1):67–78.
   PubMed Web of Science ®Google Scholar
• Akinola M, Hebert LE, Hill BJ, et al. Development of a mobile app on contraceptive options for young african american and latina women. Health Educ Behav. 2019;46(1):89–96.
   PubMed Web of Science ®Google Scholar
• Wang C-J, Chaovalit P, Pongnumkul S. A breastfeed-promoting mobile app intervention: usability and usefulness study. JMIR Mhealth Uhealth. 2018;6(1):e27.
   PubMed Web of Science ®Google Scholar
• Chyjek K, Farag S, Chen KT. Rating pregnancy wheel applications using the APPLICATIONS scoring system. Obstet Gynecol. 2015;125(6):1478–1483.
   PubMed Web of Science ®Google Scholar
• Perry R, Lunde B, Chen KT. An evaluation of contraception mobile applications for providers of family planning services. Contraception. 2016;93(6):539–544.
   PubMed Web of Science ®Google Scholar
• Loy JS, Ali EE, Yap K-L. Quality assessment of medical apps that target medication-related problems. J Manag Care Spec Pharm. 2016;22(10):1124–1140.
   PubMedGoogle Scholar
• McMillan B, Hickey E, Patel MG, et al. Quality assessment of a sample of mobile app-based health behavior change interventions using a tool based on the National Institute of Health and Care Excellence behavior change guidance. Patient Educ Couns. 2016;99(3):429–435.
   PubMed Web of Science ®Google Scholar
• Baumel A, Faber K, Mathur N, et al. Enlight: a comprehensive quality and therapeutic potential evaluation tool for mobile and web-based eHealth interventions. J Med Internet Res. 2017;19(3):e82.
   PubMed Web of Science ®Google Scholar
• Guo Y, Bian J, Leavitt T, et al. Assessing the quality of mobile exercise apps based on the american college of sports medicine guidelines: a reliable and valid scoring instrument. J Med Internet Res. 2017;19(3):e67.
   PubMed Web of Science ®Google Scholar
• DiFilippo KN, Huang W, Chapman-Novakofski KM. A new tool for nutrition App Quality Evaluation (AQEL): development, validation, and reliability testing. JMIR Mhealth Uhealth. 2017;5(10):e163.
   PubMed Web of Science ®Google Scholar
• Ali EE, Teo AKS, Goh SXL, et al. MedAd-AppQ: A quality assessment tool for medication adherence apps on iOS and android platforms. Research In Social & Administrative Pharmacy: RSAP. 2018.
   Google Scholar
• Van Singer M, Chatton A, Khazaal Y. Quality of smartphone apps related to panic disorder. Front Psychiatry. 2015;6:96.
   PubMed Web of Science ®Google Scholar
• Jeon E, Park H-A, Min YH, et al. Analysis of the information quality of korean obesity-management smartphone applications. Healthc Inform Res. 2014;20(1):23–29.
   PubMedGoogle Scholar
• Zhang MWB, Ho RCM, Hawa R, et al. Analysis of the information quality of bariatric surgery smartphone applications using the silberg scale. Obes Surg. 2016;26(1):163–168.
   PubMed Web of Science ®Google Scholar
• Zhang MW, Ho RC, Loh A, et al. Current status of postnatal depression smartphone applications available on application stores: an information quality analysis. BMJ Open. 2017;7(11):e015655.
   PubMed Web of Science ®Google Scholar
• Anderson K, Burford O, Emmerton L. App chronic disease checklist: protocol to evaluate mobile apps for chronic disease self-management. JMIR Res Protoc. 2016;5(4):e204.
   PubMed Web of Science ®Google Scholar
• Jin M, Kim J. Development and evaluation of an evaluation tool for healthcare smartphone applications. Telemed J E Health. 2015;21(10):831–837.
   PubMed Web of Science ®Google Scholar
• Wyatt JC, Thimbleby H, Rastall P, et al. What makes a good clinical app? Introducing the RCP Health Informatics Unit checklist. Clin Med. 2015;15(6):519–521.
   PubMed Web of Science ®Google Scholar
• Leigh S, Ouyang J, Mimnagh C. Effective? Engaging? Secure? Applying the ORCHA-24 framework to evaluate apps for chronic insomnia disorder. Evid Based Mental Health. 2017;20(4):e20–e20.
   PubMed Web of Science ®Google Scholar
• Mani M, Kavanagh DJ, Hides L, et al. Review and evaluation of mindfulness-based iphone apps. JMIR Mhealth Uhealth. 2015;3(3):e82.
   PubMed Web of Science ®Google Scholar
• Stoyanov SR, Hides L, Kavanagh DJ, et al. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. 2015;3(1):e27.
   PubMed Web of Science ®Google Scholar
• Bardus M, van Beurden SB, Smith JR, et al. A review and content analysis of engagement, functionality, aesthetics, information quality, and change techniques in the most popular commercial apps for weight management. Int J Behav Nutr Phys Act. 2016;13(1):35–35.
   PubMedGoogle Scholar
• Furlong LM, Morris ME, Erickson S, et al. Quality of mobile phone and tablet mobile apps for speech sound disorders: protocol for an evidence-based appraisal. JMIR Res Protoc. 2016;5(4):e233.
   PubMed Web of Science ®Google Scholar
• Hartin PJ, Cleland I, Nugent CD, et al. Assessing app quality through expert peer review: a case study from the gray matters study. Conf Proc IEEE Eng Med Biol Soc. 2016;2016:4379–4382.
   PubMedGoogle Scholar
• Masterson Creber RM, Maurer MS, Reading M, et al. Review and analysis of existing mobile phone apps to support heart failure symptom monitoring and self-care Management Using the Mobile Application Rating Scale (MARS). JMIR Mhealth Uhealth. 2016;4(2):e74.
   PubMed Web of Science ®Google Scholar
• Reyes A, Qin P, Brown CA. A standardized review of smartphone applications to promote balance for older adults. Disabil Rehabil. 2018;40(6):690–696.
   PubMed Web of Science ®Google Scholar
• Böhme C, von Osthoff MB, Frey K, et al. Development of a rating tool for mobile cancer apps: information analysis and formal and content-related evaluation of selected cancer apps. J Canc Educ. 2019;34(1):105–110.
   PubMed Web of Science ®Google Scholar
• Böhme C, von Osthoff MB, Frey K, et al. Qualitative evaluation of mobile cancer apps with particular attention to the target group, content, and advertising. J Cancer Res Clin Oncol. 2018;144(1):173–181.
   PubMed Web of Science ®Google Scholar
• Escoffery C, McGee R, Bidwell J, et al. A review of mobile apps for epilepsy self-management. Epilepsy Behav. 2018;81:62–69.
   PubMed Web of Science ®Google Scholar
• Flaherty S-J, McCarthy M, Collins A, et al. Can existing mobile apps support healthier food purchasing behaviour? Content analysis of nutrition content, behaviour change theory and user quality integration. Public Health Nutr. 2018;21(2):288–298.
   PubMed Web of Science ®Google Scholar
• Fraynt R, Cooper D, Edwards-Stewart A, et al. An evaluation of mobile applications designed to assist service members and veterans transitioning to civilian life [Health & Mental Health Treatment & Prevention 3300]. Psychol Serv. 2018;15(2):208–215.
   PubMed Web of Science ®Google Scholar
• Jisan L, Jeongeun K. Method of App Selection for Healthcare Providers Based on Consumer Needs. Comput Inform Nurs. 2018;36(1):45–54.
   PubMed Web of Science ®Google Scholar
• Jupp JCY, Sultani H, Cooper CA, et al. Evaluation of mobile phone applications to support medication adherence and symptom management in oncology patients. Pediatr Blood Cancer. 2018;65(11):e27278.
   PubMed Web of Science ®Google Scholar
• Kim BY, Sharafoddini A, Tran N, et al. Consumer mobile apps for potential drug-drug interaction check: systematic review and content analysis using the Mobile App Rating Scale (MARS). JMIR Mhealth Uhealth. 2018;6(3):e74–e74.
   PubMed Web of Science ®Google Scholar
• Le Marne FA, Butler S, Beavis E, et al. EpApp: Development and evaluation of a smartphone/tablet app for adolescents with epilepsy. J Clin Neurosci. 2018;50:214–220.
   PubMed Web of Science ®Google Scholar
• Tinschert P, Jakob R, Barata F, et al. The potential of mobile apps for improving asthma self-management: a review of publicly available and well-adopted asthma apps. JMIR Mhealth Uhealth. 2017;5(8):e113.
   PubMed Web of Science ®Google Scholar
• Stoyanov SR, Hides L, Kavanagh DJ, et al. Development and validation of the User Version of the Mobile Application Rating Scale (uMARS). JMIR Mhealth Uhealth. 2016;4(2):e72.
   PubMed Web of Science ®Google Scholar
• Gibbs J, Gkatzidou V, Tickle L, et al. Can you recommend any good STI apps?' A review of content, accuracy and comprehensiveness of current mobile medical applications for STIs and related genital infections. Sex Transm Infect. 2017;93(4):234.1–235.
   Web of Science ®Google Scholar
• Huckvale K, Car M, Morrison C, et al. Apps for asthma self-management: a systematic assessment of content and tools. BMC Med. 2012;10(1):144. 2012/11/22
   PubMedGoogle Scholar
• Househ M, Hossain N, Jamal A, et al. A cross-sectional content analysis of Android applications for asthma. Health Informatics J. 2017;23(2):83–95.
   PubMed Web of Science ®Google Scholar
• Zapata BC, Hernández Niñirola A, Fernández-Alemán JL, et al. Assessing the privacy policies in mobile personal health records. Conf Proc IEEE Eng Med Biol Soc. 2014;2014:4956–4959.
   PubMedGoogle Scholar
• Ouhbi S, Fernández-Alemán JL, Pozo JR, et al. Compliance of blood donation apps with mobile OS usability guidelines. J Med Syst. 2015;39(6):63–63.
   PubMed Web of Science ®Google Scholar
• Cruz Zapata B, Hernández Niñirola A, Idri A, et al. Mobile PHRs compliance with Android and iOS usability guidelines. J Med Syst. 2014;38(8):81–81.
   PubMed Web of Science ®Google Scholar
• Myint M, Adam A, Herath S, et al. Mobile phone applications in management of enuresis: The good, the bad, and the unreliable!. J Pediatr Urol. 2016;12(2):112.e1–6.
   Web of Science ®Google Scholar
• Robustillo Cortés M. d l A, Cantudo Cuenca MR, Morillo Verdugo R, et al. High quantity but limited quality in healthcare applications intended for HIV-infected patients. Telemed J E Health. 2014;20(8):729–735.
   PubMed Web of Science ®Google Scholar
• Reynoldson C, Stones C, Allsop M, et al. Assessing the quality and usability of smartphone apps for pain self-management. Pain Med. 2014;15(6):898–909.
   PubMed Web of Science ®Google Scholar
• Butcher R, MacKinnon M, Gadd K, et al. Development and examination of a rubric for evaluating point-of-care medical applications for mobile devices. Med Ref Serv Q. 2015;34(1):75–87.
   PubMedGoogle Scholar
• Choi J, Noh G-Y, Park D-J. Smoking cessation apps for smartphones: content analysis with the self-determination theory. J Med Internet Res. 2014;16(2):e44.
   PubMed Web of Science ®Google Scholar
• Burdette SD, Trotman R, Cmar J. Mobile infectious disease references: from the bedside to the beach. Clin Infect Dis. 2012;55(1):114–125.
   PubMed Web of Science ®Google Scholar
• Huguet A, Rao S, McGrath PJ, et al. A systematic review of cognitive behavioral therapy and behavioral activation apps for depression. Plos One. 2016;11(5):e0154248.
   PubMed Web of Science ®Google Scholar
• Nielsen J. Usability engineering. [electronic resource]. Cambridge (MA): AP Professional, c1993.; 1993.
   Google Scholar
• Lewis JR. IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int J Hum–Comput Int. 1995;7(1):57–78. 1995/01/;01
   Web of Science ®Google Scholar
• Brooke J. SUS: A “quick and dirty” usability scale. In: Jordan PW TB, Weerdmeester BA, McClelland AL, editors. Usability Evaluation in Industry. London: Taylor and Francis; 1996. p. 189–194.
   Google Scholar
• Gediga G, Hamborg K-C, Düntsch I. The IsoMetrics usability inventory: An operationalization of ISO 9241-10 supporting summative and formative evaluation of software systems. Behav Inf Technol. 1999;18(3):151–164. 1999/01/01
   Web of Science ®Google Scholar
• Lund AM. Measuring usability with the USE questionnaire. Usability Interface. 2001;8(2):3–6.
   Google Scholar
• Yen P-Y, Wantland D, Bakken S. Development of a customizable health IT usability evaluation scale. AMIA Annu Symp Proc. 2010;2010:917–921.
   PubMedGoogle Scholar
• Foundation HOtN. About Health On the Net 2018 [cited 2018. 25/05/2018]. Available from: https://www.healthonnet.org/en/about.html.
   Google Scholar
• Davis FD, Bagozzi RP, Warshaw PR. User acceptance of computer technology: a comparison of two theoretical models. Manage Sci. 1989;35(8):982–1003.
   Web of Science ®Google Scholar
• Canada MHCo. Mental Health Apps: How to Make an Informed Choice 2016. Available from: https://www.mentalhealthcommission.ca/sites/default/files/2018-01/eMH_app_eng.pdf.
   Google Scholar
• Zelmer J, Notarianni M, Schellenberg M, et al. An assessment framework for e-mental health apps in Canada: Results of a modified delphi process [Article]. JMIR Mhealth Uhealth. 2018;20(7):e10016.
   Google Scholar