Reliability and Validity of Survey Instruments to Measure Work-Related Fatigue in the Emergency Medical Services Setting: A Systematic Review

References

• Ream E, Richardson A. Fatigue: a concept analysis. Int J Nurs Stud. 1996;33(5):519–29. doi:10.1016/0020-7489(96)00004-1
   PubMed Web of Science ®Google Scholar
• Patterson PD, Suffoletto BP, Kupas DF, Weaver MD, Hostler D. Sleep quality and fatigue among prehospital providers. Prehosp Emerg Care. 2010;14(2):187–93. doi:10.3109/10903120903524971
   PubMed Web of Science ®Google Scholar
• Patterson PD, Weaver MD, Frank RC, Warner CW, Martin-Gill C, Guyette FX, Fairbanks RJ, Hubble MW, Songer TJ, Callaway CW, et al. Association between poor sleep, fatigue, and safety outcomes in emergency medical services providers. Prehosp Emerg Care. 2012;16(1):86–97. doi:10.3109/10903127.2011.616261
   PubMed Web of Science ®Google Scholar
• Lerman SE, Eskin E, Flower DJ, George EC, Gerson B, Hartenbaum N, Hursh SR, Moore-Ede M. Fatigue risk management in the workplace. J Occup Environ Med. 2012;54(2):231–58. doi:10.1097/JOM.0b013e318247a3b0
   PubMed Web of Science ®Google Scholar
• De Vries J, Michielsen HJ, Van Heck GL. Assessment of fatigue among working people: a comparison of six questionnaires. Occup Environ Med. 2003;60(Suppl 1):i10–i15. doi:10.1136/oem.60.suppl_1.i10
   PubMedGoogle Scholar
• Frone MR, Tidwell MC. The meaning and measurement of work fatigue: development and evaluation of the Three-Dimensional Work Fatigue Inventory (3D-WFI). J Occup Health Psychol. 2015;20(3):273–88. doi:10.1037/a0038700
   PubMed Web of Science ®Google Scholar
• Shen J, Barbera J, Shapiro CM. Distinguishing sleepiness and fatigue: focus on definition and measurement. Sleep Med Rev. 2006;10(1):63–6. doi:10.1016/j.smrv.2005.05.004
   PubMed Web of Science ®Google Scholar
• Basner M, Mollicone D, Dinges DF. Validity and sensitivity of a Brief Psychomotor Vigilance Test (PVT-B) to total and partial sleep deprivation. Acta Astronaut. 2011;69(11–12):949–59. doi:10.1016/j.actaastro.2011.07.015
   PubMed Web of Science ®Google Scholar
• Shahid A, Wilkinson K, Marcu S, Shapiro CM. STOP, THAT and One Hundred Other Sleep Scales. New York, NY: Springer Science & Business Media; 2012.
   Google Scholar
• Okuyama T, Akechi T, Kugaya A, Okamura H, Shima Y, Maruguchi M, Hosaka T, Uchitomi Y. Development and validation of the cancer fatigue scale: a brief, three-dimensional, self-rating scale for assessment of fatigue in cancer patients. J Pain Symptom Manage. 2000;19(1):5–14. doi:10.1016/S0885-3924(99)00138-4
   PubMed Web of Science ®Google Scholar
• Matza LS, Phillips GA, Revicki DA, Murray L, Malley KG. Development and validation of a patient-report measure of fatigue associated with depression. J Affect Disord. 2011;134(1–3):294–303. doi:10.1016/j.jad.2011.06.028
   PubMed Web of Science ®Google Scholar
• Patterson PD, Higgins JS, Lang ES, Runyon MS, Barger LK, Studnek JR, Moore CG, Robinson K, Gainor D, Infinger A, et al. Evidence-Based Guidelines for Fatigue Risk Management in EMS: Formulating Research Questions and Selecting Outcomes. Prehosp Emerg Care. 2017;21(2):149–56. doi:10.1080/10903127.2016.1241329
   PubMed Web of Science ®Google Scholar
• Patterson PD, Higgins JS, Weiss PM, Lang ES, Martin-Gill C. Systematic review methodology for the Fatigue in Emergency Medical Services project. Prehosp Emerg Care. 2018; 22(S1)1–17.
   PubMed Web of Science ®Google Scholar
• Shadish WR, Cook TD, Campbell DT. Experiments and Generalized Causal Inference. Experimental and Quasi-Experimental Designs for Generalized Causal Inference: Houghton Mifflin Company; 2002.
   Google Scholar
• Curcio G, Casagrande M, Bertini M. Sleepiness: evaluating and quantifying methods. Int J Psychophysiol. 2001;41(3):251–63. doi:10.1016/S0167-8760(01)00138-6
   PubMed Web of Science ®Google Scholar
• Guyatt GH, Oxman AD, Kunz R, Atkins D, Brozek J, Vist G, Alderson P, Glasziou P, Falck-Yitter Y, Schunemann HJ. GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol. 2011;64(4):395–400.
   PubMed Web of Science ®Google Scholar
• Whiting P, Rutjes AW, Reitsma JB, Bossuyt PM, Kleijnen J. The development of QUADAS: A tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol. 2003;3:25. doi:10.1186/1471-2288-3-25
   PubMedGoogle Scholar
• Bolster L, Rourke L. The effect of restricting residents' duty hours on patient safety, resident well-being, and resident education: an updated systematic review. J Grad Med Educ. 2015;7(3):349–63. doi:10.4300/JGME-D-14-00612.1
   PubMedGoogle Scholar
• Nunnally JC, Bernstein IH. Validity. Psychometric theory. 3rd ed. New York, NY: McGraw-Hill, Inc.; 1994:83–113.
   Google Scholar
• Nunnally JC, Bernstein IH. The assessment of reliability. Psychometric Theory. 3rd ed. New York, NY: McGraw-Hill, Inc.; 1994:248–92.
   Google Scholar
• Hatcher L. A step-by-step approach to using the SAS system for factor analysis and structural equation modeling. Cary, NC: SAS Institute., Inc.; 1994.
   Google Scholar
• Dodd K, Hill K, Haas R, Luke C, Millard S. Retest reliability of dynamic balance during standing in older people after surgical treatment of hip fracture. Physiother Res Int. 2003;8(2):93–100. doi:10.1002/pri.276
   PubMedGoogle Scholar
• Dvir Z, Gal-Eshel N, Shamir B, Prushansky T, Pevzner E, Peretz C. Cervical motion in patients with chronic disorders of the cervical spine: a reproducibility study. Spine. 2006;31(1):E394–E399. doi:10.1097/01.brs.0000219951.79922.df
   PubMed Web of Science ®Google Scholar
• Guyatt GH, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, Norris S, Falck-Yitter Y, Glasziou P, DeBeer H et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383–94. doi:10.1016/j.jclinepi.2010.04.026
   PubMed Web of Science ®Google Scholar
• Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso-Coello P, Montori V, Akl EA, Djulbegovic B, Falck-Ytter Y, et al. GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias). J Clin Epidemiol. 2011;64(4):407–15. doi:10.1016/j.jclinepi.2010.07.017
   PubMed Web of Science ®Google Scholar
• Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA-Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62(10):1006–1010. doi:10.1016/j.jclinepi.2009.06.005
   PubMed Web of Science ®Google Scholar
• Edinger T, Cohen AM. A large-scale analysis of the reasons given for excluding articles that are retrieved by literature search during systematic review. AMIA Annu Symp Proc. 2013:379–87.
   PubMedGoogle Scholar
• Barker LM, Nussbaum MA. Fatigue, performance and the work environment: a survey of registered nurses. J Adv Nurs. 2011;67(6):1370–82. doi:10.1111/j.1365-2648.2010.05597.x
   PubMed Web of Science ®Google Scholar
• Friesen LD, Vidyarthi AR, Baron RB, Katz PP. Factors associated with intern fatigue. J Gen Intern Med. 2008;23(12):1981–86. doi:10.1007/s11606-008-0798-3
   PubMed Web of Science ®Google Scholar
• Winwood PC, Lushington K, Winefield AH. Further development and validation of the Occupational Fatigue Exhaustion Recovery (OFER) scale. J Occup Environ Med. 2006;48(4):381–89.
   PubMed Web of Science ®Google Scholar
• West CP, Tan AD, Habermann TM, Sloan JA, Shanafelt TD. Association of resident fatigue and distress with perceived medical errors. JAMA. 2009;302(12):1294–1300. doi:10.1001/jama.2009.1389
   PubMed Web of Science ®Google Scholar
• Ahsberg E, Kecklund G, Akerstedt T, Gamberale F. Shiftwork and different dimensions of fatigue. Int J Ind Ergon. 2000;26(4):457–65. doi:10.1016/S0169-8141(00)00007-X
   Web of Science ®Google Scholar
• Charlton SG, Baas PH. Fatigue, work-rest cycles, and psychomotor performance of New Zealand truck drivers. New Zealand Journal of Psychology. 2001;30(1):32–39.
   Web of Science ®Google Scholar
• Ahsberg E. Dimensions of fatigue in different working populations. Scand J Psychol. 2000;41(3):231–41. doi:10.1111/1467-9450.00192
   PubMed Web of Science ®Google Scholar
• Grech MR, Neal A, Yeo G, Smith S, Humphreys M. An examination of the relationship between workload and fatigue within and across consecutive days of work: is the relationship static or dynamic? J Occup Health Psychol. 2009;14(3):231–42. doi:10.1037/a0014952
   PubMed Web of Science ®Google Scholar
• Chang YS, Wu YH, Su SF, Hsu CY, Chen HL. Factors related with the ability to maintain wakefulness in the daytime after fast and forward rotating shifts. Kaohsiung J Med Sci. 2013;29(11):611–16. doi:10.1016/j.kjms.2013.01.012
   PubMed Web of Science ®Google Scholar
• Balkin TJ, Bliese PD, Belenky G, Sing H, Thorne DR, Thomas M, Redmond DP, Russo M, Wesensten NJ. Comparative utility of instruments for monitoring sleepiness-related performance decrements in the operational environment. J Sleep Res. 2004;13(3):219–27. doi:10.1111/j.1365-2869.2004.00407.x
   PubMed Web of Science ®Google Scholar
• Forsman P, Pyykko I, Toppila E, Haeggstrom E. Feasibility of force platform based roadside drowsiness screening – a pilot study. Accid Anal Prev. 2014;62:186–90. doi:10.1016/j.aap.2013.09.015
   PubMed Web of Science ®Google Scholar
• Geiger-Brown J, Wieroney M, Blair L, Zhu S, Warren J, Scharf SM, Hinds PS. Measuring subjective sleepiness at work in hospital nurses: Validation of a modified delivery format of the Karolinska Sleepiness Scale. Sleep Breath. 2014;18(4):731–39. doi:10.1007/s11325-013-0935-z
   PubMed Web of Science ®Google Scholar
• Karchani M, Mazloumi A, NaslSaraji G, Akbarzadeh A, Niknezhad A, Ebrahimi MH, Raei M, Khandan M. Association of subjective and interpretive drowsiness with facial dynamic changes in simulator driving. J Res Health Sci. 2015;15(4):250–55.
   PubMed Web of Science ®Google Scholar
• Howard ME, Jackson ML, Berlowitz D, O'Donoghue F, Swann P, Westlake J, Wilkinson V, Pierce RJ. Specific sleepiness symptoms are indicators of performance impairment during sleep deprivation. Accid Anal Prev. 2014;62:1–8. doi:10.1016/j.aap.2013.09.003
   PubMed Web of Science ®Google Scholar
• Ftouni S, Sletten TL, Howard M, Anderson C, Lenne MG, Lockley SW, Rajaratnam SM. Objective and subjective measures of sleepiness, and their associations with on-road driving events in shift workers. J Sleep Res. 2013;22(1):58–69. doi:10.1111/j.1365-2869.2012.01038.x
   PubMed Web of Science ®Google Scholar
• Sadeghniiat-Haghighi K, Moller HJ, Saraei M, Aminian O, Khajeh-Mehrizi A. The Epworth Sleepiness Scale for screening of the drowsy driving: comparison with the maintenance of wakefulness test in an Iranian sample of commercial drivers. Acta Med Iran. 2014;52(2):125–29.
   PubMedGoogle Scholar
• Sunwoo BY, Jackson N, Maislin G, Gurubhagavatula I, George CF, Pack AI. Reliability of a single objective measure in assessing sleepiness. Sleep. 2012;35(1):149–58. doi:10.5665/sleep.1606
   PubMed Web of Science ®Google Scholar
• Sofianopoulos S, Williams B, Archer F, Thompson B. The exploration of physical fatigue, sleep and depression in paramedics: a pilot study. eJournal of Emergency Primary Health Care. 2011;9(1):1–33.
   Google Scholar
• Waage S, Pallesen S, Moen BE, Mageroy N, Flo E, Di Milia L, Bjorvatn B. Predictors of shift work disorder among nurses: a longitudinal study. Sleep Med. 2014;15(12):1449–55. doi:10.1016/j.sleep.2014.07.014
   PubMed Web of Science ®Google Scholar
• Johns MW. Reliability and factor analysis of the Epworth Sleepiness Scale. Sleep. 1992;15(4):376–81. doi:10.1093/sleep/15.4.376
   PubMed Web of Science ®Google Scholar
• Saksvik-Lehouillier I, Bjorvatn B, Hetland H, Sandal GM, Moen BE, Mageroy N, Akerstedt T, Pallesen S. Individual, situational and lifestyle factors related to shift work tolerance among nurses who are new to and experienced in night work. J Adv Nurs. 2013;69(5):1136–46. doi:10.1111/j.1365-2648.2012.06105.x
   PubMed Web of Science ®Google Scholar
• Flo E, Bjorvatn B, Folkard S, Moen BE, Gronli J, Nordhus IH, Pallesen S. A reliability and validity study of the Bergen Shift Work Sleep Questionnaire in nurses working three-shift rotations. Chronobiol Int. 2012;29(7):937–46. doi:10.3109/07420528.2012.699120
   PubMed Web of Science ®Google Scholar
• Kato C, Shimada J, Hayashi K. Sleepiness during shift work in Japanese nurses: a comparison study using JESS, SSS, and actigraphy. Sleep and Biological Rhythms. 2012;10:109–17. doi:10.1111/j.1479-8425.2011.00528.x
   Web of Science ®Google Scholar
• Takahashi M, Nakata A, Haratani T, Otsuka Y, Kaida K, Fukasawa K. Psychosocial work characteristics predicting daytime sleepiness in day and shift workers. Chronobiol Int. 2006;23(6):1409–22. doi:10.1080/07420520601100963
   PubMed Web of Science ®Google Scholar
• Scott LD, Hofmeister N, Rogness N, Rogers AE. An interventional approach for patient and nurse safety: a fatigue countermeasures feasibility study. Nurs Res. 2010;59(4):250–58. doi:10.1097/NNR.0b013e3181de9116
   PubMed Web of Science ®Google Scholar
• Pigeon WR, Sateia MJ, Ferguson RJ. Distinguishing between excessive daytime sleepiness and fatigue: toward improved detection and treatment. J Psychosom Res. 2003;54(1):61–69. doi:10.1016/S0022-3999(02)00542-1
   PubMed Web of Science ®Google Scholar
• Shahid A, Shen J, Shapiro CM. Measurements of sleepiness and fatigue. J Psychosom Res. 2010;69(1):81–9. doi:10.1016/j.jpsychores.2010.04.001
   PubMed Web of Science ®Google Scholar
• Mota DD, Pimenta CA. Self-report instruments for fatigue assessment: a systematic review. Res Theory Nurs Pract. 2006;20(1):49–78. doi:10.1891/rtnp.20.1.49
   PubMedGoogle Scholar
• Krupp LB, LaRocca NG, Muir-Nash J, Steinberg AD. The fatigue severity scale. Application to patients with multiple sclerosis and systemic lupus erythematosus. Arch Neurol. 1989;46(10):1121–23. doi:10.1001/archneur.1989.00520460115022
   PubMed Web of Science ®Google Scholar
• Beck AT, Brown G, Steer RA. Prediction of eventual suicide in psychiatric inpatients by clinical ratings of hopelessness. J Consult Clin Psychol. 1989;57(2):309–10. doi:10.1037/0022-006X.57.2.309
   PubMed Web of Science ®Google Scholar
• Loge JH, Ekeberg O, Kaasa S. Fatigue in the general Norwegian population: normative data and associations. J Psychosom Res. 1998;45(1):53–65. doi:10.1016/S0022-3999(97)00291-2
   PubMed Web of Science ®Google Scholar
• Johns MW. A new method for measuring daytime sleepiness: The Epworth sleepiness scale. Sleep. 1991;14(6):540–45. doi:10.1093/sleep/14.6.540
   PubMed Web of Science ®Google Scholar
• Akerstedt T, Gillberg M. Subjective and objective sleepiness in the active individual. Int J Neurosci. 1990;52(1–2):29–37. doi:10.3109/00207459008994241
   PubMed Web of Science ®Google Scholar
• Hoddes E, Zarcone V, Smythe H, Phillips R, Dement WC. Quantification of sleepiness: a new approach. Psychophysiology. 1973;10(4):431–36. doi:10.1111/j.1469-8986.1973.tb00801.x
   PubMed Web of Science ®Google Scholar
• Caldwell JA, Caldwell JL. An overview of fatigue. Fatigue in aviation: A guide to staying awake at the stick. 2nd ed. New York, NY: Routledge Taylor and Francis Group; 2016:15.
   Google Scholar
• Jeong HS, Jeon Y, Ma J, Choi Y, Ban S, Lee S, Lee B, Im JJ, Yoon S, Kim JE, et al. Validation of the Athens Insomnia Scale for screening insomnia in South Korean firefighters and rescue workers. Qual Life Res. 2015;24(10):2391–95. doi:10.1007/s11136-015-0986-7
   PubMed Web of Science ®Google Scholar
• Lee KA, Gay CL, Alsten CR. Home-based behavioral sleep training for shift workers: a pilot study. Behav Sleep Med. 2014;12(6):455–68. doi:10.1080/15402002.2013.825840
   PubMed Web of Science ®Google Scholar
• Halbesleben JRB. The influence of shift work on emotional exhaustion in firefighters: the role of work–family conflict and social support. Int J Workplace Health Management. 2009;2(2):115–30. doi:10.1108/17538350910970200
   Google Scholar
• Barton J, Spelten E, Totterdell P, Smith L, Folkard S, Costa G. The Standard Shiftwork Index: a battery of questionnaires for assessing shiftwork-related problems. Work Stress. 1995;9(1):4–30. doi:10.1080/02678379508251582
   Web of Science ®Google Scholar
• Ruggiero JS. Correlates of fatigue in critical care nurses. Res Nurs Health. 2003;26(6):434–44. doi:10.1002/nur.10106
   PubMed Web of Science ®Google Scholar
• Beurskens AJ, Bultmann U, Kant I, Vercoulen JH, Bleijenberg G, Swaen GM. Fatigue among working people: validity of a questionnaire measure. Occup Environ Med. 2000;57(5):353–57. doi:10.1136/oem.57.5.353
   PubMed Web of Science ®Google Scholar
• Laranjeira CA. Translation and adaptation of the fatigue severity scale for use in Portugal. Appl Nurs Res. 2012;25(3):212–17. doi:10.1016/j.apnr.2010.11.001
   PubMed Web of Science ®Google Scholar
• Guttierrez JL, Jimenez BM, Hernandez EG, Lopez AL. Spanish version of the Swedish Occupational Fatigue Inventory (SOFI): Factorial replication, reliability and validity. Int J Ind Ergon. 2005;35(8):737–46. doi:10.1016/j.ergon.2005.02.007
   Web of Science ®Google Scholar
• Chica-Urzola HL, Escobar-Cordoba F, Eslava-Schmalbach J. Validating the Epworth Sleepiness Scale. Rev Salud Publica (Bogota). 2007;9(4):558–67.
   PubMedGoogle Scholar
• Campbell DT, Fiske DW. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull. 1959;56(2):81–105. doi:10.1037/h0046016
   PubMed Web of Science ®Google Scholar
• Rubio DM, Berg-Weger M, Tebb SS, Lee ES, Rauch S. Objectifying content validity: conducting a content validity study in social work research. Soc Work Res. 2003;27(2):94–104. doi:10.1093/swr/27.2.94
   Web of Science ®Google Scholar
• Smith GT. On construct validity: issues of method and measurement. Psychol Assess. 2005;17(4):396–408. doi:10.1037/1040-3590.17.4.396
   PubMed Web of Science ®Google Scholar
• Patterson PD, Buysse DJ, Weaver MD, Suffoletto BP, McManigle KL, Callaway CW, Yealy DM. Emergency healthcare worker sleep, fatigue, and alertness behavior survey (SFAB): development and content validation of a survey tool. Accid Anal Prev. 2014;73:399–411. doi:10.1016/j.aap.2014.09.028
   PubMed Web of Science ®Google Scholar
• Patterson PD, Buysse DJ, Weaver MD, Callaway CW, Yealy DM. Recovery between work shifts among emergency medical services clinicians. Prehosp Emerg Care. 2015;19(3):365–75. doi:10.3109/10903127.2014.995847
   PubMed Web of Science ®Google Scholar
• da Silva FJ, Felli VE, Martinez MC, Mininel VA, Ratier AP. Association between work ability and fatigue in Brazilian nursing workers. Work. 2015;53(1):225–32. doi:10.3233/WOR-152241
   PubMedGoogle Scholar
• Smets EM, Garssen B, Bonke B, De Haes JC. The Multidimensional Fatigue Inventory (MFI) psychometric qualities of an instrument to assess fatigue. J Psychosom Res. 1995;39(3):315–25. doi:10.1016/0022-3999(94)00125-O
   PubMed Web of Science ®Google Scholar
• Hossain JL, Reinish LW, Heslegrave RJ, Hall GW, Kayumov L, Chung SA, Bhuiya P, Jaovanovic D, Huterer N, Volkov J, et al. Subjective and objective evaluation of sleep and performance in daytime versus nighttime sleep in extended-hours shift-workers at an underground mine. J Occup Environ Med. 2004;46(3):212–26. doi:10.1097/01.jom.0000117421.95392.31
   PubMed Web of Science ®Google Scholar
• Lance CE, Butts MM, Michels LC. The sources of four commonly reported cutoff criteria: what did they really say? Organizational Res Methods. 2006;9(2):202–20. doi:10.1177/1094428105284919
   Web of Science ®Google Scholar
• Anderson JC, Gerbing DW. Structural equation modeling in practice: a review and recommended two-step approach. Psychol Bull. 1988;103(3):411–23. doi:10.1037/0033-2909.103.3.411
   Web of Science ®Google Scholar
• Marsh HW, Balla JR, McDonald RP. Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. Psychol Bull. 1988;103(3):391–410. doi:10.1037/0033-2909.103.3.391
   Web of Science ®Google Scholar
• Ware JEJ, Gandek B. Methods for testing data quality, scaling assumptions, and reliability: the IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol. 1998;51(11):945–52. doi:10.1016/S0895-4356(98)00085-7
   PubMed Web of Science ®Google Scholar