Item Response Theory Analysis and Measurement Invariance Testing of the Cultural Humility and Enactment Scale

References

• American Counseling Association (2014). 2014 ACA code of ethics. Retrieved from https://www.counseling.org/docs/default-source/default-document-library/ethics/2014-aca-code-of-ethics.pdf?sfvrsn=55ab73d0_1
   Google Scholar
• Anders, C., & Kivlighan, D. M. (2023). Identity salience: An intersectional approach to understanding multicultural processes and outcomes in psychotherapy. Journal of Counseling Psychology, 70(5), 477–485. https://doi.org/10.1037/cou0000688
   PubMed Web of Science ®Google Scholar
• Baker, F. B., & Kim, S.-H. (2017). The basics of item response theory using R. Springer.
   Google Scholar
• Buhrmester, M. D., Talaifar, S., & Gosling, S. D. (2018). An evaluation of Amazon’s Mechanical Turk, its rapid rise, and its effective use. Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 13(2), 149–154. https://doi.org/10.1177/1745691617706516
   PubMedGoogle Scholar
• Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 6(1), 3–5. https://doi.org/10.1177/1745691610393980
   PubMedGoogle Scholar
• Chandler, J., Mueller, P., & Paolacci, G. (2014). Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers. Behavior Research Methods, 46(1), 112–130. https://doi.org/10.3758/s13428-013-0365-7
   PubMed Web of Science ®Google Scholar
• Chen, C.-C., Lau, J. M., Richardson, G. B., & Dai, C.-L. (2020). Measurement invariance testing in counseling. Journal of Professional Counseling: Practice, Theory & Research, 47(2), 89–104. https://doi.org/10.1080/15566382.2020.1795806
   Google Scholar
• Council for Accreditation of Counseling and Related Educational Programs (2023). 2024 CACREP Standards. https://www.cacrep.org/wp-content/uploads/2023/06/2024-Standards-Combined-Version-6.27.23.pdf
   Google Scholar
• Curran, P. G. (2016). Methods for the detection of carelessly invalid responses in survey data. Journal of Experimental Social Psychology, 66, 4–19. https://doi.org/10.1016/j.jesp.2015.07.006
   Web of Science ®Google Scholar
• Dai, S., Vo, T. T., Kehinde, O. J., He, H., Xue, Y., Demir, C., & Wang, X. (2021). Performance of polytomous irt models with rating scale data: An investigation over sample size, instrument length, and missing data. Frontiers in Education, 6, 721963. https://doi.org/10.3389/feduc.2021.721963
   Google Scholar
• Davis, D. E., DeBlaere, C., Brubaker, K., Owen, J., Jordan, T. A., Hook, J. N., & Van Tongeren, D. R. (2016). Microaggressions and perceptions of cultural humility in counseling. Journal of Counseling & Development, 94(4), 483–493. https://doi.org/10.1002/jcad.12107
   Web of Science ®Google Scholar
• Davis, D. E., DeBlaere, C., Owen, J., Hook, J. N., Rivera, D. P., Choe, E., Van Tongeren, D. R., Worthington, E. L., Jr., & Placeres, V. (2018). The multicultural orientation framework: A narrative review. Psychotherapy (Chicago, Ill.), 55(1), 89–100. https://doi.org/10.1037/pst0000160
   PubMed Web of Science ®Google Scholar
• de Ayala, R. J. (2022). The theory and practice of item response theory (2nd ed.) The Guilford Press.
   Google Scholar
• DeBlaere, C., Shodiya-Zeumalt, S., Hinger, C., Cobourne, L., Davis, D. E., Zelaya, D. G., Chadwick, C. N., Zeligman, M., Hook, J. N., & Owen, J. (2019). Cultural humility with religious and spiritually diverse women of color clients: A psychometric analysis. Journal of Psychology and Theology, 47(2), 87–99. https://doi.org/10.1177/0091647119837016
   Web of Science ®Google Scholar
• Dimitrov, D. M. (2010). Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development, 43(2), 121–149. https://doi.org/10.1177/0748175610373459
   Web of Science ®Google Scholar
• Dixon, K. M., Kivlighan, D. M., Jr., Hill, C. E., & Gelso, C. J. (2022). Cultural humility, Working alliance, and outcome rating scale in psychodynamic psychotherapy: Between therapist, within-therapist, and within-client effects. Journal of Counseling Psychology, 69(3), 276–286. https://doi.org/10.1037/cou0000590
   PubMed Web of Science ®Google Scholar
• Drinane, J. M., Owen, J., Adelson, J. L., & Rodolfa, E. (2016). Multicultural competencies: What are we measuring? Psychotherapy Research: Journal of the Society for Psychotherapy Research, 26(3), 342–351. https://doi.org/10.1080/10503307.2014.983581
   PubMed Web of Science ®Google Scholar
• Fisher-Borne, M., Cain, J. M., & Martin, S. L. (2015). From mastery to accountability: Cultural humility as an alternative to cultural competence. Social Work Education, 34(2), 165–181. https://doi.org/10.1080/02615479.2014.977244
   Web of Science ®Google Scholar
• Foronda, C., Porter, A., & Phitwong, A. (2021). Psychometric testing of an instrument to measure cultural humility. Journal of Transcultural Nursing: Official Journal of the Transcultural Nursing Society, 32(4), 399–404. https://doi.org/10.1177/1043659620950420
   PubMed Web of Science ®Google Scholar
• Gonzalez, E., Sperandio, K. R., Mullen, P. R., & Tuazon, V. E. (2021). Development and initial testing of the multidimensional cultural humility scale. Measurement and Evaluation in Counseling and Development, 54(1), 56–70. https://doi.org/10.1080/07481756.2020.1745648
   Web of Science ®Google Scholar
• Gu, H., Wen, Z., & Fan, X. (2015). The impact of wording effect on reliability and validity of the Core Self-Evaluation Scale (Cses): A bi-factor perspective. Personality and Individual Differences, 83, 142–147. https://doi.org/10.1016/j.paid.2015.04.006
   Web of Science ®Google Scholar
• Hampton, N. Z., Guillermo, M. S., Tucker, M., & Nichols, T. (2017). Broadening rehabilitation education and research through cultural humility: A conceptual framework fo rehabilitation counseling. Rehabilitation Research, Policy, and Education, 31(2), 70–88. https://doi.org/10.1891/2168-6653.31.2.70
   Google Scholar
• Hook, J. N., Davis, D. E., Owen, J., Worthington, E. L., Jr., & Utsey, S. O. (2013). Cultural humility: Measuring openness to culturally diverse clients. Journal of Counseling Psychology, 60(3), 353–366. https://doi.org/10.1037/a0032595
   PubMed Web of Science ®Google Scholar
• Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., Rosseel, Y. (2022). semTools: Useful tools for structural equation modeling. R package version 0.5-6. https://CRAN.R-project.org/package=semTools
   Google Scholar
• Kim, N., & Oh, J. (2023). Learning from mistakes: Impact of careless responses on counseling research using Amazon’s Mechanical Turk. Measurement and Evaluation in Counseling and Development, 56(2), 151–168. https://doi.org/10.1080/07481756.2022.2073895
   Web of Science ®Google Scholar
• Kondili, E., Isawi, D., Interiano-Shiverdecker, C., & Maleckas, O. (2022). Predictors of cultural humility in counselors-in-training. Counselor Education and Supervision, 61(2), 129–140. https://doi.org/10.1002/ceas.12230
   Web of Science ®Google Scholar
• Mallinckrodt, B., Miles, J. R., & Recabarren, D. A. (2016). Using focus groups and rasch item response theory to improve instrument development. The Counseling Psychologist, 44(2), 146–194. https://doi.org/10.1177/0011000015596437
   Web of Science ®Google Scholar
• McElroy-Heltzel, S. E., Davis, D. E., DeBlaere, C., Worthington, E. L., & Hook, J. N. (2019). Embarrassment of riches in the measurement of humility: A critical review of 22 measures. The Journal of Positive Psychology, 14(3), 393–404. https://doi.org/10.1080/17439760.2018.1460686
   Web of Science ®Google Scholar
• Morin, A. J., Boudrias, J. S., Marsh, H. W., McInerney, D. M., Dagenais-Desmarais, V., Madore, I., & Litalien, D. (2017). Complementary variable-and person-centered approaches to the dimensionality of psychometric constructs: Application to psychological wellbeing at work. Journal of Business and Psychology, 32(4), 395–419. https://doi.org/10.1007/s10869-016-9448-7
   Web of Science ®Google Scholar
• Mortensen, K., & Hughes, T. L. (2018). Comparing Amazon’s Mechanical Turk platform to conventional data collection methods in the health and medical research literature. Journal of General Internal Medicine, 33(4), 533–538. https://doi.org/10.1007/s11606017-4246-0
   PubMed Web of Science ®Google Scholar
• Mosher, D. K., Hook, J. N., Farrell, J. E., Watkins, C. E., & Davis, D. E. (2017). Cultural humility. In E. L. Worthington, D. E. Davis, & J. N. Hook (Eds.), Handbook of humility: Theory, research, and applications (pp. 91–104) Taylor & Francis.
   Google Scholar
• Mullen, P. R., Fox, J., Goshorn, J. R., & Warraich, L. K. (2021). Crowdsourcing for online samples in counseling research. Journal of Counseling & Development, 99(2), 221–226. https://doi.org/10.1002/jcad.12369
   Web of Science ®Google Scholar
• Muthén, L. K., & Muthén, B. O. (2017). Mplus: Statistical Analysis with Latent Variables: User’s Guide (Version 8). Muthén & Muthén.
   Google Scholar
• Owen, J., Tao, K. W., Drinane, J. M., Hook, J., Davis, D. E., & Kune, N. F. (2016). Client perceptions of therapists’ multicultural orientation: Cultural (missed) opportunities and cultural humility. Professional Psychology: Research and Practice, 47(1), 30–37. https://doi.org/10.1037/pro0000046
   Web of Science ®Google Scholar
• Preacher, K. J., Zhang, G., Kim, C., & Mels, G. (2013). Choosing the optimal number of factors in exploratory factor analysis: A model selection perspective. Multivariate Behavioral Research, 48(1), 28–56. https://doi.org/10.1080/00273171.2012.710386
   PubMed Web of Science ®Google Scholar
• Ratts, M. J., Singh, A. A., Nassar‐McMillan, S., Butler, S. K., & McCullough, J. R. (2016). Multicultural and social justice counseling competencies: Guidelines for the counseling profession. Journal of Multicultural Counseling and Development, 44(1), 28–48. https://doi.org/10.1002/jmcd.12035
   Web of Science ®Google Scholar
• R Core Team (2023). R: A language and environment for statistical computing [Computer software]. R Foundation for Statistical Computing. https://www.R-project.org
   Google Scholar
• Reckase, M. D. (1997). The past and future of multidimensional item response theory. Applied Psychological Measurement, 21(1), 25–36. https://doi.org/10.1177/0146621697211002
   Web of Science ®Google Scholar
• Rizopoulos, D. (2022). ltm: Latent trait models under IRT. Retrieved from https://github.com/drizopoulos/ltm
   Google Scholar
• Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika, 34(S1), 1–97. https://doi.org/10.1007/BF03372160
   Google Scholar
• Scott, L. M. (2022). The association of psychotherapist cultural humility and client experiences and outcomes in psychotherapy: A meta-analysis [Doctoral dissertation], Brigham Young University.
   Google Scholar
• Tervalon, M., & Murray-García, J. (1998). Cultural humility versus cultural competence: A critical distinction in defining physician training outcomes in multicultural education. Journal of Health Care for the Poor and Underserved, 9(2), 117–125. https://doi.org/10.1353/hpu.2010.0233
   PubMed Web of Science ®Google Scholar
• Wilcox, M. M., Drinane, J. M., Black, S. W., Cabrera, L., DeBlaere, C., Tao, K. W., Hook, J. N., Davis, D. E., Watkins, C. E., & Owen, J. (2022). Layered cultural processes: The relationship between multicultural orientation and satisfaction with supervision. Training and Education in Professional Psychology, 16(3), 235–243. https://doi.org/10.1037/tep0000366
   Web of Science ®Google Scholar
• Wilcox, M. M., Winkeljohn Black, S., Farra, A., Zimmerman, D., Drinane, J. M., Tao, K. W., DeBlaere, C., Hook, J. N., Davis, D. E., Watkins, C. E., & Owen, J. (2023). Cultural Humility, Cultural Comfort, and Supervision Processes and Outcomes for BIPOC Supervisees. The Counseling Psychologist, 51(7), 1037–1058. https://doi.org/10.1177/00110000231188337
   Web of Science ®Google Scholar
• Zhang, H., Watkins, C. E., Hook, J. N., Hodge, A. S., Davis, C. W., Norton, J., Wilcox, M. M., Davis, D. E., DeBlaere, C., & Owen, J. (2022). Cultural humility in psychotherapy and clinical supervision: A research review. Counselling and Psychotherapy Research, 22(3), 548–557. https://doi.org/10.1002/capr.12481
   Web of Science ®Google Scholar
• Zhu, P., Luke, M., & Bellini, J. (2021). A grounded theory analysis of cultural humility in counseling and counselor education. Counselor Education and Supervision, 60(1), 73–89. https://doi.org/10.1002/ceas.12197
   Web of Science ®Google Scholar
• Zhu, P., Liu, Y., Luke, M. M., & Wang, Q. (2022). The development and initial validation of the cultural humility and enactment scale in counseling. Measurement and Evaluation in Counseling and Development, 55(2), 98–115. https://doi.org/10.1080/07481756.2021.1955215
   Web of Science ®Google Scholar
• Zhu, P., Isawi, D. T., & Luke, M. M. (2023a). A discourse analysis of cultural humility within counseling dyads. Journal of Counseling & Development, 101(2), 167–179. https://doi.org/10.1002/jcad.12457
   Web of Science ®Google Scholar
• Zhu, P., Luke, M. M., Liu, Y., & Wang, Q. (2023b). Cultural humility and cultural competence in counseling: An exploratory mixed methods investigation. Journal of Counseling & Development, 101(3), 264–276. https://doi.org/10.1002/jcad.12469
   Web of Science ®Google Scholar