Analyzing Multivariate Generalizability Theory Designs within Structural Equation Modeling Frameworks

References

• Ark, T. K. (2015). Ordinal generalizability theory using an underlying latent variable framework [Doctoral dissertation]. University of British Columbia, Vancouver, British Columbia Canada.
   Google Scholar
• Baldwin, P. (2015). Weighting components of a composite score using naïve expert judgments about their relative importance. Applied Psychological Measurement, 39, 539–550. https://doi.org/10.1177/0146621615584703
   PubMed Web of Science ®Google Scholar
• Brennan, R. L. (2001a). Generalizability theory. Springer-Verlag.
   Google Scholar
• Brennan, R. L. (2001b). Manual for mGENOVA. Iowa Testing Programs, University of Iowa.
   Google Scholar
• Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334. https://doi.org/10.1007/BF02310555
   Web of Science ®Google Scholar
• Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. Wiley.
   Google Scholar
• Cronbach, L. J., Rajaratnam, N., & Gleser, G. C. (1963). Theory of generalizability: A liberalization of reliability theory. British Journal of Statistical Psychology, 16, 137–163. https://doi.org/10.1111/j.2044-8317.1963.tb00206.x
   Web of Science ®Google Scholar
• DeYoung, C. G., Quilty, L. C., & Peterson, J. B. (2007). Between facets and domains: 10 aspects of the Big Five. Journal of Personality and Social Psychology, 93, 880–896. https://doi.org/10.1037/0022-3514.93.5.880
   PubMed Web of Science ®Google Scholar
• Garnier-Villarreal, M., & Jorgensen, T. D. (2020). Adapting fit indices for Bayesian structural equation modeling: Comparison to maximum likelihood. Psychological Methods, 25, 46–70. https://doi.org/10.1037/met0000224
   PubMed Web of Science ®Google Scholar
• Jiang, Z., & Skorupski, W. (2018). A Bayesian approach to estimating variance components within a multivariate generalizability theory framework. Behavior Research Methods, 50, 2193–2214. https://doi.org/10.3758/s13428-017-0986-3
   PubMed Web of Science ®Google Scholar
• John, O. P., Donahue, E. M., & Kentle, R. L. (1991). The big five inventory—Versions 4a and 54. University of California, Berkeley, Institute of Personality and Social Research.
   Google Scholar
• Jorgensen, T. D. (2021). How to estimate absolute-error components in structural equation models of generalizability theory. Psych, 3, 113–133. https://doi.org/10.3390/psych3020011
   Google Scholar
• Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., Rosseel, Y. (2022). semTools: Useful tools for structural equation modeling. R package version 0.5-6. https://CRAN.R-project.org/package=semTools
   Google Scholar
• Kane, M. T., & Brennan, R. L. (1980). Agreement coefficients as indices of dependability for domain-referenced tests. Applied Psychological Measurement, 4, 105–126. https://doi.org/10.1177/014662168000400111
   Google Scholar
• Little, T. D., Slegers, D. W., & Card, N. A. (2006). A non-arbitrary method or identifying and scaling latent variables in SEM and MACS models. Structural Equation Modeling: A Multidisciplinary Journal, 13, 59–72. https://doi.org/10.1207/sl5328007sem1301_3
   Web of Science ®Google Scholar
• Marcoulides, G. A. (1996). Estimating variance components in generalizability theory: The covariance structure analysis approach [Teacher’s corner]. Structural Equation Modeling, 3, 290–299. https://doi.org/10.1080/10705519609540045
   Web of Science ®Google Scholar
• Marsh, H. W. (1990). The structure of academic self-concept: The Marsh/Shavelson model. Journal of Educational Psychology, 82, 623–636. https://doi.org/10.1037/0022-0663.82.4.623
   Web of Science ®Google Scholar
• McCrae, R. R., & Costa, P. T. (2010). NEO Inventories professional manual. Psychological Assessment Resources.
   Google Scholar
• Morin, A., Scalas, L. F., & Vispoel, W. (2017). The music self-perception inventory: Development of parallel forms A and B. Psychology of Music, 45, 530–549. https://doi.org/10.1177/0305735616669426
   Web of Science ®Google Scholar
• Morris, C. A. (2020). Optimal methods for disattenuating correlation coefficients under realistic measurement conditions with single-form, self-report instruments. (Publication No. 27668419) [Doctoral dissertation]. University of Iowa. ProQuest Dissertation and Theses database.
   Google Scholar
• Rajaratnam, N., Cronbach, L. J., & Gleser, G. C. (1965). Generalizability of stratified-parallel tests. Psychometrika, 30, 39–56. https://doi.org/10.1007/BF02289746
   PubMed Web of Science ®Google Scholar
• Raykov, T., & Marcoulides, G. A. (2006). Estimation of generalizability coefficients via a structural equation modeling approach to scale reliability evaluation. International Journal of Testing, 6, 81–95. https://doi.org/10.1207/s15327574ijt0601_5
   Google Scholar
• Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36. https://doi.org/10.18637/jss.v048.i02
   Web of Science ®Google Scholar
• Saucier, G. (1994). Mini-Markers: A brief version of Goldberg’s unipolar Big-Five markers. Journal of Personality Assessment, 63, 506–516. https://doi.org/10.1207/s15327752jpa6303_8
   PubMed Web of Science ®Google Scholar
• Schmidt, F. L., Le, H., & Ilies, R. (2003). Beyond alpha: An empirical investigation of the effects of different sources of measurement error on reliability estimates for measures of individual differences constructs. Psychological Methods, 8, 206–224. https://doi.org/10.1037/1082-989X.8.2.206
   PubMed Web of Science ®Google Scholar
• Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer. Sage.
   Google Scholar
• Soto, C. J., & John, O. P. (2017). The next Big Five Inventory (BFI-2): Developing and assessing a hierarchical model with 15 facets to enhance bandwidth, fidelity, and predictive power. Journal of Personality and Social Psychology, 113, 117–143. https://doi.org/10.1037/pspp0000096
   PubMed Web of Science ®Google Scholar
• Vispoel, W. P., Hong, H., & Lee, H. (2023a). Benefits of doing generalizability theory analyses within structural equation modeling frameworks: Illustrations using the Rosenberg Self-Esteem Scale [Teacher’s corner]. Structural Equation Modeling: An Interdisciplinary Journal. Advance Online Publication. https://doi.org/10.1080/10705511.2023.2187734
   Web of Science ®Google Scholar
• Vispoel, W. P., Hong, H., Lee, H., & Jorgensen, T. R. (in press). Analyzing complete generalizability theory designs using structural equation models. Applied Measurement in Education.
   Web of Science ®Google Scholar
• Vispoel, W. P., & Lee, H. (2023). Merging generalizability theory and bifactor modeling to improve psychological assessments. Psychology and Psychotherapy: Review Study, 7, 1–4. https://crimsonpublishers.com/pprs/pdf/PPRS.000652.pdfhttps://crimsonpublishers.com/pprs/pdf/PPRS.000652.pdf
   Google Scholar
• Vispoel, W. P., Lee, H., Chen, T., & Hong, H. (2023b). Using structural equation modeling to reproduce and extend ANOVA-based generalizability theory analyses for psychological assessments. Psych, 5, 249–273. https://doi.org/10.3390/psych5020019
   Google Scholar
• Vispoel, W. P., Lee, H., Chen, T., & Hong, H. (2023c). Extending applications of generalizability theory-based bifactor model designs. Psych, 5, 545–575. https://doi.org/10.3390/psych5020036
   Google Scholar
• Vispoel, W. P., Lee, H., Chen, T., & Hong, H. (2023d). Analyzing and comparing univariate, multivariate, and bifactor generalizability theory design for hierarchically structured personality traits [Manuscript submitted for publication].
   Google Scholar
• Vispoel, W. P., Lee, H., Hong, H., & Chen, T. (in press). Applying multivariate generalizability theory to psychological assessments Psychological Methods.
   Google Scholar
• Vispoel, W. P., Lee, H., Xu, G., & Hong, H. (2022a). Expanding bifactor models of psychological traits to account for multiple sources of measurement error. Psychological Assessment, 34, 1093–1111. https://doi.org/10.1037/pas0001170
   PubMed Web of Science ®Google Scholar
• Vispoel, W. P., Lee, H., Xu, G., & Hong, H. (2023e). Integrating bifactor models into a generalizability theory structural equation modeling framework. The Journal of Experimental Education. 91(4) https://doi.org/10.1080/00220973.2022.2092833
   Web of Science ®Google Scholar
• Vispoel, W. P., Morris, C. A., & Kilinc, M. (2018a). Applications of generalizability theory and their relations to classical test theory and structural equation modeling. Psychological Methods, 23, 1–26. https://doi.org/10.1037/met0000107
   PubMed Web of Science ®Google Scholar
• Vispoel, W. P., Morris, C. A., & Kilinc, M. (2018b). Practical applications of generalizability theory for designing, evaluating, and improving psychological assessments. Journal of Personality Assessment, 100, 53–67. https://doi.org/10.1080/00223891.2017.1296455
   PubMed Web of Science ®Google Scholar
• Vispoel, W. P., Morris, C. A., & Kilinc, M. (2018c). Using generalizability theory to disattenuate correlation coefficients for multiple sources of measurement error. Multivariate Behavioral Research, 53, 481–501. https://doi.org/10.1080/00273171.2018.1457938
   PubMed Web of Science ®Google Scholar
• Vispoel, W. P., Morris, C. A., & Kilinc, M. (2018d). Using G-theory to enhance evidence of reliability and validity for common uses of the Paulhus Deception Scales. Assessment, 25, 69–83. https://doi.org/10.1177/1073191116641182
   PubMed Web of Science ®Google Scholar
• Vispoel, W. P., Morris, C. A., & Kilinc, M. (2019). Using generalizability theory with continuous latent response variables. Psychological Methods, 24, 153–178. https://doi.org/10.1037/met0000177
   PubMed Web of Science ®Google Scholar
• Vispoel, W. P., & Tao, S. (2013). A generalizability analysis of score consistency for the Balanced Inventory of Desirable Responding. Psychological Assessment, 25, 94–104. https://doi.org/10.1037/a0029061
   PubMed Web of Science ®Google Scholar
• Vispoel, W. P., Xu, G., & Kilinc, M. (2021). Expanding G-theory models to incorporate congeneric relationships: Illustrations using the Big Five Inventory. Journal of Personality Assessment, 103, 429–442. https://doi.org/10.1080/00223891.202.1808474
   PubMed Web of Science ®Google Scholar
• Vispoel, W. P., Xu, G., & Schneider, W. S. (2022b). Interrelationships between latent state-trait theory and generalizability theory in a structural equation modeling framework. Psychological Methods, 27, 773–803. https://doi.org/10.1037/met0000290
   PubMed Web of Science ®Google Scholar
• Vispoel, W. P., Xu, G., & Schneider, W. S. (2022c). Using parallel splits with self-report and other measures to enhance precision in generalizability theory analyses. Journal of Personality Assessment, 104, 303–319. https://doi.org/10.1080/00223891.2021.1938589
   PubMed Web of Science ®Google Scholar