Mind the (Construct-Measurement) Gap

References

• Aluja, A., García, L. F., Rossier, J., Ostendorf, F., Glicksohn, J., Oumar, B., Bellaj, T., Ruch, W., Wang, W., Suranyi, Z., Ścigała, D., Čekrlija, Đ., Stivers, A. W., Blas, L. D., Valdivia, M., Ben Jemaa, S., Atitsogbe, K. A., & Hansenne, M. (2022). Dark triad traits, social position, and personality: A cross-cultural study. Journal of Cross-Cultural Psychology, 53(3-4), 380–402. https://doi.org/10.1177/00220221211072816
   Web of Science ®Google Scholar
• Barrett, L. F. (2019, September 25). Zombie ideas. APS Observer. https://www.psychologicalscience.org/observer/zombie-ideas
   Google Scholar
• Baumeister, R. F., & Tice, D. M. (2022). Ego depletion is the best replicated finding in all of social psychology. Scholarly Journal of Psychology and Behavioral Sciences, 6(2), 686–688. https://doi.org/10.32474/SJPBS.2021.06.000234
   Google Scholar
• Baumeister, R. F., Vohs, K. D., & Tice, D. M. (2007). The strength model of self-control. Current Directions in Psychological Science, 16(6), 351–355. https://doi.org/10.1111/j.1467-8721.2007.00534.x
   Web of Science ®Google Scholar
• Bianchi, R., Verkuilen, J., Schonfeld, I. S., Hakanen, J. J., Jansson-Fröjmark, M., Manzano-García, G., Laurent, E., & Meier, L. L. (2021). Is burnout a depressive condition? A 14-sample meta-analytic and bifactor analytic study. Clinical Psychological Science, 9(4), 579–597. https://doi.org/10.1177/2167702620979597
   Web of Science ®Google Scholar
• Burke, S. E., & Moss-Racusin, C. A. (2023). Playing the long game: Carrying out principled tests of psychological phenomena before developing formal theories. Journal of Applied Social Psychology, 53(7), 535–539. https://doi.org/10.1111/jasp.13001
   Web of Science ®Google Scholar
• Carter, E. C., & McCullough, M. E. (2014). Publication bias and the limited strength model of self-control: Has the evidence for ego depletion been overestimated? Frontiers in Psychology, 5, 823. https://doi.org/10.3389/fpsyg.2014.00823
   PubMed Web of Science ®Google Scholar
• Charlton, B. G. (2008). Zombie science: A sinister consequence of evaluating scientific theories purely on the basis of enlightened self-interest. Medical Hypotheses, 71(3), 327–329. https://doi.org/10.1016/j.mehy.2008.05.018
   PubMed Web of Science ®Google Scholar
• Credé, M., Tynan, M. C., & Harms, P. D. (2017). Much ado about grit: A meta-analytic synthesis of the grit literature. Journal of Personality and Social Psychology, 113(3), 492–511. https://doi.org/10.1037/pspp0000102
   PubMed Web of Science ®Google Scholar
• Dang, J., Barker, P., Baumert, A., Bentvelzen, M., Berkman, E., Buchholz, N., Buczny, J., Chen, Z., De Cristofaro, V., de Vries, L., Dewitte, S., Giacomantonio, M., Gong, R., Homan, M., Imhoff, R., Ismail, I., Jia, L., Kubiak, T., Lange, F., … Zinkernagel, A. (2021). A multilab replication of the ego depletion effect. Social Psychological and Personality Science, 12(1), 14–24. https://doi.org/10.1177/1948550619887702
   PubMed Web of Science ®Google Scholar
• Donnellan, M. B., Lucas, R. E., & Cesario, J. (2015). On the association between loneliness and bathing habits: Nine replications of Bargh and Shalev (2012) Study 1. Emotion, 15(1), 109–119. https://doi.org/10.1037/a0036079
   PubMed Web of Science ®Google Scholar
• Doyen, S., Klein, O., Pichon, C.-L., & Cleeremans, A. (2012). Behavioral priming: It’s all in the mind, but whose mind? PLOS One, 7(1), e29081. https://doi.org/10.1371/journal.pone.0029081
   PubMed Web of Science ®Google Scholar
• Ebersole, C., Andrighetto, L., Casini, E., Chiorri, C., Dalla Rosa, A., Domaneschi, F., Ferguson, I., Fryberger, E., Giacomantonio, M., Grahe, J., Joy-Gaba, J., Langford, E., Nichols, A., Panno, A., Parks, K., Preti, E., Richetin, J., & Vianello, M. (2020). Many Labs 5: Registered replication of payne, burkley, and stokes. Advances in Methods and Practices in Psychological Science, 3(3), 387–393. https://doi.org/10.1177/2515245919885609
   Google Scholar
• Flake, J., & Fried, E. (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3(4), 456–465. https://doi.org/10.1177/2515245920952393Flake
   Google Scholar
• Flake, J. K. (2021). Strengthening the foundation of educational psychology by integrating construct validation into open science reform. Educational Psychologist, 56(2), 132–141. https://doi.org/10.1080/00461520.2021.1898962
   Web of Science ®Google Scholar
• Flake, J., Pek, J., & Hehman, E. (2017). Construct validation in social and personality research: Current practice and recommendations. Social Psychological and Personality Science, 8(4), 370–378. https://doi.org/10.1177/1948550617693063
   Web of Science ®Google Scholar
• Gilder, T. S. E., & Heerey, E. A. (2018). The role of experimenter belief in social priming. Psychological Science, 29(3), 403–417. https://doi.org/10.1177/0956797617737128
   PubMed Web of Science ®Google Scholar
• Hagger, M. S., Chatzisarantis, N. L. D., Alberts, H., Anggono, C. O., Batailler, C., Birt, A. R., Brand, R., Brandt, M. J., Brewer, G., Bruyneel, S., Calvillo, D. P., Campbell, W. K., Cannon, P. R., Carlucci, M., Carruth, N. P., Cheung, T., Crowell, A., De Ridder, D. T. D., Dewitte, S., … Zwienenberg, M. (2016). A multilab preregistered replication of the ego-depletion effect. Perspectives on Psychological Science, 11(4), 546–573. https://doi.org/10.1177/1745691616652873
   Web of Science ®Google Scholar
• Hagger, M. S., Wood, C., Stiff, C., & Chatzisarantis, N. L. D. (2010). Ego depletion and the strength model of self-control: A meta-analysis. Psychological Bulletin, 136(4), 495–525. https://doi.org/10.1037/a0019486
   PubMed Web of Science ®Google Scholar
• Hardesty, D. M., & Bearden, W. O. (2004). The use of expert judges in scale development: Implications for improving face validity of measures of unobservable constructs. Journal of Business Research, 57(2), 98–107. https://doi.org/10.1016/S0148-2963(01)00295-8
   Web of Science ®Google Scholar
• Hodson, G. (2021a). Construct jangle or construct mangle? Thinking straight about (nonredundant) psychological constructs. Journal of Theoretical Social Psychology, 5(4), 576–590. https://doi.org/10.1002/jts5.120
   Google Scholar
• Hodson, G. (2021b). Pushing back against the microaggression pushback in academic psychology: Reflections on a concept creep paradox. Perspectives on Psychological Science, 16(5), 932–955. https://doi.org/10.1177/1745691621991863
   Web of Science ®Google Scholar
• Hodson, G., Book, A., Visser, B. A., Volk, A. A., Ashton, M. C., & Lee, K. (2018). Is the Dark Triad common factor distinct from low honesty-humility? Journal of Research in Personality, 73, 123–129. https://doi.org/10.1016/j.jrp.2017.11.012
   Web of Science ®Google Scholar
• Hodson, G., MacInnis, C. C., & Busseri, M. A. (2017). Bowing and kicking: Rediscovering the fundamental link between generalized authoritarianism and generalized prejudice. Personality and Individual Differences, 104, 243–251. https://doi.org/10.1016/j.paid.2016.08.018
   Web of Science ®Google Scholar
• Hodson, G., & Prusaczyk, E. (2023). A cautionary note on interpreting research findings in the presence of statistical suppression. The Journal of Social Psychology, 1–4. Online advance. https://doi.org/10.1080/00224545.2023.2197775
   Web of Science ®Google Scholar
• Hoyle, R. H., Lynam, D. R., Miller, J. D., & Pek, J. (2023). The questionable practice of partialing to refine scores on and inferences about measures of psychological constructs. Annual Review of Clinical Psychology, 19(1), 155–176. https://doi.org/10.1146/annurev-clinpsy-071720-015436
   PubMedGoogle Scholar
• Inzlicht, M., & Friese, M. (2019). The past, present, and future of ego depletion. Social Psychology, 50(5-6), 370–378. https://doi.org/10.1027/1864-9335/a000398
   Web of Science ®Google Scholar
• Kekecs, Z., Palfi, B., Szaszi, B., Szecsi, P., Zrubka, M., Kovacs, M., Bakos, B. E., Cousineau, D., Tressoldi, P., Schmidt, K., Grassi, M., Evans, T. R., Yamada, Y., Miller, J. K., Liu, H., Yonemitsu, F., Dubrov, D., Röer, J. P., Becker, M., … Aczel, B. (2023). Raising the value of research studies in psychological science by increasing the credibility of research reports: The transparent Psi project. Royal Society Open Science, 10(2), 191375. https://doi.org/10.1098/rsos.191375
   PubMed Web of Science ®Google Scholar
• Le, H., Schmidt, F., Harter, J., & Lauver, K. (2010). The problem of empirical redundancy of constructs in organizational research: An empirical investigation. Organizational Behavior and Human Decision Processes, 112(2), 112–125. https://doi.org/10.1016/j.obhdp.2010.02.003
   Web of Science ®Google Scholar
• Lilienfeld, S., & Strother, A. (2020). Psychological measurement and the replication crisis: Four sacred cows. Canadian Psychology, 61(4), 281–288. https://doi.org/10.1037/cap0000236
   Web of Science ®Google Scholar
• Macnamara, B. N., & Burgoyne, A. P. (2022). Do growth mindset interventions impact students’ academic achievement? A systematic review and meta-analysis with recommendations for best practices. Psychological Bulletin, 149(3–4), 133–173. https://doi.org/10.1037/bul0000352
   Web of Science ®Google Scholar
• Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251) aac4716. https://doi.org/10.1126/science.aac4716
   Web of Science ®Google Scholar
• Paulhus, D. L., & Williams, K. M. (2002). The Dark Triad of personality: Narcissism, Machiavellianism, and psychopathy. Journal of Research in Personality, 36(6), 556–563. https://doi.org/10.1016/S0092-6566(02)00505-6
   Web of Science ®Google Scholar
• Peeters, M. J., & Harpe, S. E. (2020). Updating conceptions of validity and reliability. Research in Social & Administrative Pharmacy, 16(8), 1127–1130. https://doi.org/10.1016/j.sapharm.2019.11.017
   PubMed Web of Science ®Google Scholar
• Shalev, I., & Bargh, J. (2015). On the association between loneliness and physical warmth-seeking through bathing: Reply to Donnellan et al. (2014) and three further replications of Bargh and Shalev (2012) study 1. Emotion, 15(1), 120–123. https://doi.org/10.1037/emo0000014
   PubMed Web of Science ®Google Scholar
• Simmons, J. P., & Simonsohn, U. (2017). Power posing: P-curving the evidence. Psychological Science, 28(5), 687–693. https://doi.org/10.1177/0956797616658563
   PubMed Web of Science ®Google Scholar
• Simons, D. J. (2014). The value of direct replication. Perspectives on Psychological Science, 9(1), 76–80. https://doi.org/10.1177/1745691613514755
   Web of Science ®Google Scholar
• Spector, P. E. (2013). Survey design and measure development. In T. D. Little (Ed.), The Oxford handbook of quantitative methods in psychology (Vol. 1, pp. 1–34). New York, NY: Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199934874.013.0009
   Google Scholar
• Stroebe, W., & Strack, F. (2014). The alleged crisis and the illusion of exact replication. Perspectives on Psychological Science, 9(1), 59–71. https://doi.org/10.1177/1745691613514450
   Web of Science ®Google Scholar
• Vadillo, M. A., Gold, N., & Osman, M. (2016). The bitter truth about sugar and willpower: The limited evidential value of the glucose model of ego depletion. Psychological Science, 27(9), 1207–1214. https://doi.org/10.1177/0956797616654911
   PubMed Web of Science ®Google Scholar
• Vize, C. E., Miller, J. D., & Lynam, D. R. (2021). Examining the conceptual and empirical distinctiveness of Agreeableness and “dark” personality items. Journal of Personality, 89(3), 594–612. https://doi.org/10.1111/jopy.12601
   PubMed Web of Science ®Google Scholar
• Vohs, K. D., Schmeichel, B. J., Lohmann, S., Gronau, Q. F., Finley, A. J., Ainsworth, S. E., Alquist, J. L., Baker, M. D., Brizi, A., Bunyi, A., Butschek, G. J., Campbell, C., Capaldi, J., Cau, C., Chambers, H., Chatzisarantis, N. L. D., Christensen, W. J., Clay, S. L., Curtis, J., … Albarracín, D. (2021). A multisite preregistered paradigmatic test of the ego-depletion effect. Psychological Science, 32(10), 1566–1581. https://doi.org/10.1177/0956797621989733
   PubMed Web of Science ®Google Scholar
• Wildschut, T., Sedikides, C., & Kelley, N. J. (2023). Trait nostalgia: Four scales and a recommendation. Current Opinion in Psychology, 52, 101608. https://doi.org/10.1016/j.copsyc.2023.101608
   PubMed Web of Science ®Google Scholar