Addressing Limitations of p in Counseling Research through Reporting of Bayes Factor Bound and Effect Size Precision

References

• American Psychological Association. (2020). Publication manual of the American Psychological Association 2020: The official guide to APA style (7th ed.). American Psychological Association.
   Google Scholar
• Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66(6), 423–437. https://doi.org/10.1037/h0020412
   PubMed Web of Science ®Google Scholar
• Balkin, R. S., & Lenz, A. S. (2021). Contemporary issues in reporting statistical, practical, and clinical significance in counseling research. Journal of Counseling & Development, 99(2), 227–237. https://doi.org/10.1002/jcad.12370
   Web of Science ®Google Scholar
• Balkin, R. S., & Russo, G. M. (2021). Evaluating perceptions of working alliance and crisis stabilization for adolescent males in residential treatment for substance abuse: A time-series analysis. Counseling Outcome Research and Evaluation, 12(1), 4–15. https://doi.org/10.1080/21501378.2020.1776598
   Google Scholar
• Balkin, R. S., & Sheperis, C. J. (2011). Evaluating and reporting statistical power in counseling research. Journal of Counseling & Development, 89(3), 268–272. https://doi.org/10.1002/j.1556-6678.2011.tb00088.x
   Web of Science ®Google Scholar
• Benjamin, D. J., & Berger, J. O. (2019). Three recommendations for improving the use of p-values. The American Statistician, 73(sup1), 186–191. https://doi.org/10.1080/00031305.2018.1543135
   Web of Science ®Google Scholar
• Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E.-J., Berk, R., Bollen, K. A., Brembs, B., Brown, L., Camerer, C., Cesarini, D., Chambers, C. D., Clyde, M., Cook, T. D., De Boeck, P., Dienes, Z., Dreber, A., Easwaran, K., Efferson, C., … Johnson, V. E. (2018). Redefine statistical significance. Nature Human Behaviour, 2(1), 6–10. https://doi.org/10.1038/s41562-017-0189-z
   PubMed Web of Science ®Google Scholar
• Bolles, R. C. (1962). The difference between statistical hypotheses and scientific hypotheses. Psychological Reports, 11(3), 639–645. https://doi.org/10.2466/pr0.1962.11.3.639
   Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Psychological Press.
   Google Scholar
• Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. https://doi.org/10.1037/0033-2909.112.1.155
   PubMed Web of Science ®Google Scholar
• Cohen, J. (1994). The earth is round (p <.05). American Psychologist, 49(12), 997–1003. https://doi.org/10.1037/0003-066X.49.12.997
   Web of Science ®Google Scholar
• Fornacon-Wood, I., Mistry, H., Johnson-Hart, C., Faivre-Finn, C., O’Connor, J. P. B., & Price, G. J. (2022). Understanding the differences between Bayesian and frequentist statistics. International Journal of Radiation Oncology, Biology, Physics, 112(5), 1076–1082. https://doi.org/10.1016/j.ijrobp.2021.12.011
   PubMed Web of Science ®Google Scholar
• Granello, D. H. (2007). Publishing quantitative manuscripts in counselor education and supervision: General guidelines and expectations [Editorial]. Counselor Education and Supervision, 47(2), 66–75. https://doi.org/10.1002/j.1556-6978.2007.tb00039.x
   Google Scholar
• Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G. (2016). Statistical tests, P values, confidence intervals, and power: A guide to misinterpretations. European Journal of Epidemiology, 31(4), 337–350. https://doi.org/10.1007/s10654-016-0149-3
   PubMed Web of Science ®Google Scholar
• McShane, B. B., Gal, D., Gelman, A., Tackett, C. R., Robert, C., & Tackett, J. L. (2019). Abandon statistical significance. The American Statistician, 73(sup1), 235–245. https://doi.org/10.1080/00031305.2018.1527253
   Web of Science ®Google Scholar
• Melton, A. W. (1962). Editorial. Journal of Experimental Psychology, 64(6), 553–557. https://doi.org/10.1037/h0045549
   Google Scholar
• Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349, aac4716. https://doi.org/10.1126/science.aac4716
   PubMed Web of Science ®Google Scholar
• Schmalz, X., Biurrun Manresa, J., & Zhang, L. (2021). What is a Bayes factor? Psychological Methods, 28(3), 705–718. https://doi.org/10.1037/met0000421
   Google Scholar
• Sellke, T. M., Bayarri, J., & Berger, J. O. (2001). Calibration of ρ values for testing precise null hypotheses. The American Statistician, 55(1), 62–71. https://doi.org/10.1198/000313001300339950
   Web of Science ®Google Scholar
• Thompson, B. (1994). The concept of statistical significance testing. Practical Assessment, Research, and Evaluation, 4, 5. https://doi.org/10.7275/3gsd-tk11
   Google Scholar
• Thompson, B. (2008). Foundations of behavioral statistics: An insight-based approach. Guilford Press.
   Google Scholar
• Trafimow, D., & Marks, M. (2015). Editorial. Basic and Applied Social Psychology, 37(1), 1–2. https://doi.org/10.1080/01973533.2015.1012991
   Web of Science ®Google Scholar
• Trusty, J., Thompson, B., & Petrocelli, J. V. (2004). Practical guide for reporting effect size in quantitative research in the Journal of Counseling & Development. Journal of Counseling & Development, 82(1), 107–110. https://doi.org/10.1002/j.1556-6678.2004.tb00291.x
   Web of Science ®Google Scholar
• Uanhoro, J. O. (2017). Effect size calculators. https://effect-size-calculator.herokuapp.com/
   Google Scholar
• Underwood, B. J., Duncan, C. P., Taylor, J. A., & Cotton, J. W. (1954). Elementary statistics. Appleton-Century-Crofts.
   Google Scholar
• Valentine, J. C., Aloe, A. M., & Lau, T. S. (2015). Life after NHST: How to describe your data without “p-ing” everywhere. Basic and Applied Social Psychology, 37(5), 260–273. https://doi.org/10.1080/01973533.2015.1060240
   Web of Science ®Google Scholar
• Watson, J. C., Lenz, A. S., Schmit, M., & Schmit, E. (2016). Estimating and reporting practical significance in counseling research. Counseling Outcome Research and Evaluation, 7(2), 111–123. https://doi.org/10.1177/2150137816660584
   Google Scholar
• Wilson, K. V. (1961). Subjectivist statistics for the current crisis. Contemporary Psychology: A Journal of Reviews, 6(7), 229–231. https://doi.org/10.1037/006641
   Google Scholar