Can Nudging Mentors Weaken Student Support? Experimental Evidence from a Virtual Communication Intervention

References

• Athey, S., & Imbens, G. W. (2017). Chapter 3 - the econometrics of randomized experimentsa. In A. V. Banerjee & E. Duflo (Eds.), Handbook of economic field experiments (Vol. 1, pp. 73–140). North-Holland.
   Google Scholar
• Bayer, A., Grossman, J. B., & DuBois, D. L. (2015). Using volunteer mentors to improve the academic outcomes of underserved students: The role of relationships. Journal of Community Psychology, 43(4), 408–429. https://doi.org/10.1002/jcop.21693
   Web of Science ®Google Scholar
• Bergman, P. (2016). Technology adoption in education: Usage, spillovers and student achievement. CESifo Working Paper Series (No. 6101). Elsevier. https://ssrn.com/abstract=2866866
   Google Scholar
• Bergman, P. (2021). Parent-child information frictions and human capital investment: Evidence from a field experiment. Journal of Political Economy, 129(1), 286–322. https://doi.org/10.1086/711410
   Web of Science ®Google Scholar
• Bergman, P., & Chan, E. W. (2021). Leveraging parents through low-cost technology: The impact of high-frequency information on student achievement. Journal of Human Resources, 56(1), 125–158. https://doi.org/10.3368/jhr.56.1.1118-9837R1
   Web of Science ®Google Scholar
• Bird, K., Castleman, B. L., Goodman, J. S., & Lamberton, C. (2017). Nudging at a national scale: Experimental evidence from a FAFSA completion campaign. EdPolicyWorks Working Paper Series, (No. 54. March 2017). University of Virginia's Curry School of Education EdPolicy Works. https://luminafoundation.org/wp-content/uploads/2017/08/fafsa-nudging-at-scale.pdf
   Google Scholar
• CASEL. (2020). An initial guide to leveraging the power of social emotional learning as you prepare to reopen and renew your school community. CASEL. https://casel.org/wp-content/uploads/2020/05/CASEL_Leveraging-SEL-as-You-Prepare-to-Reopen-and-Renew.pdf
   Google Scholar
• Castleman, B. L., & Page, L. C. (2015). Summer nudging: Can personalized text messages and peer mentor outreach increase college going among low-income high school graduates? Journal of Economic Behavior & Organization, 115, 144–160. https://doi.org/10.1016/j.jebo.2014.12.008
   Web of Science ®Google Scholar
• Castleman, B. L., & Page, L. C. (2016). Freshman year financial aid nudges: An experiment to increase FAFSA renewal and college persistence. Journal of Human Resources, 51(2), 389–415. https://doi.org/10.3368/jhr.51.2.0614-6458R
   Web of Science ®Google Scholar
• Castleman, B. L., & Page, L. C. (2017). Parental influences on postsecondary decision making: Evidence from a text messaging experiment. Educational Evaluation and Policy Analysis, 39(2), 361–377. https://doi.org/10.3102/0162373716687393
   Web of Science ®Google Scholar
• Chen, G., Gully, S. M., & Eden, D. (2001). Validation of a new general self-efficacy scale. Organizational Research Methods, 4(1), 62–83. https://doi.org/10.1177/109442810141004
   Web of Science ®Google Scholar
• Clearinghouse, W. W. (2022). What works clearinghouse procedures and standards handbook, version 5.0. U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance (NCEE). https://ies.ed.gov/ncee/wwc/Handbooks
   Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum.
   Google Scholar
• Damgaard, M. T., & Nielsen, H. S. (2018). Nudging in education. Economics of Education Review, 64, 313–342. https://doi.org/10.1016/j.econedurev.2018.03.008
   Web of Science ®Google Scholar
• De Castella, K., & Byrne, D. (2015). My intelligence may be more malleable than yours: The revised implicit theories of intelligence scale is a better predictor of achievement, motivation, and student disengagement. European Journal of Psychology of Education, 30(3), 245–267. https://doi.org/10.1007/s10212-015-0244-y
   Web of Science ®Google Scholar
• Deutsch, N. L., & Spencer, R. (2009). Capturing the magic: Assessing the quality of youth mentoring relationships. New Directions for Youth Development, 2009(121), 47–70. https://doi.org/10.1002/yd.296
   PubMedGoogle Scholar
• DuBois, D. L., Holloway, B. E., Valentine, J. C., & Cooper, H. (2002). Effectiveness of mentoring programs for youth: A meta-analytic review. American Journal of Community Psychology, 30(2), 157–197. https://doi.org/10.1023/a:1014628810714
   PubMed Web of Science ®Google Scholar
• DuBois, D. L., Portillo, N., Rhodes, J. E., Silverthorn, N., & Valentine, J. C. (2011). How effective are mentoring programs for youth? A systematic assessment of the evidence. Psychological Science in the Public Interest: A Journal of the American Psychological Society, 12(2), 57–91. https://doi.org/10.1177/1529100611414806
   PubMed Web of Science ®Google Scholar
• Harris, J. T., & Nakkula, M. J. (2018a). Match characteristics questionnaire (MCQ). Unpublished measure. Applied Research Consulting.
   Google Scholar
• Harris, J. T., & Nakkula, M. J. (2018b). Youth mentoring survey (YMS). Unpublished measure. Applied Research Consulting.
   Google Scholar
• Herrera, C., Grossman, J. B., Kauh, T. J., Feldman, A. F., McMaken, J., & Jucovy, L. Z. (2007). Making a difference in schools: The big brothers big sisters school-based mentoring impact study. Public/Private Ventures Report.
   Google Scholar
• Herrera, C., Grossman, J. B., Kauh, T. J., & McMaken, J. (2011). Mentoring in schools: An impact study of Big Brothers Big Sisters school-based mentoring. Child Development, 82(1), 346–361. https://doi.org/10.1111/j.1467-8624.2010.01559.x
   PubMed Web of Science ®Google Scholar
• Herrera, C., Sipe, C. L., & McClanahan, W. S. (2000). Mentoring school-age children: Relationship development in community-based and school-based programs. Public/Private Ventures.
   Google Scholar
• Heß, S. (2017). Randomization inference with Stata: A guide and software. The Stata Journal: Promoting Communications on Statistics and Stata, 17(3), 630–651. http://www.stata-journal.com/article.html?article=st0489 https://doi.org/10.1177/1536867X1701700306
   Google Scholar
• Karcher, M. J., Nakkula, M. J., & Harris, J. (2005). Developmental mentoring match characteristics: Correspondence between mentors’ and mentees’ assessments of relationship quality. The Journal of Primary Prevention, 26(2), 93–110. https://doi.org/10.1007/s10935-005-1847-x
   PubMedGoogle Scholar
• Kern, M. L., Benson, L., Steinberg, E. A., & Steinberg, L. (2016). The EPOCH measure of adolescent well-being. Psychological Assessment, 28(5), 586–597. https://doi.org/10.1037/pas0000201
   PubMed Web of Science ®Google Scholar
• Kern, L., Harrison, J. R., Custer, B. E., & Mehta, P. D. (2019). Factors that enhance the quality of relationships between mentors and mentees during check & connect. Behavioral Disorders, 44(3), 148–161. https://doi.org/10.1177/0198742918779791
   Web of Science ®Google Scholar
• Kizilcec, R. F., Schneider, E., Cohen, G. L., & McFarland, D. A. (2014). Encouraging forum participation in online courses with collectivist, individualist and neutral motivational framings. eLearning Papers, 37, 13–22.
   Google Scholar
• Kraft, M. A. (2020). Interpreting effect sizes of education interventions. Educational Researcher, 49(4), 241–253. https://doi.org/10.3102/0013189X20912798
   Web of Science ®Google Scholar
• Kraft, M. A., Bolves, A., & Hurd, N. M. (2021). School-based mentoring relationships and human capital formation. (EdWorkingPaper: 21-441). Brown University. https://doi.org/10.26300/96bs-6m26
   Google Scholar
• Lippman, L. H., Moore, K. A., Guzman, L., Ryberg, R., McIntosh, H., Ramos, M. F., Caal, S., Carle, A., & Kuhfeld, M. (2014). Flourishing children: Defining and testing indicators of positive development. Springer.
   Google Scholar
• Loewenstein, G., Krishnamurti, T., Kopsic, J., & McDonald, D. (2015). Does increased sexual frequency enhance happiness? Journal of Economic Behavior & Organization, 116, 206–218. https://doi.org/10.1016/j.jebo.2015.04.021
   Web of Science ®Google Scholar
• Maynard, B. R., Kjellstrand, E. K., & Thompson, A. M. (2014). Effects of check and connect on attendance, behavior, and academics: A randomized effectiveness trial. Research on Social Work Practice, 24(3), 296–309. https://doi.org/10.1177/1049731513497804
   Web of Science ®Google Scholar
• Morgan, K. L., & Rubin, D. B. (2012). Rerandomization to improve covariate balance in experiments. The Annals of Statistics, 40(2), 1263–1282. https://doi.org/10.1214/12-AOS1008
   Web of Science ®Google Scholar
• Nakkula, M. J., & Harris, J. T. (2014). Chapter 4: Assessing mentoring relationships. In D. L. DuBois & M. J. Karcher (Eds.), Handbook of youth mentoring (2nd ed., pp. 45–62). SAGE.
   Google Scholar
• Oreopoulos, P. (2020). Promises and limitations of nudging in education. (EdWorkingPaper: 20-296). Retrieved from Annenberg Institute at Brown University. https://doi.org/10.26300/5kqf-7j06
   Google Scholar
• Parra, G. R., DuBois, D. L., Neville, H. A., Pugh-Lilly, A. O., & Povinelli, N. (2002). Mentoring relationships for youth: Investigation of a process-oriented model. Journal of Community Psychology, 30(4), 367–388. https://doi.org/10.1002/jcop.10016
   Web of Science ®Google Scholar
• Raposa, E. B., Dietz, N., & Rhodes, J. E. (2017). Trends in volunteer mentoring in the United States: Analysis of a decade of census survey data. American Journal of Community Psychology, 59(1–2), 3–14. https://doi.org/10.1002/ajcp.12117
   PubMed Web of Science ®Google Scholar
• Raposa, E. B., Rhodes, J., Stams, G. J. J. M., Card, N., Burton, S., Schwartz, S., Sykes, L. A. Y., Kanchewa, S., Kupersmidt, J., & Hussain, S. (2019). The effects of youth mentoring programs: A meta-analysis of outcome studies. Journal of Youth and Adolescence, 48(3), 423–443. https://doi.org/10.1007/s10964-019-00982-8
   PubMed Web of Science ®Google Scholar
• Rhodes, J. E., Spencer, R., Keller, T. E., Liang, B., & Noam, G. (2006). A model for the influence of mentoring relationships on youth development. Journal of Community Psychology, 34(6), 691–707. https://doi.org/10.1002/jcop.20124
   Web of Science ®Google Scholar
• Robinson, C. D., Lee, M. G., Dearing, E., & Rogers, T. (2018). Reducing student absenteeism in the early grades by targeting parental beliefs. American Educational Research Journal, 55(6), 1163–1192. https://doi.org/10.3102/0002831218772274
   Web of Science ®Google Scholar
• Rogers, T., & Feller, A. (2018). Reducing student absences at scale by targeting parents’ misbeliefs. Nature Human Behaviour, 2(5), 335–342. https://doi.org/10.1038/s41562-018-0328-1
   PubMed Web of Science ®Google Scholar
• Rones, M., & Hoagwood, K. (2000). School-based mental health services: A research review. Clinical Child and Family Psychology Review, 3(4), 223–241. https://doi.org/10.1023/A:1026425104386
   PubMedGoogle Scholar
• Schochet, P. Z. (2008). Technical methods report: Guidelines for multiple testing in impact evaluations (NCEE 2008-4018). National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education.
   Google Scholar
• Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin Company.
   Google Scholar
• Simonton, S. (2020). MENTOR portal lets youth organizations go virtual, shift mentoring online [Press release]. https://www.evidencebasedmentoring.org/mentor-portal-lets-youth-organizations-go-virtual-shift-mentoring-online/
   Google Scholar
• WestEd. (2008). California Healthy Kids Survey (CHKS). https://www.wested.org/project/california-healthy-kids-survey-chks/
   Google Scholar
• Woods, C. S., & Preciado, M. (2016). Student–mentor relationships and students’ college attitudes. Journal of Education for Students Placed at Risk (JESPAR), 21(2), 90–103. https://doi.org/10.1080/10824669.2015.1127767
   Web of Science ®Google Scholar