Qualitative evaluations of women’s leadership programs: a global, multi-sector systematic review

References

• * Denotes study included in this review
   Google Scholar
• Alcázar, F. M., Fernández, P. M. R., & Gardey, G. S. (2013). Workforce diversity in strategic human resource management models: A critical review of the literature and implications for future research. Cross Cultural Management: An International Journal, 20(1), 39–20. https://doi.org/10.1108/13527601311296247
   Google Scholar
• Alhejji, H., Garavan, T., Carbery, R., O’Brien, F., & McGuire, D. (2016). Diversity training programme outcomes: A systematic review. Human Resource Development Quarterly, 27(1), 95–149. https://doi.org/10.1002/hrdq.21221
   Web of Science ®Google Scholar
• Anderson, D., Vinnicombe, S., & Singh, V. (2008). Women only leadership development: A conundrum. In K. James & J. Collins (Eds.), Leadership learning (pp. 147–160). Palgrave Macmillan.
   Google Scholar
• Avolio, B. J., Reichard, R. J., Hannah, S. T., Walumbwa, F. O., & Chan, A. (2009). A meta-analytic review of leadership impact research: Experimental and quasi-experimental studies. The Leadership Quarterly, 20(5), 764–784. https://doi.org/10.1016/j.leaqua.2009.06.006
   Web of Science ®Google Scholar
• Bagilhole, B. (2002). Challenging equal opportunities: Changing and adapting male hegemony in academia. British Journal of Sociology of Education, 23(1), 19–33. http://www.jstor.org/stable/1393095
   Web of Science ®Google Scholar
• Basl, M. (2000). Comparative analysis of quantitative and qualitative methods in French non-experimental evaluation of regional and local policies: Three cases of training programmes for unemployed adults. Evaluation, 6(3), 323–334. https://doi.org/10.1177/13563890022209316
   Google Scholar
• Becker, B., & Gerhart, B. (1996). The impact of human resource management on organizational performance: Progress and prospects. Academy of Management Journal, 39(4), 779–801. https://doi.org/10.5465/256712
   Web of Science ®Google Scholar
• Bierema, L. L. (2017). No woman left behind: Critical leadership development to build gender consciousness and transform organisations. In S. Madsen (Ed.), Handbook of research on gender and leadership (pp. 145–162). Edward Elgar Publishing.
   Google Scholar
• Briner, R. B., & Rousseau, D. M. (2011). Evidence-based I–O psychology: Not there yet but now a little nearer? Industrial and Organisational Psychology, 4(1), 76–82. https://doi.org/10.1111/j.1754-9434.2010.01301.x
   Google Scholar
• *Broyles, W. G. H. (2019). Profiles of a Non-Profit Statewide College Women’s Leadership Training Program’s Effectiveness [ Doctoral dissertation]. Liberty University.
   Google Scholar
• *Brue, K. L., & Brue, S. A. (2016). Experiences and outcomes of a women’s leadership development program: A phenomenological investigation. Journal of Leadership Education, 15(3), 75–97. https://doi.org/10.12806/V15/I3/R2
   Google Scholar
• *Calizo, L. S. H. (2011). A case analysis of a model program for the leadership development of women faculty and staff seeking to advance their careers in higher education [ Unpublished doctoral dissertation]. University of Maryland.
   Google Scholar
• *Clarke, M. (2011). Advancing women’s careers through leadership development programs. Employee Relations, 33(5), 498–515. https://doi.org/10.1108/01425451111153871
   Web of Science ®Google Scholar
• Collins, D. B., & Holton, E. F. (2004). The effectiveness of managerial leadership development programs: A meta‐analysis of studies from 1982 to 2001. Human Resource Development Quarterly, 15(2), 217–248. https://doi.org/10.1002/hrdq.1099
   Google Scholar
• Davey, K. M. (2008). Women’s accounts of organisational politics as a gendering process. Gender, Work & Organisation, 15(6), 650–671. https://doi.org/10.1111/j.1468-0432.2008.00420.x
   Web of Science ®Google Scholar
• Day, D. V., Fleenor, J. W., Atwater, L. E., Sturm, R. E., & McKee, R. A. (2014). Advances in leader and leadership development: A review of 25 years of research and theory. The Leadership Quarterly, 25(1), 63–82. https://doi.org/10.1016/j.leaqua.2013.11.004
   Web of Science ®Google Scholar
• *Debebe, G. (2009). Transformational learning in women’s leadership development training. Advancing Women in Leadership, 29(7), 2–12. https://doi.org/10.21423/awlj-v29.a264
   Google Scholar
• *Debebe, G. (2011). Creating a safe environment for women’s leadership transformation. Journal of Management Education, 35(5), 679–712. https://doi.org/10.1177/1052562910397501
   Google Scholar
• *Debebe, G. (2017). Navigating the double bind: Transformations to balance contextual responsiveness and authenticity in women’s leadership development. Cogent Business & Management, 4(1), 1–28. https://doi.org/10.1080/23311975.2017.1313543
   Google Scholar
• Debebe, G., Anderson, D., Bilimoria, D., & Vinnicombe, S. M. (2016). Women’s leadership development programs [special issue of journal of management education]. Journal of Management Education, 40(3), 608–611. https://doi.org/10.1177/1052562914533088
   Google Scholar
• Desvaux, G., Devillard-Hoellinger, S., & Meaney, M. C. (2008). A business case for women. The McKinsey Quarterly, 4, 26–33.
   Google Scholar
• *de Vries, J. (2010). A realistic agenda?: Women only programs as strategic interventions for building gender equitable workplaces [ Unpublished doctoral dissertation]. University of Western Australia.
   Google Scholar
• *de Vries, J. A., & van den Brink, M. (2016). Transformative gender interventions: Linking theory and practice using the “bifocal approach”. Equality, Diversity & Inclusion: An International Journal, 35(7/8), 429–448. https://doi.org/10.1108/EDI-05-2016-0041
   Google Scholar
• Due Billing, Y., & Alvesson, M. (2009). Understanding gender and organizations: An introduction to epistemology. Understanding Gender and Organizations, 1–272.
   Google Scholar
• Easterby-Smith, M. (1994). Evaluating management development, training and education (2nd ed.). Gower Publishing Company.
   Google Scholar
• Ely, K., Boyce, L. A., Nelson, J. K., Zaccaro, S. J., Hernez-Broome, G., & Whyman, W. (2010). Evaluating leadership coaching: A review and integrated framework. The Leadership Quarterly, 21(4), 585–599. https://doi.org/10.1016/j.leaqua.2010.06.003
   Web of Science ®Google Scholar
• Ely, R. J., Ibarra, H., & Kolb, D. M. (2011). Taking gender into account: Theory and design for women’s leadership development programs. Academy of Management Learning & Education, 10(3), 474–493. https://doi.org/10.5465/amle.2010.0046
   Web of Science ®Google Scholar
• Ely, R. J., & Meyerson, D. E. (2000). Advancing gender equity in organisations: The challenge and importance of maintaining a gender narrative. Organisation, 7(4), 589–608. https://doi.org/10.1177/135050840074005
   Web of Science ®Google Scholar
• Ely, K., & Sitzmann, T. (2007). Self-reported learning: What are we really measuring. In 22nd Annual Conference of the Society for Industrial-Organizational Psychology Conference, New York, NY.
   Google Scholar
• European Commission. (2010). More women in senior positions: Key to economic stability and growth. Publications Office of the European Union. https://doi.org/10.2767/92882
   Google Scholar
• Farmer, T., Robinson, K., Elliott, S. J., & Eyles, J. (2006). Developing and implementing a triangulation protocol for qualitative health research. Qualitative Health Research, 16(3), 377–394. https://doi.org/10.1177/1049732305285708
   PubMed Web of Science ®Google Scholar
• Farquhar, S. A., Parker, E. A., Schulz, A. J., & Israel, B. A. (2006). Application of qualitative methods in program planning for health promotion interventions. Health Promotion Practice, 7(2), 234–242. https://doi.org/10.1177/1524839905278915
   PubMedGoogle Scholar
• Ford, J. K., & Sinha, R. (2008). Advances in training evaluation research. In S. Cartwright & C. Cooper (Eds.), The Oxford handbook of personnel psychology. Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199234738.003.0013
   Google Scholar
• Foster-Fishman, P., Nowell, B., Deacon, Z., Nievar, M. A., & McCann, P. (2005). Using methods that matter: The impact of reflection, dialogue, and voice. American Journal of Community Psychology, 36(3–4), 275–291. https://doi.org/10.1007/s10464-005-8626-y
   PubMed Web of Science ®Google Scholar
• Frich, J. C., Brewster, A. L., Cherlin, E. J., & Bradley, E. H. (2015). Leadership development programs for physicians: A systematic review. Journal of General Internal Medicine, 30(5), 656–674. https://doi.org/10.1007/s11606-014-3141-1
   PubMed Web of Science ®Google Scholar
• *Gibbs, P. J. (2016). Self-efficacy and the leadership development of women in academic medicine: A study of women alumnae of the Hedwig van Ameringen Executive Leadership in Academic Medicine (ELAM) program [ Unpublished doctoral dissertation]. The George Washington University.
   Google Scholar
• Gipson, A. N., Pfaff, D. L., Mendelsohn, D. B., Catenacci, L. T., & Burke, W. W. (2017). Women and leadership: Selection, development, leadership style, and performance. The Journal of Applied Behavioral Science, 53(1), 32–65. https://doi.org/10.1177/0021886316687247
   Web of Science ®Google Scholar
• Grant Thornton. (2018). Women in business: Beyond policy to progress. https://www.grantthornton.global/en/insights/women-in-business-2018/
   Google Scholar
• Gray, B. (1994). The gender-based foundations of negotiation theory. Research on Negotiation in Organisations, 4, 3–36.
   Google Scholar
• Grove, J., Hass, T., & Kibel, B. M. (2005). EvaluLEAD: A guide for shaping and evaluating leadership development programs. Sustainable Leadership Initiative. Public Health Institute. https://www.wkkf.org/resource-directory/resource/2005/05/evalulead-a-guide-for-shaping-and-evaluating-leadership-development-programs
   Google Scholar
• Gurdjian, P., Halbeisen, T., & Lane, K. (2014). Why leadership-development programs fail. The McKinsey Quarterly, 1(1), 121–126.
   Google Scholar
• Harris, C. A., & Leberman, S. I. (2012). Leadership development for women in New Zealand universities: Learning from the New Zealand women in leadership program. Advances in Developing Human Resources, 14(1), 28–44. https://doi.org/10.1177/1523422311428747
   Google Scholar
• Hayward, I., & Voller, S. (2010). How effective is leadership development. The Ashridge Journal, 360, 8–13. http://www.ashridge.org.uk
   Google Scholar
• Hirsh, W., Tamkin, P., Garrow, V., & Burgoyne, J. (2011). Evaluating management and leadership development: New ideas and practical approaches. Key research findings. Institute for Employment Studies.
   Google Scholar
• Hoobler, J. M., Lemmon, G., & Wayne, S. J. (2011). Women’s underrepresentation in upper management: New insights on a persistent problem. Organisational Dynamics, 40(3), 151–156. https://doi.org/10.1016/j.orgdyn.2011.04.001
   Web of Science ®Google Scholar
• Hopkins, M. M., O’neil, D. A., Passarelli, A., & Bilimoria, D. (2008). Women’s leadership development strategic practices for women and organisations. Consulting Psychology Journal: Practice and Research, 60(4), 348. https://doi.org/10.1037/a0014093
   Google Scholar
• Ibarra, H., Ely, R., & Kolb, D. (2013). Women rising: The unseen barriers. Harvard Business Review, 91(9), 60–66. https://web.stanford.edu/dept/radiology/cgi-bin/raddiversity/wp-content/uploads/2017/12/WomenRising_TheUnseenBarriers.pdf
   PubMed Web of Science ®Google Scholar
• Janssens, M., & Zanoni, P. (2014). Alternative diversity management: Organizational practices fostering ethnic equality at work. Scandinavian Journal of Management, 30(3), 317–331. https://doi.org/10.1016/j.scaman.2013.12.006
   Web of Science ®Google Scholar
• Johansen, M., & Zhu, L. (2017). Who values diversity? Comparing the effect of manager gender across the public, private, and nonprofit sectors. The American Review of Public Administration, 47(7), 797–809. https://doi.org/10.1177/0275074016634201
   Web of Science ®Google Scholar
• Kalev, A., Dobbin, F., & Kelly, E. (2006). Best practices or best guesses? Assessing the efficacy of corporate affirmative action and diversity policies. American Sociological Review, 71(4), 589–617. https://doi.org/10.1177/000312240607100404
   Web of Science ®Google Scholar
• Kassotakis, M. E. (2017). Women-only leadership programs: A deeper look. In S. R. Madsen (Ed.), Handbook of research on gender and leadership (pp. 395–408). Edward Elgar Publishing. https://doi.org/10.4337/9781785363863.00036
   Google Scholar
• Kassotakis, M. E., & Rizk, J. B. (2015). Advancing women’s executive development: Effective practices for the design and delivery of global women’s leadership programs. In F. W. Ngunjiri & S. R. Madsen (Eds.), Women and leadership: Research, theory, and practice. Women as global leaders (pp. 163–185). IAP Information Age Publishing.
   Google Scholar
• Kay, K., & Shipman, C. (2014). The confidence gap. The Atlantic, 14(1), 1–18.
   Google Scholar
• Kirkpatrick, D. (1996). Great ideas revisited. Training & Development, 50(1), 54–60.
   Google Scholar
• Kirkpatrick, D. L. (1979). Techniques for evaluating training programs. Training & Development Journal, 33(6), 78–92.
   Google Scholar
• Kolhatkar, S. (2016). The female solidarity have-it-all, feel-good machine. Bloomberg Businessweek, February(4462), 48–55.
   Google Scholar
• Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality & Social Psychology, 77(6), 1121–1134. https://doi.org/10.1037/0022-3514.77.6.1121
   PubMed Web of Science ®Google Scholar
• Kulik, C. T. (2014). Working below and above the line: The research-practice gap in diversity management. Human Resource Management Journal, 24(2), 129–144. https://doi.org/10.1111/1748-8583.12038
   Web of Science ®Google Scholar
• Kulik, C. T., & Roberson, L. (2008a). Common goals and golden opportunities: Evaluations of diversity education in academic and organisational settings. Academy of Management Learning & Education, 7(3), 309–331. https://doi.org/10.5465/amle.2008.34251670
   Web of Science ®Google Scholar
• Kulik, C. T., & Roberson, L. (2008b). Diversity initiative effectiveness: What organisations can (and cannot) expect from diversity recruitment, diversity training, and formal mentoring programs. In A. P. Brief (Ed.), Cambridge companions to management. Diversity at work (pp. 265–317). Cambridge University Press. https://doi.org/10.1017/CBO9780511753725.010
   Google Scholar
• *Kvach, E., Yesehak, B., Abebaw, H., Conniff, J., Busse, H., & Haq, C. (2017). Perspectives of female medical faculty in Ethiopia on a leadership fellowship program. International Journal of Medical Education, 8, 314–323. https://doi.org/10.5116/ijme.5985.f644
   PubMedGoogle Scholar
• Leimon, A., Moscovici, F., & Goodier, H. (2010). Coaching women to lead. Routledge. https://doi.org/10.4324/9780203841013
   Google Scholar
• Lockwood, C., Munn, Z., & Porritt, K. (2015). Qualitative research synthesis: Methodological guidance for systematic reviewers utilizing meta-aggregation. International Journal of Evidence Based Healthcare, 13(3), 179–187. https://doi.org/10.1097/XEB.0000000000000062
   PubMed Web of Science ®Google Scholar
• Lockwood, C., Porrit, K., Munn, Z., Rittenmeyer, L., Salmond, S., Bjerrum, M., Loveday, H., Carrier, J., & Stannard, D. (2017). Chapter 2: Systematic reviews of qualitative evidence. In E. Aromataris & Z. Munn. (Eds.), Joanna Briggs Institute reviewer’s manual. The Joanna Briggs Institute. https://reviewersmanual.joannabriggs.org/
   Google Scholar
• *Louw, I., & Zuber-Skeritt, O. (2009). Reflecting on a leadership development programme: A case study in South African higher education. Perspectives in Education, 27(3), 237–246.
   Google Scholar
• Mabe, P. A., & West, S. G. (1982). Validity of self-evaluation of ability: A review and meta-analysis. Journal of Applied Psychology, 67(3), 280–296. https://doi.org/10.1037/0021-9010.67.3.280
   Web of Science ®Google Scholar
• Madsen, S. R., & Scribner, R. T. (2017). A perspective on gender in management: The need for strategic cross-cultural scholarship on women in management and leadership. Cross Cultural & Strategic Management, 24(2), 231–250. https://doi.org/10.1108/CCSM-05-2016-0101
   Web of Science ®Google Scholar
• Marecek, J. (2003). Dancing through minefields: Toward a qualitative stance in psychology. In P. Camic, J. Rhodes, & L. Yardley (Eds.), Qualitative research in psychology: Expanding perspectives in methodology and design (pp. 49–69). American Psychological Association. https://doi.org/10.1037/10595-004
   Google Scholar
• Mayne, J. (2012). Theory-based approaches to evaluation: Concepts and practices. Treasury Board of Canada Secretariat. https://www.canada.ca/en/treasury-board-secretariat/services/audit-evaluation/centre-excellence-evaluation/theory-based-approaches-evaluation-concepts-practices.html
   Google Scholar
• Metz, I., & Kumra, S. (2019). Why are self-help books with career advice for women popular? Academy of Management Perspectives, 33(1), 82–93. https://doi.org/10.5465/amp.2016.0152
   Web of Science ®Google Scholar
• Monks, K., & Barker, P. (1999). Management development for women academics and administrators. Journal of Management Development, 18(6), 531–542. https://doi.org/10.1108/02621719910279635
   Google Scholar
• Nentwich, J. C. (2006). Changing gender: The discursive construction of equal opportunities. Gender, Work & Organisation, 13(6), 499–521. https://doi.org/10.1111/j.1468-0432.2006.00320.x
   Web of Science ®Google Scholar
• Ngunjiri, F. W., & Gardiner, R. A. (2017). Future strategies for developing women as leaders. In S. R. Madsen (Ed.), Handbook of research on gender and leadership (pp. 423–437). Edward Elgar Publishing. https://doi.org/10.4337/9781785363863.00038
   Google Scholar
• Noland, M., Moran, T., & Kotschwar, B. R. (2016). Is gender diversity profitable? Evidence from a global survey (Working Paper, (16-3)). Peterson Institute for International Economics. https://doi.org/10.2139/ssrn.2729348
   Google Scholar
• O’Neil, D. A., & Bilimoria, D. (2005). Women’s career development phases: Idealism, endurance, and reinvention. Career Development International, 10(3), 168–189. https://doi.org/10.1108/13620430510598300
   Google Scholar
• O’Neil, D. A., & Hopkins, M. M. (2015). The impact of gendered organisational systems on women’s career advancement. Frontiers in Psychology, 6, 905. https://doi.org/10.3389/fpsyg.2015.00905
   PubMed Web of Science ®Google Scholar
• Pelfrey, C. M., Cola, P. A., Gerlick, J. A., Edgar, B. K., & Khatri, S. B. (2022). Breaking through barriers: Factors that influence behavior change toward leadership for women in academic medicine. Frontiers in Psychology, 13, 854488. https://doi.org/10.3389/fpsyg.2022.854488
   PubMed Web of Science ®Google Scholar
• Raifman, J. G., Lam, F., Keller, J. M., Radunsky, A., & Savedoff, W. D. (2017). Evaluating evaluations: Assessing the quality of aid agency evaluations in global health. (Working Papers 461). Center for Global Development. https://doi.org/10.2139/ssrn.3025057
   Google Scholar
• Riggio, R. E. (2008). Leadership development: The current state and future expectations. Consulting Psychology Journal: Practice and Research, 60(4), 383–392. https://doi.org/10.1037/1065-9293.60.4.383
   Google Scholar
• Rojon, C., McDowall, A., & Saunders, M. N. K. (2011). On the experience of conducting a systematic review in industrial, work, and organizational psychology: Yes, it is worthwhile. Journal of Personnel Psychology, 10(3), 133–138. https://doi.org/10.1027/1866-5888/a000041
   Web of Science ®Google Scholar
• Sandler, C. (2014). Developing female leaders: Helping women reach the top. Industrial and Commercial Training, 46(2), 61–67. https://doi.org/10.1108/ICT-11-2013-0077
   Google Scholar
• Schalken, N., & Rietbergen, C. (2017). The reporting quality of systematic reviews and meta-analyses in industrial and organisational psychology: A systematic review. Frontiers in Psychology, 8, 1–12. https://doi.org/10.3389/fpsyg.2017.01395
   PubMed Web of Science ®Google Scholar
• Selzer, R., Howton, A., & Wallace, F. (2017). Rethinking women’s leadership development: Voices from the trenches. Administrative Sciences, 7(2), 18. https://doi.org/10.3390/admsci7020018
   Web of Science ®Google Scholar
• Skaggs, S. (2008). Producing change or bagging opportunity? The effects of discrimination litigation on women in supermarket management. The American Journal of Sociology, 113(4), 1148–1182. https://doi.org/10.1086/522808
   Web of Science ®Google Scholar
• Storberg-Walker, J., & Natt Och Dag, K. (2017). Creativity in theorizing for women and leadership: A multi-paradigm perspective. In S. R. Madsen (Ed.), Handbook of research on gender and leadership (pp. 65–84). Edward Elgar Publishing. https://doi.org/10.4337/9781785363863.00012
   Google Scholar
• Stufflebeam, D. L. (2001). Evaluation checklists: Practical tools for guiding and judging evaluations. American Journal of Evaluation, 22(1), 71–79. https://doi.org/10.1177/109821400102200107
   Web of Science ®Google Scholar
• Sugiyama, K., Cavanagh, K. V., van Esch, C., Bilimoria, D., & Brown, C. (2016). Inclusive leadership development: Drawing from pedagogies of women’s and general leadership development programs. Journal of Management Education, 40(3), 253–292. https://doi.org/10.1177/1052562916632553
   Google Scholar
• Tessens, L. (2008). A review of current practices in women-only staff development programmes at Australian universities. In M. Barrow & K. Sutherland (Eds.), HERDSA: Engaging communities (Vol. 1, pp. 329–340). HERDSA.
   Google Scholar
• Torres, R. T., & Preskill, H. (2001). Evaluation and organisational learning: Past, present, and future. American Journal of Evaluation, 22(3), 387–395. https://doi.org/10.1177/109821400102200316
   Web of Science ®Google Scholar
• van Esch, C., Assylkhan, K., & Bilimoria, D. (2017). Using organisational and management science theories to understand women and leadership. In S. R. Madsen (Ed.), Handbook of research on gender and leadership (pp. 127–144). Edward Elgar Publishing. https://doi.org/10.4337/9781785363863.00016
   Google Scholar
• *Vinas, K. L. (2018). Narratives of women’s leadership identity development: An assessment of senior-level information technology (IT) leaders following participation in a women-only training program [ Unpublished doctoral dissertation]. Boston University.
   Google Scholar
• Vinnicombe, S., & Singh, V. (2002). Women-only management training: An essential part of women’s leadership development. Journal of Change Management, 3(4), 294–306. https://doi.org/10.1080/714023846
   Google Scholar
• Voller, S. (2010). The role of programme evaluation in organisational decision-making about management and leadership development [ Unpublished doctoral dissertation]. Cranfield University.
   Google Scholar
• Weyer, B. (2007). Twenty years later: Explaining the persistence of the glass ceiling for women leaders. Women in Management Review, 22(6), 482–496. https://doi.org/10.1108/09649420710778718
   Google Scholar
• Woetzel, J. (2015). McKinsey Global Institute. The power of parity: How advancing women’s equality can add $12 trillion to global growth. Online: McKinsey & Company. http://www.mckinsey.com/mgi
   Google Scholar
• Zahidi, S., & Ibarra, H. (2010). The corporate gender gap report 2010. World Economic Forum. http://www.weforum.org
   Google Scholar
• Zanoni, P., Janssens, M., Benschop, Y., & Nkomo, S. (2010). Guest editorial: Unpacking diversity, grasping inequality: Rethinking difference through critical perspectives. Organisation, 17(1), 9–29. https://doi.org/10.1177/1350508409350344
   Web of Science ®Google Scholar