Abstract
Objectives
To conduct a meta-analytic review of selective and indicated mentoring interventions for effects for youth at risk on delinquency and key associated outcomes (aggression, drug use, academic functioning). We also undertook the first systematic evaluation of intervention implementation features and organization and tested for effects of theorized key processes of mentor program effects.
Methods
Campbell Collaboration review inclusion criteria and procedures were used to search and evaluate the literature. Criteria included a sample defined as at risk for delinquency due to individual behavior such as aggression or conduct problems or environmental characteristics such as residence in a high-crime community. Studies were required to be random assignment or strong quasi-experimental design. Of 163 identified studies published from 1970–2011, 46 met criteria for inclusion.
Results
Mean effects sizes were significant and positive for each outcome category (ranging from d = 0.11 for academic achievement to d = 0.29 for aggression). Heterogeneity in effect sizes was noted for all four outcomes. Stronger effects resulted when mentor motivation was professional development but not by other implementation features. Significant improvements in effects were found when advocacy and emotional support mentoring processes were emphasized.
Conclusions
This popular approach has significant impact on delinquency and associated outcomes for youth at risk for delinquency. While evidencing some features may relate to effects, the body of literature is remarkably lacking in details about specific program features and procedures. This persistent state of limited reporting seriously impedes understanding about how mentoring is beneficial and ability to maximize its utility.
Similar content being viewed by others
Notes
In a sensitivity analysis, we tested for influence of studies with multiple outcomes on effects and found that the effect sizes in studies with single outcomes (SMD = 0.27, 95 % CI = 0.12–0.41) were slightly but not significantly higher than the effect sizes in studies with multiple outcomes (SMD = 0.22, 95 % CI = 0.07–0.38). Cross-tabulation of multiple outcomes by moderator variables revealed a single significant difference. Studies with a single outcome were more likely to have been selected for environmental or ecological risk than were studies that reported multiple outcomes, χ2 (1, n = 36) = 3.94, p < 0.05
References
Achenbach, T. M. (1991). Manual for Child Behavior Checklist/ 4-18 and 1991 Profile. Burlington, VT: University of Vermont, Dept. of Psychiatry.
Aos, S., Lieb, R., Mayfield, J., Miller, M., & Pennucci, A. (2004). Benefits and costs of prevention and early intervention programs for youth. Olympia: Washington State Institute for Public Policy.
Bailey, K. R. (1987). Inter-study differences: How should they influence the interpretation and analysis of results? Statistics in Medicine, 6, 351–358.
Chinn, S. (2000). A simple method for converting an odds ratio to effect size for use in meta-analysis. Statistics in Medicine, 19, 3127–3131.
Davidson, W. S., & Redner, R. (1988a). The prevention of juvenile delinquency: Diversion from the juvenile justice system. In R. H. Price, E. L. Cowen, R. P. Lorion, & J. Ramos-McKay (Eds.), Fourteen ounces of prevention: Theory, research, and prevention (pp. 123–137). New York: Pergamon.
Deutsch, N., & Spencer, R. (2009). Capturing the magic: Assessing the quality of youth mentoring relationships. New Directions in Youth Development: Theory, Practice and Research, 121, 47–70.
DuBois, D. L., Holloway, B. E., Valentine, J. C., & Cooper, H. M. (2002). Effectiveness of mentoring programs for youth: A meta-analytic review. American Journal of Community Psychology, 30, 157–197.
DuBois, d L., & Karcher, J. J. (2005). Youth mentoring: Theory, research, and practice. In D. L. DuBois & M. J. Karcher (Eds.), Handbook of youth mentoring (pp. 2–12). Thousand Oaks: Sage.
DuBois, D. L., Portillo, N., Rhodes, J. E., Silverthorn, N., & Valentine, J. C. (2011). How effective are mentoring programs for youth? A systematic assessment of the evidence. Psychological Science in the Public Interest, 12(2), 57–91.
Duval, S. & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56, 455–463.
Egger, M., Davey Smith, G., Schneider M., & Minder, C. (1997). Bias in metaanalysisdetected by a simple, graphical test. British Medical Journal, 315, 629–634.
Farrington, D. P. (2003). Developmental and life-course criminology: Key theoretical and empirical issues. Criminology, 41, 221–255.
Grossman, J. B., & Tierney, J. P. (1998a). Does mentoring work? An impact study of the Big brothers Big sisters program. Evaluation Review, 22, 403–426.
Haegerich, T., & Tolan, P. H. (2009). Core competencies and prevention of adolescent substance use. In N. G. Guerra, C. Bradshaw, R. Larson, & L. A. Jensen (Eds.), Youth at risk: Core competencies to prevent problem behaviors and promote positive youth development. New directions in child development (pp. 47–61). New York: Josey-Bass.
Hall, J. C. (2003). Mentoring and young people: A literature review. Glasgow: The SCRE Centre, University of Glasgow.
Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. New York: Academic.
Hedges, L. V., & Pigott, T. D. (2004). The power of statistical tests for moderators in meta-analysis. Psychological Methods, 9, 426–445.
Hieronymus, A. N., Lindquist, E. F. & Hoover, H. D. (1986). Iowa tests of basic skills: Early primary battery. Chicago: Riverside.
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. British Medical Journal, 327, 557–560.
Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Newbury Park: Sage Publications.
Lipsey, M. W., & Wilson, D. B. (1998). Effective intervention for serious juvenile offenders: A synthesis of research. In R. Loeber & D. Farrington (Eds.), Serious and violent juvenile offenders: Risk factors and successful interventions (pp. 313–341). Thousand Oaks: Sage.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174.
McCord, J. (1978a). A thirty-year follow-up of treatment effects. American Psychologist, 33(3), 284–289.
McCord, J. (1979a). Following up on Cambridge-Somerville: Response to Paul Wortman. American Psychologist, 34(8), 727.
McCord, J. (1992). The Cambridge–Somerville study: A pioneering longitudinal experimental study of delinquency prevention. In J. McCord & R. J. Tremblay (Eds.), Preventing antisocial behavior: Interventions from birth through adolescence (pp. 196–206). New York: Guilford.
MENTOR/National Mentoring Partnership. (2006). Mentoring in America 2005: A snapshot of the current state of mentoring. Alexandria: Author.
MENTOR/National Mentoring Partnership. (2009). Elements of effective practice for mentoring (3rd ed.). Alexandria, VA: Author. Retrieved from http://www.eric.ed.gov/PDFS/ED512172.pdf
Morgan, G., & Henrion, M. (1990). Uncertainty: A guide to dealing with uncertainty in quantitative risk and policy analysis. Cambridge: Cambridge University Press.
Raudenbush, S. W. (1994). Random effects models. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis. New York: Russell Sage.
Reynolds, C. R., & Kamphaus, R. W. (1992). Behavior assessment system for children\ (BASC). Circle Pines, MN: American Guidance Service.
Rhodes, J. E. (2002). Stand by me: The risks and rewards of mentoring today’s youth. Cambridge: Harvard University Press.
Rhodes, J. E. (2005). A theoretical model of youth mentoring. In D. L. DuBois & M. A. Karcher (Eds.), Handbook of youth mentoring (pp. 30–43). Thousand Oakes: Sage Press.
Rhodes, J. E., Bogat, G. A., Roffman, J., Edelman, P., & Galasso, L. (2002). Youth mentoring in perspective: Introduction to special issue. American Journal of Community Psychology, 30, 149–155.
Rhodes, J. E., Spencer, R., Keller, T. E., Liang, B., & Noam, G. (2006). A model for the influence of mentoring relationships on youth development. Journal of Community Psychology, 34(6), 691–707.
Tolan, P. H. (2002). Crime prevention: Focus on youth. In J. Q. Wilson & J. Petersilia (Eds.), Crime (pp. 109–128). Oakland: Institute for Contemporary Studies Press.
Tolan, P. H., & Brown, C. H. (1998). Methods for evaluating intervention and prevention efforts. In. P. K. Trickett & C. Schellenbach (Eds.), Violence against children in the family and the community (pp. 439–464). Washington, DC: American Psychological Association.
Tolan, P.H., & Gorman-Smith, D. (2003). What violence prevention can tell us about developmental psychopathology. Developmental and Psychopathology
Tolan, P. H., & Guerra, N. G. (1994). What works in reducing adolescent violence: An empirical review of the field. Boulder: University of Colorado, Center for the Study and Prevention of Youth Violence.
Viechtbauer W (2010). Metafor: Meta-Analysis Package for R. R package version 1.4-0. http://CRAN.R-project.org/package=metafor.
Wilson, S.J., & Lipsey, M.J. (2007). Effectiveness of school-based intervention programs on aggressive behavior: Update of a meta-analysis. American Journal of Preventive Medicine, 33(Suppl. 2), S130–S143.
Wilson, D. B., Gottfredson, D. C., & Najaka, S. S. (2001). School-based prevention of problem behaviors: A meta-analysis. Journal of Quantitative Criminology, 17(3), 247–272.
References for studies included in systematic review
Abbott, D. A., Meredith, W. H., Self-Kelly, R., & Davis, M. E. (1997). The influence of a Big brothers program on the adjustment of boys in single-parent families. Journal of Psychology, 131, 143–156.
Aiello, H. S. (1988). Assessment of a mentor program on self-concept and achievement variables of middle school underachievers. (Doctoral dissertation, Virginia Polytechnic Institute and State University, 1988). Dissertation Abstracts International, 49(07), 1699A.
Anderson, P. S. (1977). Volunteers in criminal justice: A three-year evaluation of the Clark County, Washington program. Vancouver: Health and Welfare Planning Council.
Aseltine, R. H., Dupre, M., & Lamlein, P. (2000). Mentoring as a drug prevention strategy: An evaluation of across ages. Adolescent and Family Health, 1(1), 11–20.
Barnoski, R. (2002). Preliminary findings for the juvenile rehabilitation administration’s mentoring program. Olympia: Washington State Institute for Public Policy. WSIPP Doc # 02-07-1202.
Berger, R. J., & Gold, M. (1978). An evaluation of a juvenile court volunteer program. Journal of Community Psychology, 6, 328–333.
Bernstein, L., Rappaport, C., Olsho, L., Hunt, D. & Levin, M. (2009) Impact evaluation of the US Department of Education’s student mentoring program. National Center for educational evaluation and regional assistance
Blechman, E. A., Maurice, A., Buecker, B., & Helberg, C. (2000). Can mentoring or skill training reduce recidivism? Observational study with propensity analysis. Prevention Science, 1(3), 139–155.
Brooks, L. J. (1995). An evaluation of the VCU mentoring program (Doctoral dissertation, Virginia commonwealth university, 1995). Dissertation Abstracts International, 57(04), 1481A.
Buman, B., & Cain, R. (1991). The impact of short term, work oriented mentoring on the employability of low-income youth. Minneapolis: Minneapolis Employment and Training Program. Available from Minneapolis Employment and Training Program, 510 Public Service Center, 250 S. 4th St., Minneapolis, MN 55415.
Cavell, T. A., & Hughes, J. N. (2000). Secondary prevention as context for assessing change processes in aggressive children. School Psychology, 38(3), 199–235.
Clarke, L. (2009). Effects of a school-based adult mentoring intervention on low income, urban high school freshman judged to be at risk for drop out: a replication and extension. New Jersey: PhD Dissertation, The State University of New Jersey, United States.
Converse, N., & Lignugaris, K. B. (2009). Evaluation of a school-based mentoring program for at-risk middle school youth. Remedial and special education, 30.
Davidson, W. S., II. (1976). The diversion of juvenile delinquents: An examination of the processes and relative efficacy of childhood advocacy and behavioral contracting. (Doctoral dissertation, University of Illinois at Urbana-Champaign, 1976). Dissertation Abstracts International, 37(01), 601. University Microfilms No. AAT 7616113.
Davidson, W. S., II, & Redner, R. (1988b). Prevention of juvenile delinquency: Diversion from the juvenile justice system. In R. H. Price, E. L. Cowen, R. P. Lorion, & J. Ramos-McKay (Eds.), Fourteen ounces of prevention: A casebook for practitioners (pp. 123–137). Washington, D.C.: American Psychological Association.
Davidson, W. S., II, Amdur, R. L., Mitchell, C. M., & Redner, R. (1990). Alternative treatments for troubled youth: The case of diversion from the justice system. New York: Plenum Press.
Davidson, W. S., Seidman, E., Rappaport, J., Berck, P. L., Rapp, N. A., Rhodes, W., & Herring, J. (1977). Diversion program for juvenile offenders. Social Work Research and Abstracts, 13(2), 40–49.
Davidson, W. S., & Redner, R. (1988c). The prevention of juvenile delinquency: Diversion from the juvenile justice system. In R. H. Price, E. L. Cowen, R. P. Lorion, & J. Ramos-McKay (Eds.), Fourteen ounces of prevention: Theory, research, and prevention (pp. 123–137). Washington D.C: American Psychological Association.
Davis, H. (1988). A mentor program to assist in increasing academic achievement and attendance of at-risk ninth grade students (Doctoral dissertation, University of Pittsburgh, 1988). Dissertation Abstracts International, 50(03), 0580A.
Dicken, C., Bryson, R., & Kass, N. (1977). Companionship therapy: A replication of experimental community psychology. Journal of Consulting and Clinical Psychology, 45(4), 637–646.
Flaherty, B. P. (1985). An experiment in mentoring for high school students assigned to basic courses. (Doctoral dissertation, Boston University, 1985). Dissertation Abstracts International, 46(02), 0352A.
Fo, W. S. O., & O’Donnell, C. R. (1972). The buddy system model: Community-based delinquency prevention utilizing indigenous nonprofessionals as behavior change agents. Washington: Department of Health, Education & Welfare Office of Education. ERIC Document Reproduction Service No. 074–394.
Fo, W. S. O., & O’Donnell, C. R. (1979). The buddy system: Relationship and contingency conditions in a community intervention program for youth with nonprofessionals as behavior change agents. In J. S. Stumphauzer (Ed.), Progress in behavior therapy with delinquents (pp. 302–316). Springfield: Charles C. Thomas.
Fo, W. S. O., & O’Donnell, C. R. (1975). The buddy system: Effect of community intervention on delinquent offenses. Behavior Therapy, 6, 522–524.
Grant, C. (2010). Grounded in your culture: The hidden key to promoting academic achievement among African American adolescent males. Minneapolis: PhD Dissertation Capella University, United States.
Grossman, J. B., & Tierney, J. P. (1998b). Does mentoring work? An impact study of the Big Brothers Big Sisters Program. Evaluation Review, 22(3), 403–426.
Grossman, J. B., & Rhodes, J. E. (2002). The test of time: Predictors and effects of duration in youth mentoring relationships. American Journal of Community Psychology, 30(2), 199–219.
Hanlon, T. E., Bateman, R. W., Simon, B. D., O’Grady, K. E., & Carswell, S. B. (2002). An early community-based intervention for the prevention of substance abuse and other delinquent behavior. Journal of Youth and Adolescence, 31(6), 459–471.
Harmon, M. A. (1995). Reducing drug use among pregnant and parenting teens: A program evaluation and theoretical examination. (Doctoral dissertation, University of Maryland at College Park, 1995). Dissertation Abstracts International, 56(08), 3319A.
Hayes, G. L. (1998). An evaluation of a staff mentor program for at-risk students in an Oregon high school: CAKE (Caring About Kids Effectively). (Doctoral dissertation, Portland State University, 1998). Dissertation Abstracts International, 59(05), 1517A.
Herrera, C., Grossman, J., Kaugh, T., Feldman, A., & McMaken, J. (2007). Making a difference in schools: The big brothers big sisters school based mentoring impact study. Philadelphia: Public/Private Ventures.
Holt, L., Bry, B., & Johnson, V. (2008). Enhancing school engagement in at-risk, urban minority adolescents through a school-based, adult mentoring intervention. Child & Family Behavior Therapy, 30(4), 297–318.
Johnson, A. W. (1997). Mentoring at-risk youth: A research review and evaluation of the impacts of the Sponsor-A-Scholar Program on student performance (Doctoral dissertation, University of Pennsylvania, 1997). Dissertation Abstracts International, 58(03), 813A.
Karcher, M. (2008). The study of mentoring in the learning environment (SMILE): A randomized evaluation of the effectiveness of school-based mentoring. Prevention Science, 9, 99–113.
Keating, L. M. (1996). Mentorship as prevention of juvenile delinquency (Doctoral dissertation, California School of Professional Psychology, San Diego, 1996). Dissertation Abstracts International, 57(04), 2869. University Microfilms No. AAT 9626966.
Keating, L. M., Tomishima, M. A., Foster, S., & Alessandri, M. (2002). The effects of a mentoring program on at-risk youth. Adolescence, 37(148), 717–734.
Kelley, T. M. (1973). I. Student volunteer effectiveness in a delinquency prevention experiment. II. Validation of a selection device for volunteer probation officers. (Doctoral dissertation, Wayne State University, 1972). Dissertation Abstracts International, 33(11), 140.
Kelley, T. M., Kiyak, H. A., & Blak, R. A. (1979). The effectiveness of college student companion therapists with predelinquent youths. Journal of Police Science and Administration, 7(7), 186–195.
Kemple, J. J., & Scott-Clayton, J. (2004). Career academies: Impacts on labor market outcomes and educational attainment. New York: Manpower Demonstration Research Corporation.
Ku, R., & Blew, C. H. (1977). A University’s approach to delinquency prevention: The adolescent diversion project: An exemplary project. Rockville: National Institute of Justice. NCJRS Document Reproduction Service No. 38510.
Lattimore, C. B., Mihalic, S. F., Grotpeter, J. K., & Taggart, R. (1998). Blueprints for violence prevention, book four: The quantum opportunities program. Boulder: Center for the Study and Prevention of Violence.
LoSciuto, L., Rajala, A. K., Townsend, T. N., & Taylor, A. S. (1996). An outcome evaluation of across ages: An intergenerational mentoring approach to drug prevention. Journal of Adolescent Research, 11(1), 116–129.
Maxfield, M., Schirm, A., & Rodriguez-Planas, N. (2003). The quantum opportunity program demonstration: Implementation and short-term impacts. MPR Reference No. 8279–093. Washington: Mathematica Policy Research, Inc.
McCord, J. (1978b). A thirty-year follow-up of treatment effects. American Psychologist, 33(3), 284–289.
McCord, J. (1979b). Following up on Cambridge-Somerville: Response to Paul Wortman. American Psychologist, 34(8), 727.
Moore, R. H., & Levine, D. (1974). Evaluation research of a community-based probation program. Lincoln: University of Nebraska at Lincoln, Department of Psychology. ERIC Document Reproduction Service No. 132497.
Moore, R. H. (1987). Effectiveness of citizen volunteers functioning as counselors for high-risk young male offenders. Psychological Reports, 61, 823–830.
Newton, F. R. (1994). A study of the effectiveness of using collegiate mentors to reduce violent behavior, improve self concept, and increase academic success in an urban middle school (at risk). (Doctoral dissertation, The College of William and Mary, 1994). Dissertation Abstracts International, 55(06-A), 1440.
O’Donnell, C. R., Lydgate, T., & Fo, W. S. O. (1979b). The buddy system: Review and follow-Up. Child Behavior Therapy, 1(2), 161–169.
Polit, D., Kahn, J., & Stevens, D. (1985). Final impacts from project redirection: A program for pregnant and parenting teens. New York: Manpower Demonstration Research Corporation.
Quint, J. (1991). Project redirection: Making and measuring a difference. Evaluation and Program Planning, 14, 75–86.
Reyes, O., & Jason, L. A. (1991). An evaluation of a high school dropout prevention program. Journal of Community Psychology, 19, 221–230.
Rhodes, J., Grossman, J., & Resch, N. (2000). Agents of change: Pathways through which mentoring relationships influence adolescents’ academic adjustment. Child Development, 71(6), 1662–1671.
Rowland, R. G. (1992). An evaluation of the effects of a mentoring program on at-risk students in selected elementary schools in the north east independent school district. (Doctoral dissertation, Texas A&M University, 1991). Dissertation Abstracts International, 53(1), 0039A.
Royse, D. (1998). Mentoring high-risk minority youth: Evaluation of the brothers project. Adolescence, 33(129), 145–158.
Schinke, S. P., Cole, K. C., & Poulin, S. R. (2000). Enhancing the educational achievement of at-risk youth. Prevention Science, 1(1), 51–60.
Seidman, E., Rappaport, J., & Davidson, W. S., II. (1980). Adolescents in legal jeopardy: Initial success and replication of an alternative to the criminal justice system. In R. R. Ross & P. Gendreau (Eds.), Effective correctional treatment (pp. 103–123). Toronto: Butterworth.
Taylor, A. S., LoSciuto, L., Fox, M., Hilbert, S. M., & Sonkowsky, M. (1999). The mentoring factor: Evaluation of the Across Ages’ intergenerational approach to drug abuse prevention. In V. S. Kuehne (Ed.), Intergenerational programs: Understanding what we have created (pp. 77–99). New York: Haworth Press.
Taylor, A. S., LoSciuto, L., Fox, M., Hilbert, S. M., & Sonkowsky, M. (1990). The mentoring factor: Evaluation of the across ages’ intergenerational approach to drug abuse prevention. Child Youth Services, 20(1/2), 77–99.
Watson, S. H. (1996). A study on the effects of four different types of mentoring plans using retired community individuals and college students as mentors on Hispanic “at risk” students’ grades and attendance (Master’s thesis, Stephen F. Austin State University, 1996). Masters Abstracts International, 35(05), 1133.
Author information
Authors and Affiliations
Corresponding author
Additional information
This report is based on a Campbell Collaboration systematic review. A more extensive report including the coding protocol and summary information on the included and excluded studies can be found there (http://www.campbellcollaboration.org/lib/project/48/). This includes tables summarizing components and findings of all included studies.
Rights and permissions
About this article
Cite this article
Tolan, P.H., Henry, D.B., Schoeny, M.S. et al. Mentoring programs to affect delinquency and associated outcomes of youth at risk: A comprehensive meta-analytic review . J Exp Criminol 10, 179–206 (2014). https://doi.org/10.1007/s11292-013-9181-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11292-013-9181-4