Abstract
This paper explores the relative importance of social factors and health measures in predicting educational achievement in early and late adolescence using population-based administrative data. The sample was made up of 41,943 children born in Manitoba, Canada between 1982 and 1989 and remaining in the province until age 18. Multilevel modeling nests each individual (level 1) within a family (level 2) residing within a neighborhood (level 3). Most important in predicting adolescent achievement were a broad socioeconomic status index (and a narrower measure of household income), being on social assistance, mother’s age at first birth, gender, residential mobility, the presence of ADHD/Conduct disorders, and measures of family functioning (child taken into care or offered protection services and family structure history). Family size, birth order, and newborn characteristics (birthweight, APGAR, gestational age) were statistically significant but of little importance in explaining the outcomes. Both examining regression coefficients and systematically omitting variables showed social factors (often emphasized by epidemiologists) to have markedly greater effects than the combination of health measures (often stressed by economists) in predicting achievement. However, mental health in childhood is identified as among the important predictors. Record linkage across population datasets from health, education, and family services ministries allowed: tracking health and educational attainment at different times in a child’s life, following a large number of cases across childhood, considerable sensitivity testing, controlling for unmeasured family and neighborhood effects, generating an extensive list of predictors, estimating effect sizes, and comparing Manitoba results with those of well-known American studies.
Similar content being viewed by others
Notes
The data and methods are described in more detail in the Extended Appendix to Currie et al. (2010). Material updated to reflect the additional years of information used in this paper is available on request from the corresponding author.
Linear modeling was carried out using PROC MIXED in Unix SAS Version 9. The REML (Restricted Maximum Likelihood) method was used to estimate variance–covariance parameters.
Other statistics on model fit produced very similar results. These data, as well as the relevant intercepts and intraclass correlation coefficients, are available from the corresponding author.
A Ramsey RESET (regression) test for misspecification (which deals with both omitted variables and incorrect functional form) was significant at the .01 level for the large Manitoba sample (Grade 12 index) but showed only minimal improvement in fit (from .325 to .329) (Ramsey, 1969). Such a finding of bias is quite common (Clarke 2005) and ours seems relatively small. Similar tests were not available for the American and UK studies.
“Systems’ conditions include “respiratory, alimentary, heart, haematological, urogenital, central nervous system, epilepsy.” “These condition are too rare in the NCDS cohort to analyze their impacts separately for each chronic illness.” Case et al. (2005), p. 368.
Manitoba analyses have eliminated intellectually disabled children; ‘mental retardation’ and ‘psychoses’ are among the codes used. As noted in the working paper (http://www.wws.prineton.edu/chw/research/papers.php), such children are included in the UK analysis. In addition, the UK children (in 1958) were likely to be less healthy than their more recent Canadian comparison group.
References
Adam, E. K., & Chase-Lansdale, P. L. (2002). Home sweet home(s): Parental separations, residential moves, and adjustment problems in low-income adolescent girls. Developmental Psychology, 38(5), 792–805.
Annett, R. D., Aylward, E. H., Lapidus, J., Bender, B. G., & DuHamel, T. (2000). Neurocognitive functioning in children with mild and moderate asthma in the childhood asthma management program. The childhood asthma management program (CAMP) research group. Journal of Allergy and Clinical Immunology, 105(4), 717–724.
Atherton, K., Fuller, E., Shepherd, P., Strachan, D. P., & Power, C. (2008). Loss and representativeness in a biomedical survey at age 45 years, 1958 British birth cohort. Journal of Epidemiology and Community Health, 62(3), 216–223.
Bauman, L. J., Silver, E. J., & Stein, R. E. (2006). Cumulative social disadvantage and child health. Pediatrics, 117(4), 1321–1328.
Berkman, L. F. (2009). Social epidemiology: Social determinants of health in the United States: Are we losing ground? Annual Review of Public Health, 30, 27–41.
Bickel, R. (2007). Multilevel analysis for applied research: It’s just regression. New York, NY: Guilford Press.
Bjorklund, A., Jantti, M., & Solon, G. (2005) Influences of nature and nurture on earnings variation: A report on a study of various sibling types in Sweden. In S. Bowles, H. Gintis, & M. Osborne Groves (Eds.), Unequal chances: Family background and economic success (pp. 145–164). Princeton, NJ: Princeton University Press.
Bonnie, R. J., Fulco, C. E., & Liverman, C. T. (Eds.). (1999). Reducing the burden of injury. Washington, DC: Institute of Medicine.
Breen, R., & Jonsson, J. O. (2005). Inequality of opportunity in comparative perspective: Recent research on educational attainment and social mobility. Annual Review of Sociology, 31, 223–243.
Brook, E., Rosman, D. L., & Holman, C. D. (2008). Public resource through data linkage: Measuring research outputs from the Western Australia data linkage system. Australian and New Zealand Journal of Public Health, 32(1), 19–23.
Case, A., Fertig, A., & Paxson, C. (2005). The lasting impact of childhood health and circumstance. Journal of Health Economics, 24(2), 365–389.
Clarke, K. A. (2005). The phantom menace: Omitted variable bias in econometric research. Conflict Management and Peace Science, 22, 341–352.
Conley, D., Pfeiffer, K. M., & Velez, M. (2007). Explaining sibling differences in achievement and behavioral outcomes: The importance of within- and between-family factors. Social Science Research, 36(3), 1087–1104.
Currie, J. (2009). Healthy, wealthy, and wise: Socioeconomic status, poor health in childhood, and human capital development. Journal of Economic Literature, 47(1), 87–122.
Currie, J., Stabile, M., Manivong, P., & Roos, L. L. (2010). Child health and young adult outcomes. Journal of Human Resources, 45(3), 517–548.
Dong, M., Anda, R. F., Felitti, V. J., Williamson, D. F., Dube, S. R., Brown, D. W., et al. (2005). Childhood residential mobility and multiple health risks during adolescence and adulthood: The hidden role of adverse childhood experiences. Archives of Pediatrics and Adolescent Medicine, 159(12), 1104–1110.
Duncan, G., Dowsett, C., Claessens, A., Magnuson, K., Hustonb, A., Klebanov, P., et al. (2006). School readiness and later achievement. Northwestern University working paper.
Evans, G. W., & Kim, P. (2010). Multiple risk exposure as a potential explanatory mechanism for the socioeconomic status-health gradient. Annals the New York Academy of Sciences, 1186, 174–189.
Fomby, P., & Cherlin, A. (2007). Family instability and child well-being. American Sociological Review, 72(2), 181–204.
Furstenberg, F. F., Cook, T. D., Eccles, J., Elder, G. H., Jr., & Sameroff, A. (1999). Managing to make it: Urban families and adolescent success. Chicago, IL: University of Chicago Press.
Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models. New York, NY: Cambridge University Press.
Gilbert, S. F., & Epel, D. (2009). Ecological developmental biology; integrating epigenetics, medicine, and evolution (pp. 245–286). Sunderland, MA: Sinauer Associates Inc.
Ginther, D., & Pollak, R. A. (2004). Family structure and children’s educational outcomes: Blended families, stylized facts, and descriptive regressions. Demography, 41(4), 671–696.
Glied, S. (2001). The value of reductions in child injury mortality in the U.S. In D. Cutler & E. Berndt (Eds.), Medical care output and productivity. Chicago, IL: University of Chicago Press.
Golobardes, B., Lynch, J. W., & Smith, G. D. (2008). Is the association between childhood socioeconomic circumstances and cause-specific mortality established? Update of a systematic review. Journal of Epidemiology and Community Health, 62, 387–390.
Gutstadt, L. B., Gillette, J. W., Mrazek, D. A., Fukuhara, J. T., LaBrecque, J. F., & Strunk, R. C. (1989). Determinants of school performance in children with chronic asthma. American Journal of Diseases in Children, 143(4), 471–475.
Haas, S. A., & Fosse, N. E. (2008). Health and the educational attainment of adolescents: Evidence from the NLSY97. Journal of Health and Social Behavior, 49(2), 178–192.
Hango, D. W. (2006). The long-term effect of childhood residential mobility on educational attainment. The Sociological Quarterly, 47(4), 631–664.
Haveman, R., & Wolfe, B. (1994). Succeeding generations: On the effects of investments in children. New York, NY: Russell Sage Foundation.
Hertzman, C., & Power, C. (2003). Health and human development: Understandings from life-course research. Developmental Neuropsychology, 24(2–3), 719–744.
Hertzman, C., & Williams, R. (2009). Making early childhood count. Canadian Medical Association Journal, 180(1), 68–71.
Hotz, V. J., McElroy, S. W., & Sanders, S. G. (1996). The costs and consequences of teenage childbearing for mothers and government. Chicago Policy Review, 1, 55–94.
House, J. S., Schoeni, R. F., Kaplan, G. A., & Pollack, H. (2008). The health effects of social and economic policy: The promise and challenge for research and policy. In R. F. Schoeni, J. S. House, G. A. Kaplan, & H. Pollack (Eds.), Making Americans healthier: Social and economic policy as health policy. New York, NY: Russell Sage Foundation.
Hox, J. J. (2002). Multilevel analysis: Techniques and applications. Mahwah, NJ: Lawrence Erlbaum Associates.
Jackson, M. I. (2009). Understanding links between adolescent health and educational attainment. Demography, 46(4), 671–694.
Jonsson, J. O. (2010). Child well-being and intergenerational inequality. Child Indicators Research, 3, 1–10.
Jutte, D. P., Brownell, M., Roos, N. P., Schippers, C., Boyce, W. T., & Syme, S. L. (2010a). Rethinking what is important: Biologic versus social predictors of childhood health and educational outcomes. Epidemiology, 21(3), 314–323.
Jutte, D. P., Roos, L. L., & Brownell, M. (2011). Administrative record linkage as a tool for public health research. Annual Review of Public Health, 32, 91–108.
Jutte, D. P., Roos, N. P., Brownell, M., Briggs, G., MacWilliam, L., & Roos, L. L. (2010b). The ripples of adolescent motherhood: Social, educational and medical outcomes for children of teen and prior teen moms. Academic Pediatrics, 10(5), 293–301.
Kohler, R. E. (1994). Lords of the fly. Chicago, IL: University of Chicago Press.
Kreft, I. G., & de Leeuw, J. (1998). Introducing multilevel modeling. Thousand Oaks, CA: Sage Publications Inc.
Krieger, N., Zierler, S., Hogan, J. W., Waterman, P., Chen, J., Lemieux, K., et al. (2003). Geocoding and measurement of neighborhood socioeconomic position: A U.S. perspective. In I. Kawachi & L. F. Berkman (Eds.), Neighborhoods and health (pp. 147–178). New York, NY: Oxford University Press.
Ladouceur, M., Leslie, W. D., Dastani, Z., Goltzman, D., & Richards, J. B. (2010). An efficient paradigm for genetic epidemiology cohort creation. PLoS One, 5(11), e14045.
Lahey, B. B., & D’Onofrio, B. M. (2010). All in the family: Comparing siblings to test casual hypotheses regarding environmental influences on behavior. Current Directions in Psychological Science, 19(5), 319–323.
Levine, J. A., Pollack, H., & Comfort, M. E. (2001). Academic and behavioral outcomes among the children of young mothers. Journal of Marriage and Family, 63(2), 355–369.
Lynch, J., & Davey Smith, G. (2005). A life course approach to chronic disease epidemiology. Annual Review of Public Health, 26, 1–35.
Ma, X., Ma, L., & Bradley, K. D. (2008). Using multilevel modeling to investigate school effects. In A. A. O’Connell & D. B. McCoach (Eds.), Multilevel modeling of educational data (pp. 59–110). Charlotte, NC: Information Age Publishing Inc.
Manor, O., Matthews, S., & Power, C. (2003). Health selection: The role of inter- and intra-generational mobility on social inequalities in health. Social Science and Medicine, 57(11), 2217–2227.
Marmot, M. (1999). Introduction. In M. Marmot & R. G. Wilkinson (Eds.), Social determinants of health (pp. 1–16). Oxford, UK: Oxford University Press.
Martens, P. J., Derksen, S., & Gupta, S. (2004). Predictors of hospital readmission of Manitoba newborns within six weeks postbirth discharge: A population-based study. Pediatrics, 114(3), 708–713.
Martens, P. J., Frohlich, N., Carriere, K. C., Derksen, S., & Brownell, M. (2002). Embedding child health within a framework of regional health: Population health status and sociodemographic indicators. Canadian Journal of Public Health, 93(2 Suppl), S15–S20.
Mayer, S. E. (1997). Introduction. In What money can’t buy: Family income and children’s life chances (pp. 1–15). Cambridge, MA: Harvard University Press.
Mayer, S. E. (2002). The influence of parental income on children’s outcomes. Wellington, New Zealand: Knowledge Management Group, Ministry of Social Development.
Mazumder, B. (2005). The apple falls even closer to the tree than we thought: New and revised estimates of the intergenerational inheritance of earnings. In S. Bowles, H. Gintis, & M. Osborne Groves (Eds.), Unequal chances: Family background and economic success (pp. 80–99). Princeton, NJ: Princeton University Press.
Mazumder, B. (2008). Sibling similarities and economic inequality in the US. Journal of Population Economics, 21(3), 685–701.
McLanahan, S., & Sandefur, G. (1994). Growing up with a single parent: What hurts, what helps. Cambridge, MA: Harvard University Press.
Moffitt, R. (2005). Remarks on the analysis of causal relationships in population research. Demography, 42(1), 91–108.
Mosteller, F., & Tukey, J. W. (Eds.). (1977). Data analysis and regression.A second course in statistics. Reading, MA: Addison-Wesley.
Mustard, C. A., Derksen, S., Berthelot, J. M., & Wolfson, M. C. (1999). Assessing ecologic proxies for household income: A comparison of household and neighborhood-level income measures in the study of population health status. Health and Place, 5(2), 157–171.
Mustard, C. A., & Roos, N. P. (1994). The relationship of prenatal care and pregnancy complications to birthweight in Winnipeg, Canada. American Journal of Public Health, 84(9), 1450–1457.
Oreopoulos, P. (2008). Neighbourhood effects in Canada: A critique. Canadian Public Policy, 34(2), 237–258.
Oreopoulos, P., & Salvanes, K. G. (2009). How large are returns to schooling? Hint: Money isn’t everything. NBER working paper No. 15339.
Oreopoulos, P., Stabile, M., Walld, R., & Roos, L. L. (2008). Short, medium, and long term consequences of poor infant health: An analysis using siblings and twins. Journal of Human Resources, 43(1), 88–138.
Pianta, R. C., & Early, D. (2001). Turnover in kindergarten classroom membership in a national sample. Early Education and Development, 12(2), 239–252.
Powe, N. R., Weiner, J., Starfield, B., Stuart, M. E., Baker, A., & Steinwachs, D. (1998). Systemwide performance in a Medicaid program: Profiling the care of patients with chronic illness. Medical Care, 34(8), 798–810.
Raferty, A. E. (1995). Bayesian model selection in social research. Sociological Methodology, 25, 111–164.
Ramsey, J. B. (1969). Tests for specification errors in classical linear least-squares regression analysis. Journal of the Royal Statistical Society: Series B, 31(2), 350–371.
Raudenbush, S. W. (2008). Many small groups. In J. de Leeuw & E. Meijer (Eds.), Handbook of multilevel analysis (pp. 207–236). New York, NY: Springer.
Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage Publications Inc.
Ray, G. T., Croen, L. A., & Habel, L. A. (2009). Mothers of children diagnosed with attention-deficit/hyperactivity disorder: Health conditions and medical care utilization in periods before and after birth of the child. Medical Care, 47(1), 105–114.
Reid, R. J., MacWilliam, L., Verhulst, L., Roos, N. P., & Aitkinson, M. (2001). Performance of the ACG case-mix system in two Canadian provinces. Medical Care, 39(1), 86–99.
Reid, R. J., Roos, N. P., MacWilliam, L., Frohlich, N., & Black, C. (2002). Assessing population health care needs using a claims based ACG morbidity measure: A validation exercise in the Province of Manitoba. Health Services Research, 37(5), 1345–1364.
Roos, L. L., Brownell, M., Lix, L., Roos, N. P., Walld, R., & MacWilliam, L. (2008). From health research to social research: Privacy, methods, approaches. Social Science and Medicine, 66(1), 117–129.
Roos, L. L., Menec, V., & Currie, R. J. (2004). Policy analysis in an information-rich environment. Social Science and Medicine, 58(11), 2231–2341.
Roos, L. L., & Nicol, J. P. (1999). A research registry: Uses, development, and accuracy. Journal of Clinical Epidemiology, 52(1), 39–47.
Roos, N. P., Roos, L. L., Brownell, M., & Fuller, E. L. (2010). Enhancing policy makers’ understanding of disparities: Relevant data from an information-rich environment. Milbank Quarterly, 88(3), 382–403.
Roos, L. L., Soodeen, R., Bond, R., & Burchill, C. (2003). Working more productively: Tools for administrative data. Health Services Research, 38(5), 1339–1357.
Sastry, N., & Pebley, A. R. (2010). Family and neighborhood sources of socioeconomic inequality in children’s achievement. Demography, 47(3), 777–800.
Sewell, W., & Hauser, R. M. (1975). Education, occupation and earnings. New York: Academic Press.
Shanahan, M., & Gousseau, C. (1999). Using the POPULIS framework for interprovincial comparisons of expenditures on health care. Medical Care, 37(6 Suppl), JS83–JS100.
Silberg, J. L., Maes, H., & Eaves, L. J. (2010). Genetic and environmental influences on the transmission of parental depression to children’s depression and conduct disturbance: An extended Children of Twins study. Journal of Child Psychology and Psychiatry, 51(6), 734–744.
Simpson, L. A., Peterson, L., Lannon, C. M., Murphy, S. B., Goodman, C., Ren, Z., et al. (2010). Special challenges in comparative effectiveness research on children’s and adolescents’ health. Health Affairs, 29(10), 1849–1856.
Smith, J. P. (2007). The impact of socioeconomic status on health over the life course. Journal of Human Resources, 42(4), 739–764.
Smith, J. P. (2009). The impact of childhood health on adult labor market outcomes. The Review of Economics and Statistics, 91(3), 478–489.
Snijders, T. A. B., & Bosker, R. J. (1999). Multilevel analysis: An introduction to basic and advanced multilevel modeling. London: Sage Publications Inc.
Statistics Canada. (2010). Measuring up: Canadian results of the OECD PISA study “The performance of Canada’s youth in reading, mathematics, and science: 2009 first results for Canadians aged 15” (81-590-X2010001), Ottawa: Statistics Canada.
Strohschein, L., Roos, N. P., & Brownell, M. (2009). Family structure histories and high school completion: Evidence from a population based registry. Canadian Journal of Sociology, 34(1), 83–103.
Syme, S. L. (2008). Reducing racial and social-class inequalities in health: The need for a new approach. Health Affairs (Millwood), 27(2), 456–459.
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Boston, MA: Allyn and Bacon.
The Johns Hopkins University. (2010). The Johns Hopkins ACG case-mix system (version 8 release notes) [computer software]. Baltimore, MD: The Johns Hopkins University Bloomberg School of Public Health and Development Centre.
UNICEF. (2007). Child poverty in perspective: An overview of child well-being in rich countries. Innocenti report card 7, Florence, IT: UNICEF Innocenti Research Centre.
U.S. Environmental Protection Agency, Indoor Environments Division Office of Air and Radiation. (2006). Asthma Facts. Rep. No. EPA 402-F-04-019.
Weiner, J., Dobson, A., Maxwell, S., Coleman, K., Starfield, B., & Anderson, G. (1996). Risk-adjusted Medicare capitation rates using ambulatory and inpatient diagnoses. Health Care Financing Review, 17(3), 77–99.
Weiner, J., Starfield, B., & Lieberman, R. N. (1992). Johns Hopkins ambulatory care groups (ACGs): A case mix system for UR, QA, and capitation adjustment. HMO Practice, 6(1), 13–19.
Weiner, J., Starfield, B., Steinwachs, D., & Mumford, L. (1991). Development and application of a population-oriented measure of Ambulatory care case-mix. Medical Care, 29(5), 452–472.
Williams, D. R., McClellan, M. B., & Rivlin, A. M. (2010). Beyond the affordable care act: Achieving real improvements in Americans’ health. Health Affairs, 29(8), 1481–1488.
Willms, J. D. (1986). Social class segregation and its relationship to pupils’ examination results in Scotland. American Sociological Review, 51(2), 224–241.
Willms, J. D. (2004). Variation in literacy skills among Canadian provinces: Findings from the OECD PISA. Ottawa, ON: Statistics Canada.
Acknowledgments
We are grateful to many individuals for making this research possible: Heather Hunter, John Van Walleghem, Richard Perrault, Carol Crerar, Jean Britton, Ken Clark, Irene Huggins, Allyson Matczuk and Shirley McLellan from Manitoba Education, Louis Barre and Deborah Malazdrewicz from Manitoba Health, Jan Forster, Harvey Stevens (now retired), Linda Burnside, Charlene Paquin, Joy Cramer, Kathy Reid, Margaret Ferniuk, Elin Ibrahim, Tracy Lewis and Kim Hucko from Manitoba Family Services and Consumer Affairs. This research has been funded by the Social Sciences and Humanities Research Council (Manitoba Health Project Number 2007/2008—20C), the Canadian Institutes for Health Research, the Lupina Foundation, and the Canadian Institute for Advanced Research. The results and conclusions presented are those of the authors. No official endorsement by the ministries involved is intended or should be inferred. The authors thank Shannon Lussier and Theresa Daniuk for manuscript preparation.
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix 1: Intellectual Disability
We removed children who ever had a diagnosis of mental retardation from the sample. We looked for children in the Ministry of Education data with a “special needs” flag, identified by the variables ‘MH’ = ‘Multiple Handicaps’, ‘AUT’ = ‘Autism’, or ‘ASD’ = ‘Autism Spectrum Disorder’. Hospital and physician visit data for at least one of the following diagnoses at some time during the child’s childhood years (up to age 14) were also considered (ICD-9-CM codes): ‘317—Mild Mental Retardation (MR)’, ‘318—Other MR’ ‘319—Unspecified MR’, ‘299—Psychoses’, ‘758—Downs and related’, ‘759—Fragile X, Prader-W’, and ‘760—FAS’. With hospital coding moving to ICD-10 (in April 2004), additional codes (from the hospital data) were used to flag mental retardation: ‘F70—Mild mental retardation’, ‘F71—Moderate mental retardation’, ‘F72— Severe mental retardation’, ‘F73—Profound mental retardation’, ‘F74’, ‘F75’, ‘F76’,’F77’, ‘F78—Other mental retardation’, and ‘F79—Unspecified mental retardation’.
Appendix 2: Neighborhood of Residence
Our main analyses assigned neighborhood of residence to children in each family on the basis of the oldest sibling’s residence at age 17. Residential changes were bracketed by reassigning family neighborhood and income based on residence (1986 census enumeration area) at the time of the youngest sibling’s birth. Neighborhood environments were generally persistent, but 26.5% of the families did change neighborhood between the time of the oldest sibling’s turning 17 and the time of the youngest sibling’s birth. Household income for the relevant census area (rather than SEFI) had to be used for further comparison. SEFI was not available for 1986 while 1986 Winnipeg census enumeration areas (N = 757) were larger than the dissemination areas (N = 1,183) used subsequently by Statistics Canada. These size differences probably contributed to the differing level 3 variances in the null model: 0.17 in the ‘oldest child at age 17’ model versus 0.12 in the ‘youngest child at birth’ model. A considerable pattern of available variance was explained by mean neighborhood household income in the full model (87.7% ‘for oldest child’ versus 88.4% ‘for youngest child’).
Appendix 3: Index Validation
Validation was approached in two ways. First of all, the score on the index of Grade 9 achievement can be compared with the Grade 12 achievement scores (Winnipeg sample) (Table 6). Correlations among indices ranged from .694 to .746 (Winnipeg sample) (Table 7). The Grade 9 index scores correspond reasonably closely to the average scores on the Grade 12 measure. These achievement scores can be further assessed in terms of a student’s probability of high school graduation within 5 years (Roos et al. 2008).
Rights and permissions
About this article
Cite this article
Roos, L.L., Hiebert, B., Manivong, P. et al. What is Most Important: Social Factors, Health Selection, and Adolescent Educational Achievement. Soc Indic Res 110, 385–414 (2013). https://doi.org/10.1007/s11205-011-9936-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11205-011-9936-0