Introduction

Pervasive developmental disorder not otherwise specified (PDD NOS) is a subthreshold diagnosis within autism spectrum disorder (ASD) that does not fulfill the full set of criteria for autistic disorder (AD). AD is a strictly defined category with pervasive problems in terms of communication, social relatedness, and stereotyped or repetitive behaviors (American Psychiatric Association 2000). PDD NOS is used as a residual category for individuals with a broader autism phenotype. During the last decade, several studies have questioned the adequacy of the current PDD NOS category (Allen et al. 2001; Buitelaar et al. 1999; Volkmar et al. 2009; Walker et al. 2004). In some studies, children with PDD NOS have been found to have less restrictive and repetitive behaviors than children with autism, but the literature so far has been unable to clearly differentiate children with PDD NOS from children with AD (Allen et al. 2001; Buitelaar et al. 1999; Walker et al. 2004). Distinctions have been reported to be inconsistent and associated with language level and cognitive ability rather than with autistic symptoms (American Psychiatric Association 2010).

In the new revision of DSM (DSM-V), PDD NOS together with AD, Asperger’s disorder, and childhood disintegrative disorder have been suggested to be subsumed under a single diagnostic category, described dimensionally, because of inconsistencies between ASD subgroups (American Psychiatric Association 2010).

Predictive validity can be an important aspect of the clinical utility of a diagnostic category (First et al. 2004; Volkmar et al. 2009). If individuals with PDD NOS have the same prognosis and outcome as individuals with AD, this would support the assumption of an artificial diagnostic distinction. Knowledge of the prognosis and outcome for individuals with PDD NOS is however, scarce, whereas, the outcome for AD is well known. In both clinical (Cederlund et al. 2007; Howlin et al. 2000, 2004; Larsen and Mouridsen 1997) and population-based studies (Billstedt et al. 2005; Gillberg and Steffenburg 1987; von Knorring and Hagglof 1993), about two-thirds of the individuals diagnosed with AD fare poorly in employment, education, independent living and peer relations.

Only one study has described adult outcome for individuals with PDD NOS defined according to the current DSM-IV criteria (Hofvander et al. 2009). In this study, Hofvander et al. reported poor psychosocial outcome for 50 individuals with PDD NOS, five individuals with AD, and 67 individuals with Asperger’s disorder, all of whom were outpatients with normal intelligence. Only 40% were employed and 84% had never lived in a long-term relationship at follow-up (median age 29 years). However, outcome comparisons between ASD subgroups were not reported. In a previous study, Billstedt et al. (2005) studied 78 individuals with AD and 42 individuals with autistic-like conditions (according to DSM-III-R) in a population-based follow-up study (mean age 25.5 years at follow-up). They found that, regardless of subgroups, 78% of the participants had a poor overall outcome with an obvious severe handicap. However, because only 18% of the population had intellectual levels above 70, the results could not be extrapolated to individuals with intellectual levels in the upper range. In an early population-based study of 46 children suffering from either infantile autism or other childhood psychoses (OP), Gillberg and Steffenburg (1987) reported that 59% had a poor outcome in early adulthood, with a tendency toward better outcome in the infantile autism group. Interpretation of the results in this study is, however, difficult because of the heterogeneity of the OP group and their associated handicaps.

The aim of the present study was to compare adult outcome of individuals with PDD NOS and individuals with AD, diagnosed according to DSM-IV. We wanted to explore whether vulnerability factors other than ASD subdiagnoses enhanced the prediction of outcome.

Methods

Study Population

The study population consisted of 113 inpatients with ASD. They were all part of a larger study population consisting of all consecutively admitted inpatients (n = 550) to the children’s unit at the National Centre for Child and Adolescent Psychiatry in Oslo (NCCAP), Norway, from the opening of the children’s unit in January 1968–October 1988. Specialized child psychiatric services were not available all over Norway during this period, especially not in sparsely populated areas. Children with long-lasting, complex or rare disorders were referred to the hospital from all over the country for assessment and inpatient treatment when local outpatient clinics were short of professional expertise. Many children were admitted as inpatients for practical reasons, because NCCAP was located far from their homes. The children’s unit at NCCAP provided specialized treatment for children up to 13 years of age. The institution did not have an emergency unit and none of these children were in acute crisis when they were hospitalized.

The hospital records for each individual provided baseline information and detailed descriptions of symptoms, psychological test results, school performance and extensive anamnestic information about the children and their families.

The gender distribution in the ASD group studied was 23 (20%) girls and 90 (80%) boys. The mean age at admission was 7.1 years (SD 2. 6, range 3–13 years), with no gender differences. Fifty-six (50%) of the patients were admitted to the family ward, 53 (47%) to the inpatient long-term ward, and four (3%) to the day care ward. The mean length of stay was 1.3 months (SD 1.6) in the family ward, 12.7 months (SD 18.6) in the inpatient long-term ward, and 35.5 months (SD 17.6) at the day care ward. Thirty-three percent of the patients were admitted more than once. The mean age at follow-up (excluding those who had emigrated or died) was 36.6 years (SD 7.1, range 22–48 years) and the mean follow-up period was 29.5 years (SD 6.5, range 17–38 years). By follow-up, three (3%) individuals in the study population had died and three (3%) had emigrated.

Outcome Variables

The participants were identified by personal identification number in the population register at the Central Bureau of Statistics at follow-up in December 2005. Rates of mortality and criminality were obtained from the Cause of Death Registry and the Criminal Records Registry. Information on marital status and disability pension award was obtained from Statistics Norway’s events database FD–Trygd (which includes demographic details and information from the Norwegian Labour and Welfare Organisation) at follow-up in December 2005. All citizens of Norway are eligible after 18 years of age (age 16 until January 1st 1998) to be granted a disability pension award for an acknowledged medical condition that causes more than 50% lasting reduction in work capacity. The right to a disability pension award is not means tested and no prior work participation is required. It is solely a public responsibility, and, as in most northern European countries, it is a fairly generous welfare scheme compared with those in many other countries.

The Norwegian Labour and Welfare Organisation records information on all disability pension awards. Correct registration is a prerequisite for transfers of payments and the records are thus highly accurate. Findings reported in the Criminal Records Register were based on court convictions for infractions of all breaches of the law. All the registers were complete, valid and up to date.

Measures

Diagnostic Classification (DSM-IV)

Based on chart review, the 550 inpatients were rediagnosed according to the current DSM-IV criteria, independent of diagnosis at admission. The children admitted represented a broad variety of child psychiatric disorders. Of the 550 inpatients, 113 children fulfilled the DSM-IV criteria for either AD, Asperger’s disorder (AS) or PDD NOS. They constituted the group studied in this paper.

Using hospital records, the patients were rediagnosed by the first author and independently by at least one other experienced child psychiatrist. If two raters disagreed, consensus diagnoses were set by a research group of four child psychiatrists (including one expert in the field of autism).

Sociodemographic Variables

Gender and age were registered at baseline. We also applied a global assessment of Chronic Family Difficulties (CFD) based on all the information available in the hospital records concerning the patients’ past and present family situations (Vandvik et al. 1989). Socioeconomic conditions, social network, marital or family discord and current/previous physical and mental health of the family members were recorded. The total burden of difficulties was scored on an interval scale from 0 to 6. A score of 0 reflects no sign of chronic family difficulties and a score of 6 reflects severe difficulties/very disturbed family environment.

Intellectual Level

An assessment of each participant’s intellectual level was based on all the information available in the hospital records, including clinical findings, psychometric test results (in some cases standardized intelligence tests, such as the Wechsler Intelligence Scale for Children (WISC), the Standford–Binet Intelligence Scales, or the Leiter International Performance Scale) and pedagogic tests (such as the Illinois Test of Psycholinguistic Abilities (ITPA) and the Peabody Picture Vocabulary Test) administered during hospitalization. Teachers at NCCAP’s affiliated school performed systematic pedagogic evaluations for school-age children.

Diagnostic criteria for level of mental retardation were used according to DSM-IV. Because previous research has shown that having an IQ of at least 70 is a crucial prognostic factor (Howlin et al. 2004), intellectual level was dichotomized in terms of mental retardation (MR) yes/no which correspond to the approximate cut-off for IQ scores that were either greater or less than 70. In three cases (3%), there was not enough information in the records to assess intellectual level and thus the corresponding data were recorded as missing.

Organic Brain Dysfunction

Organic brain dysfunction was registered if neuroanatomical pathology was documented in the medical record (e.g., diagnoses of cerebral palsy, hemiparesis or organic brain dysfunction given by neurologists) or if there was focal epileptogen activity on the EEG.

Children’s Global Assessment Scale (CGAS)

Based on chart review, the children’s CGAS scores were assigned by the raters. The CGAS is a widely used clinician rated scale assigning a single summary score to describe psychosocial functioning (Bird et al. 1996; Shaffer et al. 1983). The instrument is validated against many different psychiatric assessment scales (Winters et al. 2005), and validity is good at distinguishing cases from no cases (Bird et al. 1987, 1990). The scale runs from 1 to 100, with 1 indicating the most severely disordered child and 100 the best-functioning child. The assessment was based on the child’s functioning at the time of admission, as described in the hospital records. Because no children were admitted to the hospital due to an acute crisis situation, the ratings reflect the child’s long-term problems.

Interrater Study

An interrater reliability study was carried out for 476 individuals in the initial study population, yielding an overall kappa value of 0.77 for Axis 1 diagnoses and a kappa of 0.89 for differentiating ASD from non-ASD patients (ASD subtyping was based on consensus). For 96 of the 113 ASD individuals, the CGAS intraclass correlation coefficient (ICC) was 0.62. In five cases, the discrepancy between raters was more than 12 points. When these cases were excluded, the interrater reliability was considered satisfactory with an ICC of 0.73. The interrater reliability was very good for CFD with ICC of 0.82 and ICC of 0.88 for intellectual level.

Statistical Methods

Descriptive statistics are presented as means with standard deviations, medians and ranges, as appropriate. Variables were examined using Student’s two-sample t test for continuous variables, and Pearson’s chi-square test and Fisher’s exact test for categorical variables. Binary logistic regression analyses were used to analyze the risk of disability pension awards. The youngest age for registration of disability pension awards in Norway was 16 years of age during the study period (age 18 since January 1st 1998). Those individuals who died or emigrated before the age of 16 (n = 3) were excluded from the estimates of disability, marital status and conviction rates, as well as from the binary logistic regression analyses. The effects of possible prognostic variables for disability pension award were tested using univariate binary logistic regression analysis. CGAS and CFD were continuous variables, whereas, intellectual function and comorbid brain dysfunction were dichotomized. Variables with p < 0.250 in the univariate analyses were included in a multivariate logistic regression analysis. The least significant factors were excluded one by one until the remaining factor(s) were significant at the p = 0.05 level. Results are presented as odds ratios (OR) with corresponding 95% confidence intervals (CI). The Hosmer and Lemeshow goodness of fit test was used to evaluate final models. The study group was compared with the average Norwegian population in 2005, using Table statistics (StatBank Norway 2005).

SPSS version 15 was used for the statistical analyses.

Ethics

The study was approved by the Regional Committee of Ethics in Medical Research, the Department of Health and Social Services, and the Norwegian Data Inspectorate.

Results

ASD Subgroups

AD was diagnosed in 74 (65%) children according to DSM-IV, of whom 11 (10%) children who met the criteria for AS were included.

PDD NOS was diagnosed in 39 individuals (35%) who either did not fully meet the DSM-IV criteria for AD or whose symptom onset occurred after 3 years of age. Characteristics of the AD and PDD NOS groups are given in Table 1.

Table 1 Characteristics of AD and PDD NOS groups at admission

General Adult Outcome in AD and PDD NOS Groups

Rates of disability pension award, marital status, convictions and mortality in AD and PDD NOS groups are shown in Table 2.

Table 2 Rates of disability pension award, marital status, criminality and mortality in AD group and PDD NOS group at follow-up in 2005 with 95% confidence interval (CI)

Disability Pension Award

At follow-up, 91 persons (83%) in the ASD group had received a disability pension award. There was a significantly higher rate of disability in the AD group compared with the PDD NOS group (89% vs. 72%, p < 0.05; Table 2), but the disability rate in both groups was markedly increased relative to the same age groups in the general population, where a crude estimate was 5% (The Norwegian Labour and Welfare Administration 2005). The mean age when the disability pension was awarded was 17.1 years (SD 3.9, range 16–40 years), with no significant difference between the AD and PDD NOS groups. By 22 years of age, 87 of 91 (96%) individuals had been awarded a disability pension. Of the four registered later, two were in the AD group and two in the PDD NOS group.

Marital Status

Almost all in the ASD population were unmarried at follow-up, with no difference between AD and PDD NOS groups (99% vs. 92%, ns; Table 2), compared with about 50% in the general population (StatBank Norway 2005).

Convictions

Two (3%) individuals with AD and five (13%) individuals with PDD NOS had been convicted at follow-up (p = 0.10; Table 2). The overall crime rate (n = 7.6%) in the ASD group was a little more than half of the occurrence in the general population (10%) (Kjelsberg and Dahl 1998; Skardhamar 2010). The offenders were all men, and they had been convicted for different kinds of offences e.g., interpersonal aggression and threats, crimes against property, and drug violations.

Mortality

One male with AD (2%) and one male (3%) with PDD NOS had died by the time of follow-up (p > 0.05), compared with 2% in the general male population, adjusted for age (http://www.ssb.no). Among 23 ASD females, one AD female (4%) had died by follow-up, compared with 1% in the general female population, adjusted for age (StatBank Norway 2005).

Predictors of Disability Pension Award

Disability pension award was the only outcome measure in this study that was significantly different between the AD and PDD NOS groups (Table 2). Using binary logistic regression analyses, we examined the associations between subsequent disability pension award and AD and PDD NOS, and variables we wanted to adjust for: gender, MR, CFD, organic brain disorder and CGAS, in 110 individuals, none of whom died or emigrated before the age of 16 (Table 3).

Table 3 Prevalence of vulnerability factors and OR estimates by univariate logistic regression of the study population of those who received (N = 91) and those who did not receive (N = 19) disability pension award (DP) at follow-up in 2005

The results of the univariate binary logistic regression analyses showed that four variables (PDD NOS, CGAS, MR and CFD) had significance levels below 0.250, and they were all entered into a multivariate logistic regression. Only one variable remained significant in the final model: CGAS (OR 0.8, 95% CI = 0.7–0.9, p < 0.001). Because CGAS and level of intellectual functioning represented overlapping constructs (Pearson’s correlation 0.54, p < 0.001), separate analyses were performed without CGAS. Main vulnerability factor for disability pension then was MR (data not shown). Because we chose to include those with AS (n = 11) in the AD group, we also ran separate logistic analyses with the AS group excluded. CGAS still remained the only significant factor in the final model (p < 0.001, data not shown).

Discussion

In the present study, we found small differences in adult outcome between individuals with AD and individuals with PDD NOS. The overall adult outcome in both AD and PDD NOS groups was poor, with excessively increased disability rates in both groups relative to the general population, and with almost all individuals being unmarried at follow-up. There were no elevated mortality or conviction rates in either group. Disability pension award was the only outcome measure that differed between the diagnostic subgroups, and that was explained by difference in psychosocial functioning (CGAS) rather than by diagnostic category.

Disability Pension Award and Marital Status

Eighty-three percent of the individuals in this study received disability pension awards, and 95% were unmarried at follow-up. This is consistent with previous studies showing poor prognosis in ASD individuals (Billstedt et al. 2005; Gillberg and Steffenburg 1987; Cederlund et al. 2007; Hofvander et al. 2009; Howlin et al. 2000, 2004; von Knorring and Hagglof 1993). In our study, 35% of the ASD individuals were diagnosed with PDD NOS. Despite a lower symptom load in this group, we found a markedly elevated rate of disability pension awards, and a substantial majority was unmarried also in this group. Our findings are in line with two previous studies that reported similar severe handicaps in adults with PDD NOS/autistic-like conditions, in which few individuals were living normal social lives and functioning well at work (Billstedt et al. 2005; Hofvander et al. 2009). Hofvander et al. reported a somewhat better prognosis for their participants than for ours or Billstedt’s, but this is probably attributable to the normal-range intellectual level of their individuals. In our study, 33% of the patients were in the upper intellectual range compared with only 18% in the Billstedt study, but the prognosis was similar, with a poor outcome in almost 80% of the cases in both studies. However, comparisons must only be tentative. In our study, outcome was based on marital status, disability pension award, mortality and convictions as measures for prognosis. Billstedt et al. used the more graded outcome criteria published by Lotter (Lotter 1974).

Predictors of Disability Pension Award

Childhood intellectual level and language function before age 6 years have been reported to be the most important predictors of outcome in ASD individuals (Baghdadli et al. 2007; Billstedt et al. 2005; Howlin et al. 2004; Kobayashi et al. 1992; Szatmari et al. 2003). In the present study, disability pension award was the outcome measure providing most information about adult outcome. Interestingly, our results indicated that low psychosocial function (CGAS) at admission seemed to be more associated with disability pension award at follow-up than intellectual level. These factors are obviously interacting, but the results suggest that assessment of CGAS, in addition to intellectual level, provide useful information about outcome. Because CGAS is a global measure, it also measures adaptive capacity, which is one of the most impaired functions in individuals with ASD. Thus, this instrument may capture important information relevant to prognosis that intellectual level as a prognostic factor may miss. In ASD populations known to be difficult to test and where precise IQ scores may be unreliable, assessing CGAS may be especially useful. However, few previous studies have used CGAS as a predictor of outcome (DeMaso et al. 1995; Gold et al. 1993; Sourander et al. 1996), and less research has been conducted on the measurement of functional impairment than on psychiatric disorders (Szatmari 2009). Szatmari and colleagues (Szatmari et al. 2002) have claimed that the severity of symptoms and level of functioning are two phenotypic dimensions that do not always correlate. CGAS incorporates both these dimensions in one global assessment and could therefore be useful as an additional tool when estimating outcome in individuals with ASD.

We found that AD was no more associated with disability pension award than was PDD NOS when we adjusted for intellectual level and CGAS. This is in line with research conducted by Billstedt et al. (2005), in which AD and other ASD subgroups with similar intellectual levels were equally predictive of a poor outcome. Because our findings indicate that outcome seem to depend more on level of functioning than degree of autistic symptoms, our findings support a dimensional model of ASD as proposed in the DSM-V revision (American Psychiatric Association 2010).

Previous research has paid little attention to whether contextual variables predict later outcome in ASD individuals (Seltzer et al. 2004). We found no association between chronic family difficulties and subsequent disability pension at follow-up, nor did we find any gender differences. This is consistent with Howlin’s findings (1997), who reported that the effects of family factors and gender were unclear. However, mapping contextual factors that promote or impede development in ASD individuals should be emphasized in future research. The prevalence of ASD has increased markedly within the last decades (Fombonne 2005), and many people will need the support of their families and society in the future. With regard to gender, reported studies have often suffered from small female samples (Billstedt et al. 2005; Gillberg and Steffenburg 1987; Howlin 1997; Piven et al. 1996), and future research must use larger female populations to draw conclusions about gender differences.

Convictions

Only seven individuals in our ASD population were convicted of crimes. The low conviction rate is in line with the results of Mouridsen et al. (2007), who found that former child psychiatric inpatients with ASD had about half the conviction rate of a matched control group. However, five out of seven convicted patients in our sample belonged to the PDD NOS group, and recent studies have found that there are differences in criminal behavior between subgroups of people with ASD (Mouridsen et al. 2007; Siponmaa et al. 2001). The tentative, but not statistically significant, difference we found in our study may have been caused by the different intellectual and functional levels between the groups, but a definitive answer awaits future research on larger populations.

Mortality

The mortality rate among males (2%) in our study must be regarded with caution because of the small numbers, but it did not seem to be high in either the AD group or the PDD NOS group. Previous research has found that persons with ASD tend to have an increased mortality risk (Gillberg et al. 2010; Mouridsen et al. 2008; Shavelle et al. 2001), regardless of ASD subtypes (Gillberg et al. 2010). However, research on mortality in ASD populations is limited, and the representativeness of study populations has been unclear. In our study, only 14% of the individuals had a comorbid organic brain disorder at baseline, which contrasts with a study by Gillberg et al. (2010) in which a large proportion of the participants had additional specific medical disorders.

With one female (4%) from a small female population registered dead at follow-up, we cannot conclude anything about female mortality, but our findings do not contradict recent research in which female gender were associated with an increased risk of early death (Mouridsen et al. 2008; Shavelle et al. 2001).

Strengths and Limitations

The present study has several strengths. We have examined a large group of patients. It is a nation-wide study, and no regional admission bias should be in force. The follow-up period is long relative to that used in most other studies. Rediagnosis and scoring of the study population was completed before the outcome information was collected, and thus scoring was performed blind to outcome. The reliance on four experienced clinicians (one expert in the field of autism) to make consensus best-estimate diagnoses ensured that the diagnosis of PDD NOS was applied as accurately as possible. The outcomes are based on high-quality national registers.

The present study also has some general limitations that must be considered when interpreting the results. Follow-up studies of clinical samples will always have problems with representativeness of such samples. This study is based on inpatient admissions only, and the study population may not be representative of child psychiatric patients in general. However, the NCCAP was a national institution and patients were referred from all over Norway. During the period we examined, fewer children were seen at local clinics and individuals with suspected pervasive developmental disorders were often admitted as inpatients. These factors make our population less selective than would have been the case today. Because our ASD population was identified by chart review, according to current DSM-IV criteria, and not upon the criteria at the time of admission, we also ensured that children representing the broader spectrum of autism disorders than strictly defined AD were included.

All information was based on chart review from hospital records, which are not reliable scientific sources of information in all aspects. File-based information should always be interpreted with caution. However, the hospital records were of good quality, giving a detailed and thorough description of the patients’ symptoms and behavior, psychometric test results and family functioning. All the records were read independently by at least two clinicians, and the rediagnosis and scoring of the data were completed by experienced psychiatrists. We conducted an extensive interrater reliability study, and the interrater reliability was high for the diagnoses. This is consistent with previous research in which validity of file-based diagnostic ratings has been satisfactory (Grann et al. 1998; McKenzie et al. 2011).

Unfortunately, standardized IQ instruments were not systematically used during hospitalization. To mitigate this problem, we reassessed the cognitive level according to DSM-IV criteria for level of mental retardation. The interrater reliability for the cognitive level assessments was very good, reflecting the detailed information about cognitive attainment in the records.

We also found the CGAS and CFD scale scores to be reasonably reliable between raters, in line with previous research (Aasland et al. 1997; Bird et al. 1987; Flato et al. 1997). The detailed medical histories in the hospital records largely compensated for the lack of direct observations of the children and their families.

The outcome measures were derived from register data, and prognosis was based on disability pension award, marital status, convictions and mortality. We did not use the Lotter (1974) outcome criteria (“good”, “fair”, “restricted” and “poor”) that are most often used in other studies, so comparisons must be done with caution and prognoses should only be tentative. The outcome measures we used, however, were robust official register data, and they were not influenced by the investigators.

Factors identified in this study are probably not causative factors, but rather they are markers of vulnerability factors that increase the risk of disability pension award within an ASD population, and they should be interpreted as such.

Finally, if the proposed DSM-V criteria are accepted, this study compares outcome differences in diagnostic groups that would no longer exist. However, we believe our study still adds information about the long-term outcome of ASD individuals, while supporting the future dimensional approach.

Conclusions

In summary, the results of this study of a large group of ASD individuals that we followed into adulthood suggest that the overall outcome is poor regardless of ASD subgroups. The results did not indicate substantial differences between individuals with autistic disorder and those with pervasive developmental disorders not otherwise specified. Prognosis was associated with psychosocial function and intellectual level rather than ASD subcategories, and thus our findings support a dimensional description of ASD individuals that is in line with proposed DSM-V revision. Our findings also indicate that a simultaneous consideration of symptom severity and functional impairment, implemented in the Children Global Assessment Scale (CGAS), could enhance the prediction of outcome.