Skip to main content
Log in

Quantifying Narrative Ability in Autism Spectrum Disorder: A Computational Linguistic Analysis of Narrative Coherence

  • Original Paper
  • Published:
Journal of Autism and Developmental Disorders Aims and scope Submit manuscript

Abstract

Autism is a neurodevelopmental disorder characterized by serious difficulties with the social use of language, along with impaired social functioning and ritualistic/repetitive behaviors (American Psychiatric Association in Diagnostic and statistical manual of mental disorders: DSM-5, 5th edn. American Psychiatric Association, Arlington, 2013). While substantial heterogeneity exists in symptom expression, impairments in language discourse skills, including narrative (or storytelling), are universally observed in autism (Tager-Flusberg et al. in Handbook on autism and pervasive developmental disorders, 3rd edn. Wiley, New York, pp 335–364, 2005). This study applied a computational linguistic tool, Latent Semantic Analysis (LSA), to objectively characterize narrative performance in high-functioning individuals with autism and typically-developing controls, across two different narrative contexts that differ in the interpersonal and cognitive demands placed on the narrator. Results indicated that high-functioning individuals with autism produced narratives comparable in semantic content to those produced by controls when narrating from a picture book, but produced narratives diminished in semantic quality in a more demanding narrative recall task. This pattern is similar to that detected from analyses of hand-coded picture book narratives in prior research, and extends findings to an additional narrative context that proves particularly challenging for individuals with autism. Results are discussed in terms of the utility of LSA as a quantitative, objective, and efficient measure of narrative ability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Almasy, L., & Blangero, J. (2001). Endophenotypes as quantitative risk factors for psychiatric disease: Rationale and study design. American Journal of Medical Genetics, 105, 42–44.

    Article  PubMed  Google Scholar 

  • American Psychiatric Association. (1994). Diagnostic and Statistical Manual of Mental Disorders (DSM-IV) (4th ed.). Washington, DC: American Psychiatric Association.

    Google Scholar 

  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders: DSM-5 (5th ed.). Arlington, VA: American Psychiatric Association.

    Google Scholar 

  • Asperger, H. (1991). ‘Autistic psychopathy’ in childhood (U. Frith, Trans.). In U. Frith (Ed.), Autism and Asperger syndrome. London: Cambridge University Press.

  • Black, M., Katsamanis, A., Lee, C.-C., Lammert, A. C., Baucom, B. R., Christensen, A., et al. (2010). Automatic classification of married couples’ behavior using audio features. In 11th annual conference of the International Speech Communication Association 2010 (Interspeech 2010) (Vols. 3, 4, pp. 2030–2033).

  • Bruner, J. (1986). Acutal minds, possible worlds. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Bruner, J. (1990). Acts of meaning. Cambridge: Harvard University Press.

    Google Scholar 

  • Bruner, J., & Feldman, C. (1993). Theories of mind and the problem of autism. In S. Baron-Cohen, H. Tager-Flusberg, & D. J. Cohen (Eds.), Understanding other minds: Perspectives from autism. New York: Oxford University Press.

    Google Scholar 

  • Capps, L., Kehres, J., & Sigman, M. (1998). Conversational abilities among children with autism and developmental delay. Autism, 2, 325–344.

    Article  Google Scholar 

  • Capps, L., Losh, M., & Thurber, C. (2000). The frog ate a bug and made his mouth sad: Narrative competence in children with autism. Journal of Abnormal Child Psychology, 28, 193–204.

    Article  PubMed  Google Scholar 

  • Dennis, M., Jacennik, B., & Barnes, M. A. (1994). The content of narrative discourse in children and adolescents after early-onset hydrocephalus and in normally developing age peers. Brain and Language, 46(1), 129–165. doi:10.1006/brln.1994.1008.

    Article  PubMed  Google Scholar 

  • Diehl, J. J., Bennetto, L., & Young, E. C. (2006). Story recall and narrative coherence of high-functioning children with autism spectrum disorders. Journal of Abnormal Child Psychology, 34(1), 83–98.

    Article  Google Scholar 

  • Elvevag, B., Foltz, P. W., Weinberger, D. R., & Goldberg, T. E. (2007). Quantifying incoherence in speech: An automated methodology and novel application to schizophrenia. Schizophrenia Research, 93(1–3), 304–316. doi:10.1016/j.schres.2007.03.001.

    Article  PubMed Central  PubMed  Google Scholar 

  • Firth, J. R. (1957). Papers in linguistics. Oxford: Oxford University Press.

    Google Scholar 

  • Foltz, P. W., Kintsch, W., & Landauer, T. K. (1998). The measurement of textual coherence with latent semantic analysis. Discourse Processes, 25, 285–307.

    Article  Google Scholar 

  • Franzke, M., Kintsch, E., Caccamise, D., Johnson, N., & Dooley, S. (2005). Summary Street®: Computer support for comprehension and writing. Journal of Educational Computing Research, 33(1), 304–316.

    Article  Google Scholar 

  • Gallese, V., & Goldman, A. (1999). Mirror neurons and the simulation theory of mind-reading. Trends in Cognitive Science, 2, 493–500.

    Article  Google Scholar 

  • Georgiou, P. G., Black, M. P., & Narayanan, S. S. (2011). Behavioral signal processing for understanding (distressed) dyadic interactions: Some recent developments. Paper presented at the third international workshop on social signal processing (SSPW’11), ACM Multimedia’11, Scottsdale, AZ.

  • Goldman, S. (2008). Brief report: Narratives of personal events in children with autism and developmental language disorders: Unshared memories. Journal of Autism and Developmental Disorders, 38(10), 1982–1988. doi:10.1007/s10803-008-0588-0.

    Article  PubMed  Google Scholar 

  • Gottesman, I. I., & Gould, T. D. (2003). The endophenotype concept in psychiatry: Etymology and strategic intentions. American Journal of Psychiatry, 160(4), 636–645.

    Article  PubMed  Google Scholar 

  • Grandin, T. (1995). Thinking in pictures. New York: Doubleday.

    Google Scholar 

  • Jurgens, D., & Stevens, K. (2010). The S-Space package: An open source package for word space models. Paper presented at the proceedings of the ACL 2010 systems demonstrations, Uppsala, Sweden.

  • Kanner, L. (1943). Autistic disturbances of affective contact. The Nervous Child, 2, 217–250.

    Google Scholar 

  • Kintsch, W. (2002). The potential of latent semantic analysis for machine grading of clinical case summaries. Journal Biomedical Informatics, 35(1), 3–7.

    Article  Google Scholar 

  • Landauer, T. K., & Dumais, S. T. (1997). A solution to Plato’s problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104(2), 211–240.

    Article  Google Scholar 

  • Landauer, T. K., McNamara, D. S., Dennis, S., & Kintsch, W. (Eds.). (2007). Handbook of latent semantic analysis. Mahwah, NJ: Lawrence Erlbaum.

    Google Scholar 

  • Ledoux, K., Camblin, C. C., Swaab, T. Y., & Gordon, P. C. (2006). Reading words in discourse: The modulation of lexical priming effects by message-level context. Behavioral and Cognitive Neuroscience Reviews, 5, 107–127.

    Article  PubMed Central  PubMed  Google Scholar 

  • Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P., et al. (2000). The Autism Diagnostic Observation Schedule-Generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30, 205–223.

    Article  PubMed  Google Scholar 

  • Lord, C., Rutter, M., & Le Couteur, A. (1994). Autism Diagnostic Interview-Revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism and Developmental Disorders, 24(5), 659–685.

    Article  PubMed  Google Scholar 

  • Losh, M., & Capps, L. (2003). Narrative ability in high-functioning children with autism or Asperger’s syndrome. Journal of Autism and Developmental Disorders, 33(3), 239–251.

    Article  PubMed  Google Scholar 

  • Losh, M., & Capps, L. (2006). Understanding of emotional experience in autism: Insights from the personal accounts of high-functioning children with autism. Developmental Psychology, 42(5), 809–818.

    Article  PubMed  Google Scholar 

  • Loveland, K. A., McEvoy, R. E., & Tunali, B. (1990). Narrative story telling in autism and Down’s syndrome. British Journal of Developmental Psychology, 8, 9–23.

    Article  Google Scholar 

  • Loveland, K. A., & Tunali, B. (1993). Narrative language in autism and the theory of mind hypothesis: A wider perspective. In S. Baron-Cohen, H. Tager-Flusberg, & D. J. Cohen (Eds.), Understanding other minds: Perspectives from autism. Oxford: Oxford University Press.

    Google Scholar 

  • MacWhinney, B. (2007). The TalkBank Project. In J. C. Beal, K. P. Corrigan, & H. L. Moisl (Eds.), Creating and digitizing language corpora: Synchronic databases (Vol. 1). Houndmills: Palgrave-Macmillan.

    Google Scholar 

  • Mayer, M. (1969). Frog, where are you?. New York: Dial Press.

    Google Scholar 

  • Metallinou, A., Lee, S., Narayanan, S., & IEEE. (2010, March 14–19). Decision level combination of multiple modalities for recognition and analysis of emotional expression. Paper presented at the 2010 IEEE international conference on acoustics, speech, and signal processing, Dallas, TX.

  • Opie, I. A., & Opie, P. (1974). The classic fairy tales. London: Oxford University Press.

    Google Scholar 

  • Paul, R., Orlovski, S. M., Marcinko, H. C., & Volkmar, F. (2009). Conversational behaviors in youth with high-functioning ASD and asperger syndrome. Journal of Autism and Developmental Disorders, 39, 115–125.

    Article  PubMed Central  PubMed  Google Scholar 

  • Reichow, B., Salamack, S., Paul, R., Volkmar, F. R., & Klin, A. (2008). Pragmatic assessment in Autism Spectrum Disorders: A comparison of a standard measure with parent report. Communication Disorders Quarterly, 29(3), 169–176. doi:10.1177/1525740108318697.

    Article  PubMed Central  PubMed  Google Scholar 

  • Simmons, R., Gordon, P. C., & Chambless, D. (2005). Pronoun use in marital interaction: What do “you” and “I” say about marital health? Psychological Science, 16, 932–936.

    Article  PubMed  Google Scholar 

  • Sykes, N. H., & Lamb, J. A. (2007). Autism: The quest for the genes. Expert Reviews in Molecular Medicine, 9(24), 1–15.

    Article  PubMed  Google Scholar 

  • Tager-Flusberg, H. (2000). Understanding the language and communicative impairments in autism. International Review of Research in Mental Retardation, 23, 185–205.

    Article  Google Scholar 

  • Tager-Flusberg, H. (2005). Designing studies to investigate the relationships between genes, environments, and developmental language disorders. Applied Psycholinguistics, 26, 29–39.

    Article  Google Scholar 

  • Tager-Flusberg, H., & Anderson, M. (1991). The development of contingent discourse ability in autistic children. Journal of Child Psychology and Psychiatry, 32, 1123–1134.

    Article  PubMed  Google Scholar 

  • Tager-Flusberg, H., & Caronna, E. (2007). Language disorders: Autism and other pervasive developmental disorders. Pediatric Clinics of North America, 54(3), 469–481. doi:10.1016/j.pcl.2007.02.011.

    Article  PubMed  Google Scholar 

  • Tager-Flusberg, H., Paul, R., & Lord, C. (2005). Language and communication in autism. In F. Volkmar, R. Paul, & A. Klin (Eds.), Handbook on autism and pervasive developmental disorders (3rd ed., pp. 335–364). New York: Wiley.

    Google Scholar 

  • Tager-Flusberg, H., & Sullivan, K. (1995). Attributing mental states to story characters: A comparison of narratives produced by autistic and mentally retarded individuals. Applied Psycholinguistics, 16(3), 241–256.

    Article  Google Scholar 

  • Turney, P. D., & Pantel, P. (2010). From frequency to meaning: Vector space models of semantics. Journal of Artificial Intelligence Research, 37, 141–188.

    Google Scholar 

  • Volden, J., Coolican, J., Garon, N., White, J., & Bryson, S. (2009). Brief report: Pragmatic language in autism spectrum disorder: Relationships to measures of ability and disability. Journal of Autism and Developmental Disorders, 39(2), 388–393. doi:10.1007/s10803-008-0618-y.

    Article  PubMed  Google Scholar 

  • Wechsler, D. (2003). Manual for the Wechsler Intelligence Scale for Children—Fourth edition. San Antonio: The Psychological Corporation.

    Google Scholar 

  • Williams, J. (1978). The practical princess and other liberating fairy tales. New York: Parents’ Magazine Press.

    Google Scholar 

Download references

Acknowledgments

We wish to acknowledge Patrick Plummer for his assistance with the preparation of transcripts for computational linguistic analysis. This work was supported by the National Science Foundation (BCS-0820394) and the National Institute of Deafness and other communication Disorders (1R01DC010191-01A1).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Molly Losh.

Appendix

Appendix

Frog Prince Story (Opie and Opie 1974)

Once upon a time there was a princess. She went one day to play at the pond. She took her golden ball with her, which was her favorite toy. She played with the ball at the pond, until-oops-the ball fell in the water. She began to cry, and said, “Oh dear, I would give anything to have my lovely ball back again!” Suddenly a frog stuck his head out of the water and said, “Why are you crying?” The princess said, “What use are you, you nasty frog? My ball has fallen into the pond.” The frog said, “I will get your ball for you, if you will be my friend and let me live with you and eat from your plate and sleep on your bed.” “What nonsense,” the princess thought, “He will never be able to get out of the pond, but I will promise what he asks because perhaps he can get my ball back.” So she said to the frog, “If you will get my ball for me I will do all the things you ask.” So the frog dived into the water, picked up the ball with his mouth, and threw it on the ground in front of the princess. When she saw it, she was so happy that she ran off home without thinking of the kind frog. Next day the princess heard a knock just as she was having her dinner. She opened the door and there was the frog! The princess did not like the frog but she remembered her promise. The frog said, “Let me come in and sit near you, and eat your dinner with you.” So the frog ate dinner with the princess. After they had eaten, the frog said, “Carry me upstairs and put me on your bed.” And the princess did what he asked, even though she still thought he was a wet and nasty frog. She secretly hoped that he would be gone when she woke up. But the next morning she was amazed to find that the frog was gone. Instead there was the most handsome prince she had ever seen. He told her that a bad fairy had changed him into a frog until he could find a princess who would be his friend and let him eat with her and sleep on her bed. And the prince and the princess were married and lived happily ever after.

Practical Princess Story (Williams 1978)

Princess Bedelia was as lovely as the moon shining upon a lake full of water lilies. She was as graceful as a cat leaping. And she was also extremely practical. When she was born, three fairies had come to her cradle to give her gifts. The first fairy had given her beauty. The second had given her grace. But the third, who was a wise old creature, had said, “I give her common sense.” “I don’t think much of that gift,” said King Ludwig, raising his eyebrows, “What good is common sense to a princess? All she needs is charm.” Nevertheless, when Bedelia was eighteen, something happened which made the king change his mind. A dragon moved into the neighborhood. He settled in a dark cave on top of a mountain. He sent a message to the king. “I must have a princess to devour,” the message said, “or I shall breathe out my fiery breath and destroy the kingdom.” Sadly, King Ludwig called together his councilors and read them the message. “Perhaps,” said the Prime Minister, “we had better advertise for a knight to slay the dragon. That is what is generally done in these cases.” “I’m afraid we haven’t time,” answered the king. “The dragon has only given us until tomorrow morning. There is no help for it. We shall have to send him the princess.” Princess Bedelia had come to the meeting because, as she said, she liked to mind her own business and this was certainly her business. “Rubbish!” she said, “Dragons can’t tell the difference between princesses and anyone else. Use your common sense. He’s just asking for me because he’s a snob.” “That may be so,” said her father, “but if we don’t send you along, he’ll destroy the kingdom.” Bedelia said, “I see 1’11 have to deal with this myself!” She left the council chamber. She got the largest and gaudiest of her state robes and stuffed it with straw, and tied it together with string. She packed 100 pounds of gunpowder into the center of the bundle. She got a strong young man to carry it up the mountain for her. She stood in front of the dragon’s cave and called. “Come out! Here’s the princess!” The dragon came peering out of the darkness. Seeing the bright robe covered with gold and silver embroidery, and hearing Bedelia’s voice, he opened his mouth wide. When Bedelia gave the signal, the young man heaved the robe down the dragon’s throat. Bedelia threw herself flat on the ground, and the young man ran away. As the gunpowder met the flames inside the dragon, there was a tremendous explosion. Bedelia got up, dusting herself off. “Dragons,” she said, “are not very bright.” She left the young man sweeping up the pieces, and she went back to the castle to have her geography lesson.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Losh, M., Gordon, P.C. Quantifying Narrative Ability in Autism Spectrum Disorder: A Computational Linguistic Analysis of Narrative Coherence. J Autism Dev Disord 44, 3016–3025 (2014). https://doi.org/10.1007/s10803-014-2158-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10803-014-2158-y

Keywords

Navigation