Abstract
Despite considerable discussion in the literature about the advantages of observational research and the relative benefits of different coding systems and strategies, little is written about the actual implementation of this assessment strategy. This paper presents an overall framework as well as the essential components involved in collecting (selection of task, setting, unit of analysis, and coding system) and coding (transcribing, selecting and training coders, transforming data, and analyzing reliability) of observational data. To achieve success with observational methods, we emphasize several issues, including (a) the research question as the motivator for all decisions, (b) the interrelatedness of tasks, and (c) the implications of decisions early in the process for later stages of analysis and interpretation. Investigators are encouraged to communicate the details of their observational and coding procedures so that these methods are readily accessible for purposes of replication and comparison.
Similar content being viewed by others
REFERENCES
Alexander, J. F., Newell, R. M., Robbins, M. S., & Turner, C. W. (1995). Observational coding in family therapy process research. Journal of Family Psychology, 9, 355–365.
Allison, P. D., & Liker, J. K. (1982). Analyzing sequential categorical data on dyadic interaction: Comment on Gottman. Psychological Bulletin, 91, 393–403.
Aragona, J. A., & Eyberg, S. M. (1981). Neglected children: Mothers' report of child behavior problems and observed verbal behavior. Child Development, 52, 596–602.
Bakeman, R., & Casey, R. L. (1995). Analyzing family interaction: Taking time into account. Journal of Family Psychology, 9, 131–143.
Bakeman, R., & Gottman, J.M. (1986). Observing interaction: An introduction to sequential analysis. Cambridge: Cambridge University Press.
Bakeman, R., & Quera, V. (1995). Analyzing interaction: Sequential analysis with SDIS and GSEQ. New York: Cambridge University.
Barker, R. G. (1963). The stream of behavior as an empirical problem. In R. G. Barker (Ed.), The stream of behavior (pp. 1–22). New York: Appleton-Century-Crofts.
Barker, R. G., & Wright, H. F. (1951). One boy's day. New York: Harper & Row.
Bartko, J. J., & Carpenter, W. T. (1976). On the methods and theory of reliability. Journal of Nervous and Mental Disease, 163, 307–317.
Barton, C., Alexander, J. F., & Turner, C. W. (1988). Defensive communications in normal and delinquent families: The impact of context and family role. Journal of Family Psychology, 1, 390–405.
Basco, M. R., Birchler, G. R., Kalal, B., Talbott, R., & Slater, M. A. (1991). The clinician rating of adult communication (CRAC): A clinician's guide to the assessment of interpersonal communication. Journal of Clinical Psychology, 47, 368–380.
Bell, D. C., & Bell, L. G. (1989). Micro and macro measurement of family systems concepts. Journal of Family Psychology, 3, 137–157.
Bradbury, T. N., Beach, S. R. H., Fincham, F. D., & Nelson, G. M. (1996). Attributions and behavior in functional and dysfunctional marriages. Journal of Consulting and Clinical Psychology, 64, 569–576.
Bray, J. H., & Berger, S. H. (1993). Developmental issues in Step-Families Research Project: Family relationships and parent-child interactions. Journal of Family Psychology, 7, 76–90.
Brody, G., Stoneman, Z., & McCoy, J. (1994). Contributions of family relationships and child temperaments to longitudinal variations in sibling relationship quality and sibling relationship styles. Journal of Family Psychology, 8, 274–286.
Burman, B., Margolin, G., & John, R. S. (1993). America's angriest home videos: Behavioral contingencies observed in home reenactments of marital conflict. Journal of Consulting and Clinical Psychology, 61, 28–39.
Cairns, R. B., & Green, J. A. (1979). How to assess personality and social patterns: Observations or ratings? In R. G. Cairns (Ed.), The analysis of social interactions: Methods, issues, and illustration (pp. 209–226). Hillsdale, NJ: Erlbaum.
Christensen, A. (1979). Naturalistic observation of families: A system for random audio recordings in the home. Behavior Therapy, 10, 418–422.
Christensen, A., & Arrington, A. (1987). Research issues and strategies. In T. Jacob (Ed.), Family interaction and psychopathology (pp. 259–296). New York: Plenum Press.
Christensen, A., & Hazzard, A. (1983). Reactive effects during naturalistic observation of families. Behavioral Assessment, 5, 349–362.
Christensen, A., & Heavey, C. L. (1990). Gender and social structure in the demand/withdraw pattern of marital conflict. Journal of Personality and Social Psychology, 59, 73–81.
Cohen, J. A. (1960). Coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46.
Conger, R. D. (1983). Behavioral assessment for practitioners: Some reasons and recommendations. In E. E. Filsinger (Ed.), Marriage and family assessment (pp. 137–151). Beverly Hills, Sage.
Conger, K. J., & Conger, R. D.(1994). Differential parenting and change in sibling differences in delinquency. Journal of Family Psychology, 8, 287–302.
Cummings, J. S., Pellegrini, D., Notarius, C., & Cummings, E. M. (1989). Children's responses to angry adult behavior as a function of marital distress and history of interparent hostility. Child Development, 60, 1035–1043.
Davidson, D., MacGregor, M. W., MacLean, D. R., McDermott, N., Farquharson, J., & Chaplin, W. F. (1996). Coder gender and potential for hostility ratings. Health Psychology, 15, 298–302.
Deater-Deckard, K., Dodge, K. A., Bates, J. E., & Pettit, G. S. (1996). Physical discipline among African American and European American mothers: Links to children's externalizing behaviors. Developmental Psychology, 32, 1065–1072.
Easterbrooks, M. A., Cummmings, E. M., & Emde, R. N. (1994). Young children's responses to constructive marital disputes. Journal of Family Psychology, 8, 160–169.
Ekman, P., & Friesen, W. V. (1978). The facial action coding system. Palo Alto: Consulting Psychologists Press.
El-Sheikh, M. (1997). Children's responses to adult-adult and mother-child arguments: The role of parental marital conflict and distress. Journal of Family Psychology, 11, 165–175.
Eyberg, S. M., & Boggs, S. R. (1998). Parent-child interaction therapy: A psychosocial intevention for the treatment of young conduct-disordered children. In J. M. Briesmeister & C. E. Schaefer (Eds.). Handbook of parent training: Parents as co-therapists for children's behavior problems (pp. 61–97). New York: Wiley.
Fleiss, J. L., Nee, J. C. M., & Landis, J. R. (1979). The large sample variance of kappa in the case of different sets of raters. Psychological Bulletin, 86, 974–977.
Floyd, F. (1989). Segmenting interactions: Coding units for assessing marital and family behaviors. Behavioral Assessment, 11, 23–29.
Floyd, F. J., O'Farrell, T. J., & Goldberg, M. (1987). Comparison of marital observation measures: The Marital Interaction Coding System and the Communication Skills Test. Journal of Consulting and Clinical Psychology, 55, 423–429.
Forgatch, M. S.(1989). Patterns and outcome in family problem solving: The disrupting effect of negative emotion. Journal of Marriage and the Family, 51, 115–124.
Foster, S. L. (1987). Issues in behavioral assessment of parent-adolescent conflict. Behavioral Assessment, 9, 253–269.
Gjerde, P. R. (1986). The interpersonal structure of family interaction settings: Parent-adolescent relations in dyads and triads. Developmental Psychology, 22, 297–304.
Goldstein, M. J. (1992). Intrafamilial communication patterns observed during adolescence and the subsequent development of schizophrenia in early adulthood. In A. Z. Schwartberg, A. H. Esman, S. C. Feinstein, & S. Lebovici (Eds.), International annals of adolescent psychiatry (Vol. 2, pp. 47–55). Chicago: U of Chicago.
Gordis, E., Margolin, G., & John, R. S. (1997). Marital aggression, observed parental hostility, and child behavior during triadic family interaction. Journal of Family Psychology, 11, 3–10.
Gottman, J. M. (1979). Marital interaction: Experimental investigations. New York: Academic Press.
Gottman, J. M. (1996). What predicts divorce? The measures. Mahwah, NJ: Erlbaum.
Gottman, J. M., & Krokoff, L. J. (1989). Marital interaction and satisfaction: A longitudinal view. Journal of Consulting and Clinical Psychology, 57, 47–52.
Gottman, J. M., & Levenson, R. W. (1992). Marital processes predictive of later dissolution: Behavior, physiology, and health. Journal of Personality and Social Psychology, 63, 221–233.
Greenberg, L. S. (1986). Change process research. Journal of Consulting and Clinical Psychology, 54, 4–9.
Hahlweg, K., Goldstein, M. J., Nuechterlein, K. H., Magana, A. B., Mintz, J., Doane, J. A., Miklowitz, D. J., & Snyder, K. S. (1989). Expressed emotion and patient-relative interaction in families of recent onset schizophrenics. Journal of Consulting and Clinical Psychology, 57, 11–18.
Henggeler, S. W., Edwards, J. J., Hanson, C. L., & Okwumabua, T. M. (1988). The psychosocial functioning of wife-dominant families. Journal of Family Psychology, 2. 188–211.
Hetherington, E. M. (1993). An overview of the Virginia longitudinal study of divorce and remarriage with a focus on early adolescence. Journal of Family Psychology, 7, 39–56.
Heyman, R. E., Weiss, R. L., & Eddy, J. M. (1995) Marital Interaction Coding System: Revision and empirical evaluation. Behavioral Research and Therapy, 33, 737–746.
Hops, H., Biglan, A., Sherman, L., Arthur, J., Friedman, L., & Osteen, V. (1987). Home observations of family interactions of depressed women. Journal of Consulting and Clinical Psychology, 55, 341–346.
Hops, H., Davis, B., & Longoria, N. (1995). Methodological issues in direct observation: Illustrations with the Living in Familial Environments (LIFE) Coding System. Journal of Clinical Child Psychology, 24, 193–203.
Jacob, T. (1975). Family interaction in normal and disturbed families: A methodological and substantive review. Psychological Bulletin, 82, 33–65.
Jacob, T., & Krahn, G. L. (1987). The classification of behavioral observation codes in studies of family interaction. Journal of Marriage and the Family, 49, 677–687.
Jacob, T., & Krahn, G. L. (1988). Marital interactions of alcoholic couples: Comparison with depressed and nondistressed couples. Journal of Consulting and Clinical Psychology, 56, 73–79.
Jacob, T., Tennenbaum, D. L., & Krahn, G. (1987). Factors influencing the reliability and validity of observational data. In T. Jacob (Ed.), Family interaction and psychopathology: Theories, methods, and findings (pp. 297–328). New York: Plenum Press.
Jacobson, N. S. (1985). The role of observational measures in behavioral therapy outcome research. Behavioral Assessment, 7, 297–308.
Jacobson, N. S., Gottman, J. M., & Shortt, J. W. (1995). The distinction between Type 1 and Type 2 batterers—Further considerations: Reply to Ornduff et al. (1995), Margolin et al. (1995), and Walker (1995). Journal of Family Psychology, 9, 272–279.
Jacobson, N. S., Gottman, J. M., Waltz, J., Rushe, R., & Babcock, J. (1994). Affect, verbal content, and psychophysiology in the arguments of couples with a violent husband. Journal of Consulting and Clinical Psychology, 62, 982–988.
Johnson, S. M., & Bolstad, O. D. (1975). Reactivity to home observation, a comparison of audio recorded behavior with observers present or absent. Journal of Applied Behavior Analysis, 8, 181–185.
Jouriles, E. N., Pfiffner, L. J., & O'Leary, S. G. (1988). Marital conflict, parenting, and toddler conduct problems. Journal of Abnormal Child Psychology, 16, 197–206.
Jouriles, E. N., & Thompson, S. M. (1993). Effects of mood on mothers' evaluations of children's behavior. Journal of Family Psychology, 6, 300–307.
Julien, D., Markman, H. J., & Lindahl, K. M. (1989). A comparison of a global and a microanalytic coding system: Implications for future trends in studying interactions. Behavioral Assessment, 11, 81–100.
Katz, L. F., & Gottman, J. M. (1993). Patterns of marital conflict predict children's internalizing and externalizing behaviors. Developmental Psychology, 29, 940–950.
Lindahl, K., Clements, M., & Markman, H. (1998). The development of marriage: A nine-year perspective. In T. Bradbury (Ed.), The developmental course of marital dysfunction (pp. 205–236). New York: Cambridge University Press.
Long, J. (1996). Video Coding System (VCS). In J. M. Gottman (Ed.), What predicts divorce? The measures (pp. SPAFF 129–130). Mahwah, NJ: Erlbaum.
Margolin, G. (1983). An interactional model for the behavioral assessment of marital relationships. Behavioral Assessment, 5, 103–127.
Margolin, G., Burman, B., & John, R. S. (1989). Home observations of married couples reenacting naturalistic conflicts. Behavioral Assessment, 11, 101–118.
Margolin, G., John, R. S., & Gleberman, L. (1988). Affective responses to conflictual discussions in violent and nonviolent couples. Journal of Consulting and Clinical Psychology, 59, 670–681.
Margolin, G., John, R. S., Ghosh, C. M. & Gordis, E. B. (1996). Family interaction process: An essential tool for exploring abusive relations. In D. D. Cahn & S. A. Lloyd (Eds.), Family violence from a communication perspective (pp. 37–58). Thousand Oaks, CA: Sage.
Margolin, G. & Wampold, B. E. (1981). Sequential analysis of conflict and accord in distressed and nondistressed marital partners. Journal of Consulting and Clinical Psychology, 49, 554–567.
Markman, H. J., Leber, B. D., Cordova, A. D., & St. Peters, M. (1995). Behavioral observation and family psychology — Strange bedfellows or happy marriage?: Comment on Alexander et al. (1995). Journal of Family Psychology, 9, 371–379.
Markman, H. J., & Notarius, C. I. (1987). Coding marital and family interaction: Current status. In T. Jacob (Ed.), Family interaction and psychopathology: Theories, methods, and findings (pp. 329–390). New York: Plenum Press.
McCombs, A., Forehand, R., & Smith, K. (1988). The relationship between maternal problem-solving style and adolescent social adjustment. Journal of Family Psychology, 2, 57–66.
McGoldrick, M. & Giordano, J. (1996). Overview: Ethnicity and family therapy. In M. McGoldrick, J. Giordano, & J. K. Pearce (Eds.), Ethnicity and family therapy (pp. 1–30). New York: Guilford.
Mook, D. G. (1983). In defense of external invalidity. American Psychologist, 38, 379–387.
Mosteller, F., & Tukey, J. W. (1977). Data analysis and regression: A second course in statistics. Menlo Park: Addison-Wesley.
Notarius, C., & Markman, H. J. (1989). Coding marital and family interaction: A sampling and discussion of current issues. Behavioral Assessment, 11, 1–13.
Notarius, C., Markman, H. J., & Gottman, J. M. (1983). Couples' Interaction Scoring System: Clinical implications. In E. E. Filsinger (Ed.), Marriage and family assessment: A sourcebook for family therapy (pp. 117–136). Beverly Hills, CA: Sage.
O'Brien, M., Margolin, G., John, R. S., & Krueger, L. (1991). Mothers' and sons' cognitive and emotional reactions to simulated marital and family conflict. Journal of Consulting and Clinical Psychology, 59, 692–703.
O'Farrell, T. J., & Birchler, G. R. (1987). Marital relationships of alcoholic, conflicted and nonconflicted couples. Journal of Marital and Family Therapy, 13, 259–274.
Olson, D., H., & Ryder, R. G. (1970). Inventory of marital conflicts (IMC): An experimental interaction procedure. Journal of Marriage and the Family, 32, 443–448.
Parke, R. D., & O'Leary, S. (1976). Family interaction in the newborn period: Some findings, some observations, and some unresolved issues. In K. Riegel & J. Meacham (Eds.), The developing individual in a changing world: Vol. 2: Social and environmental issues (pp. 653–663). The Hague: Mouton.
Pasch, L. A., & Bradbury, T. M. (1998). Social support, conflict, and the development of marital dysfunction. Journal of Consulting and Clinical Psychology, 66, 219–230.
Patterson, G. R., (1982). Coercive family processes. Eugene, OR: Castalia.
Patterson, G. R., & Chamberlain, P. (1994). A functional analysis of resistance during parent training therapy. Clinical Psychology: Science and Practice, 1, 53–70.
Patterson, G. R., & Forgatch, M. S. (1995). Predicting future clinical adjustment from treatment outcome and process variables. Psychological Assessment, 7, 275–285.
Patterson, G. R., Reid, J. B., & Dishion, T. J. (1992). Antisocial boys. Eugene, OR: Castalia.
Power, T., & Parke, R. (1982). Play as a context for early learning: Lab and home analyses. In E. I. Sigel & T. Laosa (Eds.), The family as a learning environment (pp. 147–178). New York: Plenum Press.
Pratt, M. W., Kerig, P. K., Cowan, P. A., & Cowan, C. P. (1988). Mothers and fathers teaching three year olds: Authoritative parenting and adults' use of the zone of proximal development. Developmental Psychology, 24, 832–839.
Raush, H. L., Barry, W. A., Hertel, R. K., & Swain, M. A. (1974). Communication, conflict, and marriage. San Francisco: Jossey-Bass.
Reid, J. B. (1978). A social learning approach to family intervention: Observation in home settings (Vol. 2). Eugene, OR: Castalia.
Reid, J. R., Taplin, P., & Lorber, R. (1981). A social interactional approach to the treatment of abusive families. In R. B. Stuart (Ed.), Violent behavior: Social learning approaches to prediction management, and treatment (pp. 83–101). New York: Brunner/Mazel.
Robin, A. L., & Weiss, J. G. (1980). Criterion-related validity of behavioral and self-report measures of problem-solving communication skills in distressed and non-distressed parent-adolescent dyads. Behavioral Assessment, 2, 339–352.
Ruscher, S. M., & Gotlib, I. H. (1988). Marital interaction patterns of couples with and without a depressed partner. Behavior Therapy, 19, 455–470.
Sattler, J. M. (1992). Assessment of children. San Diego: Jerome M. Sattler.
Schmaling, K. B., & Jacobson, N. S. (1990). Marital interaction and depression. Journal of Abnormal Psychology, 99, 229–236.
Shrout, P. E., & Fleiss, J. C. (1979). Intraclass correlations: Uses in assessing rater reliability, Psychological Bulletin, 86, 420–428.
Slesnick, N. & Waldron, H. B. (1997). Interpersonal problem-solving interactions of depressed adolescents and their parents. Journal of Family Psychology, 11, 234–245.
Snyder, J. L. (1977). Reinforcement analysis of interaction in problem and nonproblem families. Journal of Abnormal Psychology, 86, 528–535.
Strodtbeck, F. L. (1951). Husband-wife interaction over revealed difference. American Sociological Review, 16, 468–473.
Tannen, D. (1990). You just don't understand: Women and men in conversation. New York: Ballantine.
Taplin, P. S., & Reid, J. B. (1973). Effects of instructional set and experimenter influence on observer reliability. Child Development, 44, 547–554.
Vuchinich, S., Emery, R. E., & Cassidy, J. (1988). Family members as third parties in dyadic family conflict: Strategies, alliances, and outcomes. Child Development, 59, 1293–1302.
Wampold, B. E., & Margolin, G. (1982). Nonparametric strategies to test the independence of behavioral states in sequential data. Psychological Bulletin, 92, 755–765.
Weiss, R. L. (1989). The circle of voyeurs: Observing the observers of marital and family interactions. Behavioral Assessment, 11, 135–147.
Weiss, R. L., & Heyman, R. E. (1990). Observation of marital interaction. In F. D. Fincham & T. N. Bradbury (Eds.), The psychology of marriage: Basic issues and applications (pp. 87–117). New York: Guilford.
Weiss, R. L., & Summers, K. (1983). Marital interaction coding system-III. In E. Filsinger (Ed.), Marriage and family assessment (pp. 35–117). Beverly Hills, CA: Sage.
Weiss, R. L., & Tolman, A. O., (1990). The Marital Interactional Coding System-Global (MICS-G): A global comparison to the MICS. Behavioral Assessment, 12, 271–294.
Whitehurst, G. J., Fischel, J. E., DeBaryshe, B., Caulfield, M. B., & Falco, F. L. (1986). Analyzing sequential relations in observational data: A practical guide. Journal of Psychopathology and Behavioral Assessment, 8, 129–148.
Wieder, G. B., & Weiss, R. L. (1980). Generalizability theory and the coding of marital interactions. Journal of Consulting and Clinical Pschology, 48, 469–477.
Wiggins, J. S. (1973). Personality and prediction: Principles of personality assessment. Reading, MA: Addison-Wesley.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Margolin, G., Oliver, P.H., Gordis, E.B. et al. The Nuts and Bolts of Behavioral Observation of Marital and Family Interaction. Clin Child Fam Psychol Rev 1, 195–213 (1998). https://doi.org/10.1023/A:1022608117322
Issue Date:
DOI: https://doi.org/10.1023/A:1022608117322