Skip to main content
Erschienen in: European Journal of Pediatrics 4/2024

22.01.2024 | RESEARCH

Computerized adaptive testing to screen pre-school children for emotional and behavioral problems

verfasst von: Meinou H. C. Theunissen, Iris Eekhout, Sijmen A. Reijneveld

Erschienen in: European Journal of Pediatrics | Ausgabe 4/2024

Einloggen, um Zugang zu erhalten

Abstract

Questionnaires to detect emotional and behavioral (EB) problems in preventive child healthcare (PCH) should be short; this potentially affects their validity and reliability. Computerized adaptive testing (CAT) could overcome this weakness. The aim of this study was to (1) develop a CAT to measure EB problems among pre-school children and (2) assess the efficiency and validity of this CAT. We used a Dutch national dataset obtained from parents of pre-school children undergoing a well-child care assessment by PCH (n = 2192, response 70%). Data regarded 197 items on EB problems, based on four questionnaires, the Strengths and Difficulties Questionnaire (SDQ), the Child Behavior Checklist (CBCL), the Ages and Stages Questionnaire: Social Emotional (ASQ:SE), and the Brief Infant–Toddler Social and Emotional Assessment (BITSEA). Using 80% of the sample, we calculated item parameters necessary for a CAT and defined a cutoff for EB problems. With the remaining part of the sample, we used simulation techniques to determine the validity and efficiency of this CAT, using as criterion a total clinical score on the CBCL. Item criteria were met by 193 items. This CAT needed, on average, 16 items to identify children with EB problems. Sensitivity and specificity compared to a clinical score on the CBCL were 0.89 and 0.91, respectively, for total problems; 0.80 and 0.93 for emotional problems; and 0.94 and 0.91 for behavioral problems.
    Conclusion: A CAT is very promising for the identification of EB problems in pre-school children, as it seems to yield an efficient, yet high-quality identification. This conclusion should be confirmed by real-life administration of this CAT.
What is Known:
• Studies indicate the validity of using computerized adaptive test (CAT) applications to identify emotional and behavioral problems in school-aged children.
• Evidence is as yet limited on whether CAT applications can also be used with pre-school children.
What is New:
• The results of this study show that a computerized adaptive test is very promising for the identification of emotional and behavior problems in pre-school children, as it appears to yield an efficient and high-quality identification.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Brugman E, Reijneveld SA, Verhulst FC, Verloove-Vanhorick SP (2001) Identification and management of psychosocial problems by preventive child health care. Arch Pediatr Adolesc Med 155(4):462–469CrossRefPubMed Brugman E, Reijneveld SA, Verhulst FC, Verloove-Vanhorick SP (2001) Identification and management of psychosocial problems by preventive child health care. Arch Pediatr Adolesc Med 155(4):462–469CrossRefPubMed
2.
Zurück zum Zitat Patel V, Flisher AJ, Hetrick S, McGorry P (2007) Mental health of young people: a global public-health challenge. Lancet 369(9569):1302–1313CrossRefPubMed Patel V, Flisher AJ, Hetrick S, McGorry P (2007) Mental health of young people: a global public-health challenge. Lancet 369(9569):1302–1313CrossRefPubMed
3.
Zurück zum Zitat Kieling C, Baker-Henningham H, Belfer M et al (2011) Child and adolescent mental health worldwide: evidence for action. Lancet 378(9801):1515–1525CrossRefPubMed Kieling C, Baker-Henningham H, Belfer M et al (2011) Child and adolescent mental health worldwide: evidence for action. Lancet 378(9801):1515–1525CrossRefPubMed
4.
Zurück zum Zitat Tremblay L, Limbos M (2009) Body image disturbance and psychopathology in children: research evidence and implications for prevention and treatment. Current Psychiatry Reviews 5(1):62–72CrossRef Tremblay L, Limbos M (2009) Body image disturbance and psychopathology in children: research evidence and implications for prevention and treatment. Current Psychiatry Reviews 5(1):62–72CrossRef
5.
Zurück zum Zitat Ormel J, Oldehinkel AJ, Sijtsema J et al (2012) The TRacking adolescents’ individual lives survey (TRAILS): design, current status, and selected findings. J Am Acad Child Adolesc Psychiatry 51(10):1020–1036CrossRefPubMed Ormel J, Oldehinkel AJ, Sijtsema J et al (2012) The TRacking adolescents’ individual lives survey (TRAILS): design, current status, and selected findings. J Am Acad Child Adolesc Psychiatry 51(10):1020–1036CrossRefPubMed
6.
Zurück zum Zitat Jaspers M, de Winter AF, Huisman M et al (2012) Trajectories of psychosocial problems in adolescents predicted by findings from early well-child assessments. J Adolesc Health 51(5):475–483CrossRefPubMed Jaspers M, de Winter AF, Huisman M et al (2012) Trajectories of psychosocial problems in adolescents predicted by findings from early well-child assessments. J Adolesc Health 51(5):475–483CrossRefPubMed
7.
Zurück zum Zitat Verboom CE, Sijtsema JJ, Verhulst FC, Penninx, Brenda WJH, Ormel J (2014) Longitudinal associations between depressive problems, academic performance, and social functioning in adolescent boys and girls. Dev Psychol 50(1):247–257. https://doi.org/10.1037/a0032547 Verboom CE, Sijtsema JJ, Verhulst FC, Penninx, Brenda WJH, Ormel J (2014) Longitudinal associations between depressive problems, academic performance, and social functioning in adolescent boys and girls. Dev Psychol 50(1):247–257.  https://​doi.​org/​10.​1037/​a0032547
8.
Zurück zum Zitat Lavigne JV, Meyers KM, Feldman M (2016) Systematic review: classification accuracy of behavioral screening measures for use in integrated primary care settings. J Pediatr Psychol 41(10):1091–1109CrossRefPubMed Lavigne JV, Meyers KM, Feldman M (2016) Systematic review: classification accuracy of behavioral screening measures for use in integrated primary care settings. J Pediatr Psychol 41(10):1091–1109CrossRefPubMed
9.
Zurück zum Zitat Geeraert L, van den Noortgate W, Grietens H, Onghena P (2004) The effects of early prevention programs for families with young children at risk for physical child abuse and neglect: a meta-analysis. Child Maltreat 9(3):277–291CrossRefPubMed Geeraert L, van den Noortgate W, Grietens H, Onghena P (2004) The effects of early prevention programs for families with young children at risk for physical child abuse and neglect: a meta-analysis. Child Maltreat 9(3):277–291CrossRefPubMed
10.
Zurück zum Zitat Cuijpers P, Van Straten A, Smit F (2005) Preventing the incidence of new cases of mental disorders: a meta-analytic review. J Nerv Ment Dis 193(2):119–125CrossRefPubMed Cuijpers P, Van Straten A, Smit F (2005) Preventing the incidence of new cases of mental disorders: a meta-analytic review. J Nerv Ment Dis 193(2):119–125CrossRefPubMed
11.
Zurück zum Zitat Goodman R (1997) The strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry 38:581–586CrossRefPubMed Goodman R (1997) The strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry 38:581–586CrossRefPubMed
12.
Zurück zum Zitat Theunissen MH, Vogels AG, Reijneveld SA (2012) Early detection of psychosocial problems in children aged 5 to 6 years by preventive child healthcare: has it improved? J Pediatr 160(3):500–504CrossRefPubMed Theunissen MH, Vogels AG, Reijneveld SA (2012) Early detection of psychosocial problems in children aged 5 to 6 years by preventive child healthcare: has it improved? J Pediatr 160(3):500–504CrossRefPubMed
13.
Zurück zum Zitat Glascoe FP (2005) Screening for developmental and behavioral problems. Ment Retard Dev Disabil Res Rev 11(3):173–179CrossRefPubMed Glascoe FP (2005) Screening for developmental and behavioral problems. Ment Retard Dev Disabil Res Rev 11(3):173–179CrossRefPubMed
14.
Zurück zum Zitat Sheldrick RC, Merchant S, Perrin EC (2011) Identification of developmental-behavioral problems in primary care: a systematic review. Pediatrics 128(2):356–363CrossRefPubMed Sheldrick RC, Merchant S, Perrin EC (2011) Identification of developmental-behavioral problems in primary care: a systematic review. Pediatrics 128(2):356–363CrossRefPubMed
15.
Zurück zum Zitat Vogels AG, Crone MR, Hoekstra F, Reijneveld SA (2009) Comparing three short questionnaires to detect psychosocial dysfunction among primary school children: a randomized method. BMC Public Health 9(1):489CrossRefPubMedPubMedCentral Vogels AG, Crone MR, Hoekstra F, Reijneveld SA (2009) Comparing three short questionnaires to detect psychosocial dysfunction among primary school children: a randomized method. BMC Public Health 9(1):489CrossRefPubMedPubMedCentral
16.
Zurück zum Zitat Theunissen MH, Vogels AG, de Wolff MS, Reijneveld SA (2013) Characteristics of the strengths and difficulties questionnaire in preschool children. Pediatrics 131(2):446CrossRef Theunissen MH, Vogels AG, de Wolff MS, Reijneveld SA (2013) Characteristics of the strengths and difficulties questionnaire in preschool children. Pediatrics 131(2):446CrossRef
18.
Zurück zum Zitat Vugteveen J, de Bildt A, Theunissen M, Reijneveld M, Timmerman M (2021) Validity aspects of the strengths and difficulties questionnaire (SDQ) adolescent self-report and parent-report versions among dutch adolescents. Assessment 28(2):601–616CrossRefPubMed Vugteveen J, de Bildt A, Theunissen M, Reijneveld M, Timmerman M (2021) Validity aspects of the strengths and difficulties questionnaire (SDQ) adolescent self-report and parent-report versions among dutch adolescents. Assessment 28(2):601–616CrossRefPubMed
19.
Zurück zum Zitat Stone LL, Otten R, Engels RC, Vermulst AA, Janssens JM (2010) Psychometric properties of the parent and teacher versions of the strengths and difficulties questionnaire for 4- to 12-year-olds: a review. Clin Child Fam Psychol Rev 13(3):254–274CrossRefPubMedPubMedCentral Stone LL, Otten R, Engels RC, Vermulst AA, Janssens JM (2010) Psychometric properties of the parent and teacher versions of the strengths and difficulties questionnaire for 4- to 12-year-olds: a review. Clin Child Fam Psychol Rev 13(3):254–274CrossRefPubMedPubMedCentral
20.
Zurück zum Zitat Vogels AG, Jacobusse GW, Reijneveld SA (2011) An accurate and efficient identification of children with psychosocial problems by means of computerized adaptive testing. BMC Med Res Methodol 11:111–111CrossRefPubMedPubMedCentral Vogels AG, Jacobusse GW, Reijneveld SA (2011) An accurate and efficient identification of children with psychosocial problems by means of computerized adaptive testing. BMC Med Res Methodol 11:111–111CrossRefPubMedPubMedCentral
21.
Zurück zum Zitat Theunissen MHC, de Wolff MS, Deurloo JA, Vogels AGC, Reijneveld SA (2020) Computerized adaptive testing to screen children for emotional and behavioral problems by preventive child healthcare. BMC Pediatr 20(1):119–121CrossRefPubMedPubMedCentral Theunissen MHC, de Wolff MS, Deurloo JA, Vogels AGC, Reijneveld SA (2020) Computerized adaptive testing to screen children for emotional and behavioral problems by preventive child healthcare. BMC Pediatr 20(1):119–121CrossRefPubMedPubMedCentral
22.
Zurück zum Zitat Barthel D, Otto C, Nolte S et al (2017) The validation of a computer-adaptive test (CAT) for assessing health-related quality of life in children and adolescents in a clinical sample: study design, methods and first results of the kids-CAT study. Qual Life Res 26(5):1105–1117CrossRefPubMed Barthel D, Otto C, Nolte S et al (2017) The validation of a computer-adaptive test (CAT) for assessing health-related quality of life in children and adolescents in a clinical sample: study design, methods and first results of the kids-CAT study. Qual Life Res 26(5):1105–1117CrossRefPubMed
23.
Zurück zum Zitat Devine J, Otto C, Rose M et al (2015) A new computerized adaptive test advancing the measurement of health-related quality of life (HRQoL) in children: the kids-CAT. Qual Life Res 24(4):871–884CrossRefPubMed Devine J, Otto C, Rose M et al (2015) A new computerized adaptive test advancing the measurement of health-related quality of life (HRQoL) in children: the kids-CAT. Qual Life Res 24(4):871–884CrossRefPubMed
24.
Zurück zum Zitat Gardner W, Kelleher KJ, Pajer KA (2002) Multidimensional adaptive testing for mental health problems in primary care. Med Care 40(9):812–823CrossRefPubMed Gardner W, Kelleher KJ, Pajer KA (2002) Multidimensional adaptive testing for mental health problems in primary care. Med Care 40(9):812–823CrossRefPubMed
25.
Zurück zum Zitat Hill CD, Edwards MC, Thissen D et al (2007) Practical issues in the application of item response theory: a demonstration using items from the pediatric quality of life inventory (PedsQL) 4.0 generic core scales. Med Care 45(5 Suppl 1):39CrossRef Hill CD, Edwards MC, Thissen D et al (2007) Practical issues in the application of item response theory: a demonstration using items from the pediatric quality of life inventory (PedsQL) 4.0 generic core scales. Med Care 45(5 Suppl 1):39CrossRef
27.
Zurück zum Zitat Theunissen MH, Vogels AG, de Wolff MS, Crone MR, Reijneveld SA (2015) Comparing three short questionnaires to detect psychosocial problems among 3 to 4-year olds. BMC Pediatr 15:84-yCrossRef Theunissen MH, Vogels AG, de Wolff MS, Crone MR, Reijneveld SA (2015) Comparing three short questionnaires to detect psychosocial problems among 3 to 4-year olds. BMC Pediatr 15:84-yCrossRef
28.
Zurück zum Zitat de Wolff MS, Theunissen MH, Vogels AG, Reijneveld SA (2013) Three questionnaires to detect psychosocial problems in toddlers: a comparison of the BITSEA, ASQ:SE, and KIPPPI. Acad Pediatr 13(6):587–592CrossRefPubMed de Wolff MS, Theunissen MH, Vogels AG, Reijneveld SA (2013) Three questionnaires to detect psychosocial problems in toddlers: a comparison of the BITSEA, ASQ:SE, and KIPPPI. Acad Pediatr 13(6):587–592CrossRefPubMed
29.
Zurück zum Zitat Achenbach T, Rescorla L (2000) Manual for the ASEBA preschool forms and profiles. University of Vermont, Burlington Achenbach T, Rescorla L (2000) Manual for the ASEBA preschool forms and profiles. University of Vermont, Burlington
30.
Zurück zum Zitat Ferdinand RF, Visser JH, Hoogerheide KN et al (2004) Improving estimation of the prognosis of childhood psychopathology; combination of DSM-III-R/DISC diagnoses and CBCL scores. J Child Psychol Psychiatry 45(3):599–608CrossRefPubMed Ferdinand RF, Visser JH, Hoogerheide KN et al (2004) Improving estimation of the prognosis of childhood psychopathology; combination of DSM-III-R/DISC diagnoses and CBCL scores. J Child Psychol Psychiatry 45(3):599–608CrossRefPubMed
31.
Zurück zum Zitat Koot HM, Van Den Oord EJ, Verhulst FC, Boomsma DI (1997) Behavioral and emotional problems in young preschoolers: cross-cultural testing of the validity of the child behavior checklist/2-3. J Abnorm Child Psychol 25(3):183–196CrossRefPubMed Koot HM, Van Den Oord EJ, Verhulst FC, Boomsma DI (1997) Behavioral and emotional problems in young preschoolers: cross-cultural testing of the validity of the child behavior checklist/2-3. J Abnorm Child Psychol 25(3):183–196CrossRefPubMed
32.
Zurück zum Zitat Goodman R, Ford T, Simmons H, Gatward R, Meltzer H (2000) Using the strengths and difficulties questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. Br J Psychiatry 177:534–539CrossRefPubMed Goodman R, Ford T, Simmons H, Gatward R, Meltzer H (2000) Using the strengths and difficulties questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. Br J Psychiatry 177:534–539CrossRefPubMed
33.
Zurück zum Zitat Bricker D, Squires J (1999) Ages & stages questionnaires: A parent-completed, child-monitoring system. Vol 2. Baltimore: Brooks Bricker D, Squires J (1999) Ages & stages questionnaires: A parent-completed, child-monitoring system. Vol 2. Baltimore: Brooks
34.
Zurück zum Zitat Squires J, Bricker D, Twombly E (2003) Ages & stages questionnaires: Social-emotional. Brookes Publishing, A parent-completed child-monitoring system for social-emotional behaviors. Baltimore Squires J, Bricker D, Twombly E (2003) Ages & stages questionnaires: Social-emotional. Brookes Publishing, A parent-completed child-monitoring system for social-emotional behaviors. Baltimore
35.
Zurück zum Zitat Guillemin F (1995) Cross-cultural adaptation and validation of health status measures. Scand J Rheumatol 24(2):61–63CrossRefPubMed Guillemin F (1995) Cross-cultural adaptation and validation of health status measures. Scand J Rheumatol 24(2):61–63CrossRefPubMed
36.
Zurück zum Zitat Briggs-Gowan MJ, Carter AS, Irwin JR, Wachtel K, Cicchetti DV (2004) The brief infant-toddler social and emotional assessment: screening for social-emotional problems and delays in competence. J Pediatr Psychol 29(2):143–155CrossRefPubMed Briggs-Gowan MJ, Carter AS, Irwin JR, Wachtel K, Cicchetti DV (2004) The brief infant-toddler social and emotional assessment: screening for social-emotional problems and delays in competence. J Pediatr Psychol 29(2):143–155CrossRefPubMed
37.
Zurück zum Zitat Visser JC, Smeekens S, Riksen-Walraven M et al (2001) Nederlandse vertaling van de BITSEA [dutch translation of the brief infant toddler social, emotional Assessment–Revised]. Radboud Universiteit Nijmegen, Nijmegen, The Netherlands Visser JC, Smeekens S, Riksen-Walraven M et al (2001) Nederlandse vertaling van de BITSEA [dutch translation of the brief infant toddler social, emotional Assessment–Revised]. Radboud Universiteit Nijmegen, Nijmegen, The Netherlands
39.
Zurück zum Zitat Baker FB (1992) Item response theory: Parameter estimation techniques. Marcel Dekker, New York Baker FB (1992) Item response theory: Parameter estimation techniques. Marcel Dekker, New York
41.
Zurück zum Zitat Crone MR, Vogels AG, Hoekstra F, Treffers PD, Reijneveld SA (2008) A comparison of four scoring methods based on the parent-rated strengths and difficulties questionnaire as used in the dutch preventive child health care system. BMC Public Health 8:106CrossRefPubMedPubMedCentral Crone MR, Vogels AG, Hoekstra F, Treffers PD, Reijneveld SA (2008) A comparison of four scoring methods based on the parent-rated strengths and difficulties questionnaire as used in the dutch preventive child health care system. BMC Public Health 8:106CrossRefPubMedPubMedCentral
42.
Zurück zum Zitat Zero To Three (2005) Diagnostic classification of mental health and development disorders in infancy and early childhood, (rev.ed.). Washington, DC: Zero To Three Press Zero To Three (2005) Diagnostic classification of mental health and development disorders in infancy and early childhood, (rev.ed.). Washington, DC: Zero To Three Press
Metadaten
Titel
Computerized adaptive testing to screen pre-school children for emotional and behavioral problems
verfasst von
Meinou H. C. Theunissen
Iris Eekhout
Sijmen A. Reijneveld
Publikationsdatum
22.01.2024
Verlag
Springer Berlin Heidelberg
Erschienen in
European Journal of Pediatrics / Ausgabe 4/2024
Print ISSN: 0340-6199
Elektronische ISSN: 1432-1076
DOI
https://doi.org/10.1007/s00431-023-05414-1

Weitere Artikel der Ausgabe 4/2024

European Journal of Pediatrics 4/2024 Zur Ausgabe

ADHS-Medikation erhöht das kardiovaskuläre Risiko

16.05.2024 Herzinsuffizienz Nachrichten

Erwachsene, die Medikamente gegen das Aufmerksamkeitsdefizit-Hyperaktivitätssyndrom einnehmen, laufen offenbar erhöhte Gefahr, an Herzschwäche zu erkranken oder einen Schlaganfall zu erleiden. Es scheint eine Dosis-Wirkungs-Beziehung zu bestehen.

Erstmanifestation eines Diabetes-Typ-1 bei Kindern: Ein Notfall!

16.05.2024 DDG-Jahrestagung 2024 Kongressbericht

Manifestiert sich ein Typ-1-Diabetes bei Kindern, ist das ein Notfall – ebenso wie eine diabetische Ketoazidose. Die Grundsäulen der Therapie bestehen aus Rehydratation, Insulin und Kaliumgabe. Insulin ist das Medikament der Wahl zur Behandlung der Ketoazidose.

Frühe Hypertonie erhöht späteres kardiovaskuläres Risiko

Wie wichtig es ist, pädiatrische Patienten auf Bluthochdruck zu screenen, zeigt eine kanadische Studie: Hypertone Druckwerte in Kindheit und Jugend steigern das Risiko für spätere kardiovaskuläre Komplikationen.

Betalaktam-Allergie: praxisnahes Vorgehen beim Delabeling

16.05.2024 Pädiatrische Allergologie Nachrichten

Die große Mehrheit der vermeintlichen Penicillinallergien sind keine. Da das „Etikett“ Betalaktam-Allergie oft schon in der Kindheit erworben wird, kann ein frühzeitiges Delabeling lebenslange Vorteile bringen. Ein Team von Pädiaterinnen und Pädiatern aus Kanada stellt vor, wie sie dabei vorgehen.

Update Pädiatrie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.