Skip to main content

26.03.2024 | Original Article

Prioritizing a high posterior probability threshold leading to low error rate over high classification accuracy: the validity of MorphoPASSE software for cranial morphological sex estimation in a contemporary population

verfasst von: Anežka Pilmann Kotěrová, Frédéric Santos, Šárka Bejdová, Rebeka Rmoutilová, MennattAllah Hassan Attia, Ahmed Habiba, Jana Velemínská, Jaroslav Brůžek

Erschienen in: International Journal of Legal Medicine

Einloggen, um Zugang zu erhalten

Abstract

An increasing number of software tools can be used in forensic anthropology to estimate a biological profile, but further studies in other populations are required for more robust validation. The present study aimed to evaluate the validity of MorphoPASSE software for sex estimation from sexually dimorphic cranial traits recorded on 3D CT models (n = 180) from three populations samples (Czech, French, and Egyptian). Two independent observers performed scoring of 4 cranial traits (2 of them bilateral) in each population sample of 30 males and 30 females. The accuracy of sex estimation using traditional posterior probability threshold (pp = 0.5) ranged from 85.6% to 88.3% and overall classification error from 14.4% to 11.7% for both observers, and corresponds to the previously published values of the method. The MorphoPASSE method is also affected by the subjectivity of the observers, as both observers show agreement in sex assignment in 83.9% of cases, regardless of the accuracy of the estimates. Applying a higher posterior probability threshold (pp 0.95) provided classification accuracy of 97.9% and 93.3% of individuals (for observer A and B respectively), minimizing the risk of error to 2.1% and 6.7%, respectively. However, sex estimation can only be applied to 54% and 66% of individuals, respectively. Our results demonstrate the validity of the MorphoPASSE software for cranial sex estimation outside the reference population. However, the achieved classification success is accompanied by a high risk of errors, the reduction of which is only possible by increasing the posterior probability threshold.
Literatur
1.
Zurück zum Zitat Acsádi G, Nemeskéri J (1970) History of human life span and mortality. Akademiai Kiado, Budapest Acsádi G, Nemeskéri J (1970) History of human life span and mortality. Akademiai Kiado, Budapest
5.
Zurück zum Zitat Attia MH, Kholief MA, Zaghloul NM et al (2022b) Efficiency of the Adjusted Binary Classification (ABC) approach in osteometric sex estimation: a comparative study of different linear machine learning algorithms and training sample sizes. Biology (Basel) 11:917PubMed Attia MH, Kholief MA, Zaghloul NM et al (2022b) Efficiency of the Adjusted Binary Classification (ABC) approach in osteometric sex estimation: a comparative study of different linear machine learning algorithms and training sample sizes. Biology (Basel) 11:917PubMed
9.
Zurück zum Zitat Baumgarten SE, Kenyon-Flatt B (2020) Metric methods for estimating sex utilizing the pelvis. In: Klales A (ed) Sex estimation of the human skeleton. Academic Press, pp 171–184CrossRef Baumgarten SE, Kenyon-Flatt B (2020) Metric methods for estimating sex utilizing the pelvis. In: Klales A (ed) Sex estimation of the human skeleton. Academic Press, pp 171–184CrossRef
10.
Zurück zum Zitat Bertsatos A, Chovalopoulou ME, Brůžek J, Bejdová Š (2020) Advanced procedures for skull sex estimation using sexually dimorphic morphometric features. Int J Legal Med 134:1927–1937CrossRefPubMed Bertsatos A, Chovalopoulou ME, Brůžek J, Bejdová Š (2020) Advanced procedures for skull sex estimation using sexually dimorphic morphometric features. Int J Legal Med 134:1927–1937CrossRefPubMed
11.
Zurück zum Zitat Bertsatos A, Christaki A, Chovalopoulou ME (2019) Testing the reliability of 3D-ID software in sex and ancestry estimation with a modern Greek sample. Forensic Sci Int 297:132–137CrossRefPubMed Bertsatos A, Christaki A, Chovalopoulou ME (2019) Testing the reliability of 3D-ID software in sex and ancestry estimation with a modern Greek sample. Forensic Sci Int 297:132–137CrossRefPubMed
12.
Zurück zum Zitat Boucherie A (2023) Analyse du dimorphisme sexuel de variables métriques de la base du crâne: intérêts archéo-anthropologiques et forensiques. Dissertation. Université Libre de Bruxelles Boucherie A (2023) Analyse du dimorphisme sexuel de variables métriques de la base du crâne: intérêts archéo-anthropologiques et forensiques. Dissertation. Université Libre de Bruxelles
13.
Zurück zum Zitat Boyd C, Boyd D (2018) Forensic anthropology: theoretical framework and scientific basis. John Wiley & Sons, HobokenCrossRef Boyd C, Boyd D (2018) Forensic anthropology: theoretical framework and scientific basis. John Wiley & Sons, HobokenCrossRef
14.
Zurück zum Zitat Brennan EJ (2023) Differential adult mortality risk from late medieval to early modern Berlin: health consequences at the intersection of urban growth and climate change. Am J Biol Anthropol 180:21 Brennan EJ (2023) Differential adult mortality risk from late medieval to early modern Berlin: health consequences at the intersection of urban growth and climate change. Am J Biol Anthropol 180:21
15.
Zurück zum Zitat Brůžek J, Murail P (2006) Methodology and reliability of sex determination from the skeleton. In: Schmitt A, Cunha E, Pinheiro J (eds) Forensic anthropology and medicine: complementary sciences from recovery to cause of death. Humana Press Inc., Totowa, pp 225–242CrossRef Brůžek J, Murail P (2006) Methodology and reliability of sex determination from the skeleton. In: Schmitt A, Cunha E, Pinheiro J (eds) Forensic anthropology and medicine: complementary sciences from recovery to cause of death. Humana Press Inc., Totowa, pp 225–242CrossRef
17.
Zurück zum Zitat Buikstra JE, Ubelaker DH (1994) Standards for data collection from human skeletal remains : proceedings of a seminar at the Field Museum of Natural History, organized by Jonathan Haas. Archeological Survey Buikstra JE, Ubelaker DH (1994) Standards for data collection from human skeletal remains : proceedings of a seminar at the Field Museum of Natural History, organized by Jonathan Haas. Archeological Survey
18.
Zurück zum Zitat Byrnes JF, Torres SEM, Johnson LJ et al (2023) New tricks, old bones, reassessing assigned sex at birth estimations of the Erie County Poorhouse cemetery using MorphoPASSE. Am J Biol Anthropol 180:24 Byrnes JF, Torres SEM, Johnson LJ et al (2023) New tricks, old bones, reassessing assigned sex at birth estimations of the Erie County Poorhouse cemetery using MorphoPASSE. Am J Biol Anthropol 180:24
19.
Zurück zum Zitat Cappella A, Bertoglio B, Di Maso M et al (2022) Sexual dimorphism of cranial morphological traits in an italian sample: a population-specific logistic regression model for predicting sex. Biology (Basel) 11:1202PubMed Cappella A, Bertoglio B, Di Maso M et al (2022) Sexual dimorphism of cranial morphological traits in an italian sample: a population-specific logistic regression model for predicting sex. Biology (Basel) 11:1202PubMed
20.
Zurück zum Zitat Cohen J (1968) Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit. Psychol Bull 70:213–220CrossRefPubMed Cohen J (1968) Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit. Psychol Bull 70:213–220CrossRefPubMed
21.
Zurück zum Zitat Daubert v. Merrell Dow Pharmaceuticals (1993) Daubert v. Merrell Dow Pharmaceuticals Daubert v. Merrell Dow Pharmaceuticals (1993) Daubert v. Merrell Dow Pharmaceuticals
23.
Zurück zum Zitat Dirkmaat, Cabo LL (2012) Forensic anthropology: embracing the new paradigm. In: Dirkmaat DC (ed) A companion to forensic anthropology. Wiley, Ltd, pp 3–40 Dirkmaat, Cabo LL (2012) Forensic anthropology: embracing the new paradigm. In: Dirkmaat DC (ed) A companion to forensic anthropology. Wiley, Ltd, pp 3–40
25.
Zurück zum Zitat Ferembach D, Schwidetzky I, Stloukal M (1980) Recommendations for age and sex diagnoses of skeletons. J Hum Evol 9:517–549CrossRef Ferembach D, Schwidetzky I, Stloukal M (1980) Recommendations for age and sex diagnoses of skeletons. J Hum Evol 9:517–549CrossRef
27.
Zurück zum Zitat Galeta P, Brůžek J (2020) Sex estimation using continuous variables: problems and principles of sex classification in the zone of uncertainty. In: Obertová Z, Stewart A, Cattaneo C (eds) Statistics and probability in forensic anthropology. Academic Press, pp 155–182CrossRef Galeta P, Brůžek J (2020) Sex estimation using continuous variables: problems and principles of sex classification in the zone of uncertainty. In: Obertová Z, Stewart A, Cattaneo C (eds) Statistics and probability in forensic anthropology. Academic Press, pp 155–182CrossRef
28.
Zurück zum Zitat Garvin (2020) Adult sex estimation from cranial morphological traits. In: Klales A (ed) Sex estimation of the human skeleton. Academic Press, pp 95–112CrossRef Garvin (2020) Adult sex estimation from cranial morphological traits. In: Klales A (ed) Sex estimation of the human skeleton. Academic Press, pp 95–112CrossRef
29.
Zurück zum Zitat Garvin HM, Uhl N, Passalacqua NV et al (2012) Developments in forensic anthropology: age at- death estimation. In: Dirkmaat DC (ed) A companion to forensic anthropology, first. Wiley-Blackwell, London, pp 202–223CrossRef Garvin HM, Uhl N, Passalacqua NV et al (2012) Developments in forensic anthropology: age at- death estimation. In: Dirkmaat DC (ed) A companion to forensic anthropology, first. Wiley-Blackwell, London, pp 202–223CrossRef
30.
Zurück zum Zitat Garvin, Klales A (2020) Adult skeletal sex estimation and global standardization. In: Parra R, Zapico S, Ubelaker D (eds) Forensic science and humanitarian action: interacting with the dead and the living. Wiley, Ltd, pp 109–209 Garvin, Klales A (2020) Adult skeletal sex estimation and global standardization. In: Parra R, Zapico S, Ubelaker D (eds) Forensic science and humanitarian action: interacting with the dead and the living. Wiley, Ltd, pp 109–209
31.
Zurück zum Zitat Garvin, Sholts S, Mosca L (2014) Sexual dimorphism in human cranial trait scores: effects of population, age, and body size. Am J Phys Anthropol 154:259–269CrossRefPubMed Garvin, Sholts S, Mosca L (2014) Sexual dimorphism in human cranial trait scores: effects of population, age, and body size. Am J Phys Anthropol 154:259–269CrossRefPubMed
33.
Zurück zum Zitat Grivas CR, Komar DA (2008) Kumho, Daubert, and the nature of scientific inquiry: Implications for forensic anthropology. J Forensic Sci 53:771–776CrossRefPubMed Grivas CR, Komar DA (2008) Kumho, Daubert, and the nature of scientific inquiry: Implications for forensic anthropology. J Forensic Sci 53:771–776CrossRefPubMed
34.
Zurück zum Zitat Guyomarc’h, Brůžek J (2011) Accuracy and reliability in sex determination from skulls: a comparison of Fordisc® 3.0 and the discriminant function analysis. Forensic Sci Int 208:180-e1CrossRef Guyomarc’h, Brůžek J (2011) Accuracy and reliability in sex determination from skulls: a comparison of Fordisc® 3.0 and the discriminant function analysis. Forensic Sci Int 208:180-e1CrossRef
35.
Zurück zum Zitat Jantz RL, Ousley SD (2005) FORDISC 3: computerized forensic discriminant functions. Version 3.0. The University of Tennessee, Knoxville Jantz RL, Ousley SD (2005) FORDISC 3: computerized forensic discriminant functions. Version 3.0. The University of Tennessee, Knoxville
37.
Zurück zum Zitat Jerković I, Bašić Ž, Kružić I, Anđelinović Š (2018) Creating reference data on sex for ancient populations using the Probabilistic Sex Diagnosis method: a validation test using the results of aDNA analysis. J Archaeol Sci 94:44–50CrossRef Jerković I, Bašić Ž, Kružić I, Anđelinović Š (2018) Creating reference data on sex for ancient populations using the Probabilistic Sex Diagnosis method: a validation test using the results of aDNA analysis. J Archaeol Sci 94:44–50CrossRef
39.
Zurück zum Zitat Klales A (2020a) MorphoPASSE: morphological pelvis and skull sex estimation program. In: Klales A (ed) Sex estimation of the human skeleton. Academic Press, pp 271–278CrossRef Klales A (2020a) MorphoPASSE: morphological pelvis and skull sex estimation program. In: Klales A (ed) Sex estimation of the human skeleton. Academic Press, pp 271–278CrossRef
40.
Zurück zum Zitat Klales A (2018a) MorphoPASSE: the morphological pelvis and skull sex estimation database. Version 1.0. Washburn, University, Topeka Klales A (2018a) MorphoPASSE: the morphological pelvis and skull sex estimation database. Version 1.0. Washburn, University, Topeka
41.
Zurück zum Zitat Klales A (2020b) Practitioner preferences for sex estimation from human skeletal remains. In: Klales A (ed) Sex Estimation of the Human Skeleton. Academic Press, pp 11–23CrossRef Klales A (2020b) Practitioner preferences for sex estimation from human skeletal remains. In: Klales A (ed) Sex Estimation of the Human Skeleton. Academic Press, pp 11–23CrossRef
42.
Zurück zum Zitat Klales A, Cole S (2018) MorphoPASSE: the morphological pelvis and skull sex estimation database manual. Version 1.0. Washburn, University, Topeka Klales A, Cole S (2018) MorphoPASSE: the morphological pelvis and skull sex estimation database manual. Version 1.0. Washburn, University, Topeka
43.
Zurück zum Zitat Klales AR (2018b) Introducing MorphoPASSE: the morphological pelvis and skull sex estimation database. In: Proceedings of the 70th Annual Scientific Meeting of the American Academy of Forensic Sciences in Seattle. Wa Klales AR (2018b) Introducing MorphoPASSE: the morphological pelvis and skull sex estimation database. In: Proceedings of the 70th Annual Scientific Meeting of the American Academy of Forensic Sciences in Seattle. Wa
44.
Zurück zum Zitat Klales AR, Ousley SD, Vollner JM (2012) A revised method of sexing the human innominate using Phenice’s nonmetric traits and statistical methods. Am J Phys Anthropol 149:104–114CrossRefPubMed Klales AR, Ousley SD, Vollner JM (2012) A revised method of sexing the human innominate using Phenice’s nonmetric traits and statistical methods. Am J Phys Anthropol 149:104–114CrossRefPubMed
45.
Zurück zum Zitat Kotěrová A, Rmoutilová R, Brůžek J (2022) Current trends in methods for estimating age and sex from the adult human skeleton. Anthropologie 60:225–252CrossRef Kotěrová A, Rmoutilová R, Brůžek J (2022) Current trends in methods for estimating age and sex from the adult human skeleton. Anthropologie 60:225–252CrossRef
46.
Zurück zum Zitat Kotěrová A, Velemínská J, Dupej J et al (2016) Disregarding population specificity: its influence on the sex assessment methods from the tibia. Int J Legal Med 131:251–261CrossRefPubMed Kotěrová A, Velemínská J, Dupej J et al (2016) Disregarding population specificity: its influence on the sex assessment methods from the tibia. Int J Legal Med 131:251–261CrossRefPubMed
48.
Zurück zum Zitat Krishan K, Chatterjee PM, Kanchan T et al (2016) A review of sex estimation techniques during examination of skeletal remains in forensic anthropology casework. Forensic Sci Int 261:165.e1-165.e8CrossRefPubMed Krishan K, Chatterjee PM, Kanchan T et al (2016) A review of sex estimation techniques during examination of skeletal remains in forensic anthropology casework. Forensic Sci Int 261:165.e1-165.e8CrossRefPubMed
50.
Zurück zum Zitat Lesciotto K (2015) The impact of Daubert on the admissibility of forensic anthropology expert testimony. J Forensic Sci 60:549–555CrossRefPubMed Lesciotto K (2015) The impact of Daubert on the admissibility of forensic anthropology expert testimony. J Forensic Sci 60:549–555CrossRefPubMed
51.
Zurück zum Zitat Lewis, Garvin HM (2016) Reliability of the Walker cranial nonmetric method and implications for sex estimation. J Forensic Sci 61:743–751CrossRefPubMed Lewis, Garvin HM (2016) Reliability of the Walker cranial nonmetric method and implications for sex estimation. J Forensic Sci 61:743–751CrossRefPubMed
55.
Zurück zum Zitat Murail P, Brůžek J, Houët F, Cunha E (2005) DSP: a tool for probabilistic sex diagnosis using worldwide variability in hip-bone measurements. Bull Mém Soc Anthropol Paris 17:167–176CrossRef Murail P, Brůžek J, Houët F, Cunha E (2005) DSP: a tool for probabilistic sex diagnosis using worldwide variability in hip-bone measurements. Bull Mém Soc Anthropol Paris 17:167–176CrossRef
56.
Zurück zum Zitat Nikita E, Michopoulou E (2018) A quantitative approach for sex estimation based on cranial morphology. Am J Phys Anthropol 165:507–517CrossRefPubMed Nikita E, Michopoulou E (2018) A quantitative approach for sex estimation based on cranial morphology. Am J Phys Anthropol 165:507–517CrossRefPubMed
57.
Zurück zum Zitat Oikonomopoulou EK, Valakos E, Nikita E (2017) Population-specificity of sexual dimorphism in cranial and pelvic traits: evaluation of existing and proposal of new functions for sex assessment in a Greek assemblage. Int J Legal Med 131:1731–1738CrossRefPubMed Oikonomopoulou EK, Valakos E, Nikita E (2017) Population-specificity of sexual dimorphism in cranial and pelvic traits: evaluation of existing and proposal of new functions for sex assessment in a Greek assemblage. Int J Legal Med 131:1731–1738CrossRefPubMed
58.
Zurück zum Zitat Phenice T (1969) A newly developed visual method of sexing the os pubis. Am J Phys Anthropol 30:297–301CrossRefPubMed Phenice T (1969) A newly developed visual method of sexing the os pubis. Am J Phys Anthropol 30:297–301CrossRefPubMed
59.
Zurück zum Zitat R Core Team (2023) R: a language and environment for statistical computing R Core Team (2023) R: a language and environment for statistical computing
60.
Zurück zum Zitat Ramsthaler F, Kreutz K, Verhoff MA (2007) Accuracy of metric sex analysis of skeletal remains using Fordisc® based on a recent skull collection. Int J Legal Med 121:477–482CrossRefPubMed Ramsthaler F, Kreutz K, Verhoff MA (2007) Accuracy of metric sex analysis of skeletal remains using Fordisc® based on a recent skull collection. Int J Legal Med 121:477–482CrossRefPubMed
61.
Zurück zum Zitat Santos F (2021) rdss: an R package to facilitate the use of Murail et al’.s (1999) approach of sex estimation in past populations. Int J Osteoarchaeol 31:382–392CrossRef Santos F (2021) rdss: an R package to facilitate the use of Murail et al’.s (1999) approach of sex estimation in past populations. Int J Osteoarchaeol 31:382–392CrossRef
62.
Zurück zum Zitat Slice DE, Ross A (2009) 3D-ID: geometric morphometric classification of crania for forensic scientists. Proc Natl Acad Sci USA 106:2124–2129PubMedPubMedCentral Slice DE, Ross A (2009) 3D-ID: geometric morphometric classification of crania for forensic scientists. Proc Natl Acad Sci USA 106:2124–2129PubMedPubMedCentral
63.
Zurück zum Zitat Stevenson JC, Mahoney ER, Walker PL, Everson PM (2009) Prediction of sex based on five skull traits using decision analysis (CHAID). Am J Phys Anthropol 139:434–441CrossRefPubMed Stevenson JC, Mahoney ER, Walker PL, Everson PM (2009) Prediction of sex based on five skull traits using decision analysis (CHAID). Am J Phys Anthropol 139:434–441CrossRefPubMed
65.
Zurück zum Zitat Tallman S (2019) Cranial nonmetric sexual dimorphism and sex estimation in East and Southeast Asian individuals. Forensic Anthropol 4:204–221 Tallman S (2019) Cranial nonmetric sexual dimorphism and sex estimation in East and Southeast Asian individuals. Forensic Anthropol 4:204–221
69.
Zurück zum Zitat Urbanová P, Ross AH, Jurda M, Nogueira MI (2014) Testing the reliability of software tools in sex and ancestry estimation in a multi-ancestral Brazilian sample. Leg Med 16:264–273CrossRef Urbanová P, Ross AH, Jurda M, Nogueira MI (2014) Testing the reliability of software tools in sex and ancestry estimation in a multi-ancestral Brazilian sample. Leg Med 16:264–273CrossRef
70.
Zurück zum Zitat Vargas DS, St John ME, Garcia-Bernabe JR, DiGangi EA (2022) MorphoPASSE skull sexing error. Am J Biol Anthropol 177:159–160 Vargas DS, St John ME, Garcia-Bernabe JR, DiGangi EA (2022) MorphoPASSE skull sexing error. Am J Biol Anthropol 177:159–160
72.
Zurück zum Zitat Walrath D, Turner P, Bruzek J (2004) Reliability test of the visual assessment of cranial traits for sex determination. Am J Phys Anthr 125:132–137CrossRef Walrath D, Turner P, Bruzek J (2004) Reliability test of the visual assessment of cranial traits for sex determination. Am J Phys Anthr 125:132–137CrossRef
75.
Zurück zum Zitat Zejdlik K, Nyárádi Z, Gonciar A (2021) Evidence of horsemanship in two Szekler noblemen from the Baroque period. Int J Osteoarchaeol 31:66–76CrossRef Zejdlik K, Nyárádi Z, Gonciar A (2021) Evidence of horsemanship in two Szekler noblemen from the Baroque period. Int J Osteoarchaeol 31:66–76CrossRef
Metadaten
Titel
Prioritizing a high posterior probability threshold leading to low error rate over high classification accuracy: the validity of MorphoPASSE software for cranial morphological sex estimation in a contemporary population
verfasst von
Anežka Pilmann Kotěrová
Frédéric Santos
Šárka Bejdová
Rebeka Rmoutilová
MennattAllah Hassan Attia
Ahmed Habiba
Jana Velemínská
Jaroslav Brůžek
Publikationsdatum
26.03.2024
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Legal Medicine
Print ISSN: 0937-9827
Elektronische ISSN: 1437-1596
DOI
https://doi.org/10.1007/s00414-024-03215-1

Neu im Fachgebiet Rechtsmedizin

Molekularpathologische Untersuchungen im Wandel der Zeit

Open Access Biomarker Leitthema

Um auch an kleinen Gewebeproben zuverlässige und reproduzierbare Ergebnisse zu gewährleisten ist eine strenge Qualitätskontrolle in jedem Schritt des Arbeitsablaufs erforderlich. Eine nicht ordnungsgemäße Prüfung oder Behandlung des …

Vergleichende Pathologie in der onkologischen Forschung

Pathologie Leitthema

Die vergleichende experimentelle Pathologie („comparative experimental pathology“) ist ein Fachbereich an der Schnittstelle von Human- und Veterinärmedizin. Sie widmet sich der vergleichenden Erforschung von Gemeinsamkeiten und Unterschieden von …

Gastrointestinale Stromatumoren

Open Access GIST CME-Artikel

Gastrointestinale Stromatumoren (GIST) stellen seit über 20 Jahren ein Paradigma für die zielgerichtete Therapie mit Tyrosinkinaseinhibitoren dar. Eine elementare Voraussetzung für eine mögliche neoadjuvante oder adjuvante Behandlung bei …

Personalisierte Medizin in der Onkologie

Aufgrund des erheblichen technologischen Fortschritts in der molekularen und genetischen Diagnostik sowie zunehmender Erkenntnisse über die molekulare Pathogenese von Krankheiten hat in den letzten zwei Jahrzehnten ein grundlegender …