Age estimation in forensic anthropology: methodological considerations about the validation studies of prediction models

There is currently no clear consensus on how to calculate, express, and interpret the error when validating methods for age estimation in forensic anthropology. For this reason, it is likely that researchers are commonly drawing erroneous or confusing conclusions about the existence of population differences or the need to design new and increasingly complex estimation methods. In recent years, many researchers have highlighted these limitations. They propose new lines of research focused on the use of rigorous statistics and new technologies for the development of methods for estimating age. Our main objective in this study is to contribute to the strengthening of these novel ideas, for which we show the existing empirical evidence about the inadequacy of some age estimation methods in calculating, expressing, and interpreting the errors obtained. With this aim, a total of 500 simulations have been performed, in which hypothetical research teams develop and validate methods for age estimation. The data employed in this study was obtained from the “Centers for Disease Control and Prevention (CDC) Growth Charts: United States” released in 2000. The charts relate age with height, weight, and head circumference of US male children. Five learning algorithms have been employed as age estimators. We have performed three experiments in which the following aspects have been analyzed: frequency with which “negative” results can be obtained in the validation studies; which are the most appropriate criteria to compare and select the age estimation methods; and what analysis should be employed to carry out the validation studies. The results show possible errors in the interpretation of validation studies as a consequence of the confusion of statistical concepts. To conclude, we made a proposal of “good practices” for the correct calculation, expression, and interpretation of the error when validating age estimation methods in forensic anthropology.