Methods
In order to quantify the level of underreporting of CYP mental health services report to the HES dataset, we use the Clinical Research Practice Datalink (CPRD-Aurum) linked to HES inpatient and outpatient datasets. The CPRD records diagnoses, medications and other clinical events, including referrals and discharges from hospital. We identified 4,046,885 CYP, aged 5 to 17, who were eligible for linkage to HES and registered at a CPRD-Aurum participating practice over the period 1 January 2007 to 31 December 2017. We selected observations in the CPRD which have been coded as “Seen in child and adolescent psychiatry clinic” or “Seen by child and adolescent psychiatrist”. We included only those events occurring over the age range 5 to 17 and between 2007 and 2017. When children had more than one event, the first was selected. This resulted in a cohort of 15,726 CYP. We then calculated the proportion of these who had an inpatient or outpatient HES records in the year before this event, where the clinical speciality was “Child and Adolescent Psychiatry”. This was our main measure, which we interpret as the proportion of CYP mental health specialists that report to HES.
As a sensitivity analysis, we expanded the capture window to 2 years before and included other clinical specialties: “Adult Mental Illness”, “Forensic Psychiatry”, “Paediatric Neurology”, “Paediatrics”, “Medical Psychotherapy”, “Neurology”. These clinical specialisms emulate other specialisms included in the analysis by Jack et al. [
1]. As a further sensitivity, we restricted to events that occurred in the CPRD from 1 April 2009 onwards as data quality in the HES outpatient dataset has been reported to be better from April 2008 [
2].
Results
Of 15,726 CYP with a contact with a CYP psychiatrist, only 27.5% (
n = 4325) were matched to a HES record in the year before, where the clinical speciality was ‘Child and Adolescent Psychiatry’ (Table
1). Following expansion to other specialists, the rate of matches increased to 49.0%. By widening the data capture window to 2 years prior, the rates of matches increased to 29.8% and 56.0%.
Table 1
Rates of matches between CPRD records where there was a record of contact with child and adolescent psychiatrist, and HES records [95% CI]
Capture window | 1 year | 27.5 [26.8, 28.2] | 49.0 [48.3, 49.8] |
2 years | 29.8 [29.1, 30.5] | 56.0 [55.2, 56.8] |
Discussion
We report that, in England, between three quarters and a half of contacts with specialist CYP mental health services are not reported in national hospital data. We conclude, therefore, that the paper by Jack et al [
1]. considerably underestimates the true rate of contacts with specialist CYP mental health services for children and adolescents who are prescribed antidepressants, and the implication that general practitioners (GPs) are initiating antidepressants in children and young people in the majority of cases is simply wrong.
Whilst some CYP may be prescribed antidepressants against clinical guidelines, the figure of only 25% seeing a specialist is inaccurate and unnecessarily alarmist. From our analysis, if we apply the figure of 27.5% of CYP mental health services being in the HES dataset, then we could estimate that the figure is closer to
\(25/0.275\) = 91%, which fits more closely to our clinical experience. Given that we use a different primary care dataset to Jack et al., further checks are needed to ascertain that our estimate applies to their sample. Otherwise, it may be possible to re-do their analysis, using a sample of primary care practices where we know that data are being reported to HES. Whilst this task may be challenging given the quality of the data at hand, getting the true figure correct is important, as the findings have significant public interest, demonstrated by the results by Jack et al. being repeated in a report by the National Institute for Health and Care Research [
3] and subsequently picked up in the national media [
4,
5]. Having inaccurate statistics serves nobody and is likely to cause unwarranted alarm amongst the public and policymakers and confusion and upset amongst GPs who do follow guidelines.
Our analysis also demonstrates a significant data gap. Whilst data are not routinely reported from specialist CYP mental health services to the HES dataset, they are reported to a separate national dataset, the Mental Health Services Dataset (MHSDS) [
6]. However, there are significant data quality issues with this dataset, and, because of this, linkage between this and the CPRD has been withdrawn. Whilst analysis of the MHSDS has helped show trends in referrals to specialist mental health services, the poor quality of recording of patient characteristics and lack of linkage to other datasets severely limits its utility [
6]. In particular, there is a gap in our understanding of who is being seen in services and what their long-term outcomes are. Better quality data and linkage is vital if we are to tackle significant public health challenges, such as the current crisis in CYP mental health treatment.
Acknowledgements
This study is based on data from the Clinical Practice Research Datalink obtained under licence from the UK Medicines and Healthcare products Regulatory Agency. The data are provided by patients and collected by the NHS as part of their care and support. We would like to acknowledge all the data providers, patients and general practices that made the anonymised data available for research.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit
http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (
http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.