Skip to main content
Erschienen in:

30.09.2023 | Original Research Article

Automated Classification of Quality Defect Issues Relating to Substandard Medicines Using a Hybrid Machine Learning and Rule-Based Approach

verfasst von: Desmond Chun Hwee Teo, Yiting Huang, Sreemanee Raaj Dorajoo, Michelle Sau Yuen Ng, Chih Tzer Choong, Doris Sock Tin Phuah, Dorothy Hooi Myn Tan, Filina Meixuan Tan, Huilin Huang, Maggie Siok Hwee Tan, Suan Tian Koh, Jalene Wang Woon Poh, Pei San Ang

Erschienen in: Drug Safety | Ausgabe 10/2023

Einloggen, um Zugang zu erhalten

Abstract

Background and Objective

Substandard medicines can lead to serious safety issues affecting public health; however, the nature of such issues can be widely heterogeneous. Health product regulators seek to prioritise critical product quality defects for review to ensure that prompt risk mitigation measures are taken. This study aims to classify the nature of issues for substandard medicines using machine learning to augment a risk-based and timely review of cases.

Methods

A combined machine learning algorithm with a keyword-based model was developed to classify quality issues using text relating to substandard medicines (CISTERM). The nature of issues for product defect cases were classified based on Medical Dictionary for Regulatory Activities–Health Sciences Authority (MedDRA–HSA) lowest-level terms.

Results

Product defect cases received from January 2010 to December 2021 were used for training (n = 11,082) and for testing (n = 2771). The machine learning model achieved a good recall (precision) of 92% (96%) for ‘Product adulterated and/or contains prohibited substance’, 86% (90%) for ‘Out of specification or out of trend test result’ and 90% (91%) for ‘Manufacturing non-compliance’.

Conclusion

Post-market surveillance of substandard medicines remains a key activity for drug regulatory authorities. A combined machine learning algorithm with keyword-based model can help to prioritise the review of product quality defect issues in a timely manner.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat World Health Organization. A study on the public health and socioeconomic impact of substandard and falsified medical products. Geneva, Switzerland: World Health Organization; 2017. World Health Organization. A study on the public health and socioeconomic impact of substandard and falsified medical products. Geneva, Switzerland: World Health Organization; 2017.
3.
Zurück zum Zitat Medical Dictionary for Regulatory Activities. MedDRA® the Medical Dictionary for Regulatory Activities. In: International Conference on Harmonization of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH): MedDRA Maintenance and Support Services Organization (MSSO)) Version 24.0; 2021. Medical Dictionary for Regulatory Activities. MedDRA® the Medical Dictionary for Regulatory Activities. In: International Conference on Harmonization of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH): MedDRA Maintenance and Support Services Organization (MSSO)) Version 24.0; 2021.
4.
Zurück zum Zitat Ang PS, Teo DCH, Toh YL, et al. A risk classification model for prioritising the management of quality issues relating to substandard medicines in Singapore. Pharmacoepidemiol Drug Saf. 2022;31(7):729–38. https://doi.org/10.1002/pds.5434. Ang PS, Teo DCH, Toh YL, et al. A risk classification model for prioritising the management of quality issues relating to substandard medicines in Singapore. Pharmacoepidemiol Drug Saf. 2022;31(7):729–38. https://​doi.​org/​10.​1002/​pds.​5434.
6.
Zurück zum Zitat He H, Bai Y, Garcia EA, et al. ADASYN: Adaptive synthetic sampling approach for imbalanced learning. In: 2008 IEEE International Joint Conference on neural networks. 2008;1322−28. He H, Bai Y, Garcia EA, et al. ADASYN: Adaptive synthetic sampling approach for imbalanced learning. In: 2008 IEEE International Joint Conference on neural networks. 2008;1322−28.
8.
Zurück zum Zitat Mihalcea R, Tarau P. Textrank: Bringing order into text. In: Proceedings of the 2004 conference on empirical methods in natural language processing. 2004. Mihalcea R, Tarau P. Textrank: Bringing order into text. In: Proceedings of the 2004 conference on empirical methods in natural language processing. 2004.
Metadaten
Titel
Automated Classification of Quality Defect Issues Relating to Substandard Medicines Using a Hybrid Machine Learning and Rule-Based Approach
verfasst von
Desmond Chun Hwee Teo
Yiting Huang
Sreemanee Raaj Dorajoo
Michelle Sau Yuen Ng
Chih Tzer Choong
Doris Sock Tin Phuah
Dorothy Hooi Myn Tan
Filina Meixuan Tan
Huilin Huang
Maggie Siok Hwee Tan
Suan Tian Koh
Jalene Wang Woon Poh
Pei San Ang
Publikationsdatum
30.09.2023
Verlag
Springer International Publishing
Erschienen in
Drug Safety / Ausgabe 10/2023
Print ISSN: 0114-5916
Elektronische ISSN: 1179-1942
DOI
https://doi.org/10.1007/s40264-023-01339-8