Skip to main content
Erschienen in: Medicine, Health Care and Philosophy 1/2020

29.07.2019 | Scientific Contribution

The right to refuse diagnostics and treatment planning by artificial intelligence

verfasst von: Thomas Ploug, Søren Holm

Erschienen in: Medicine, Health Care and Philosophy | Ausgabe 1/2020

Einloggen, um Zugang zu erhalten

Abstract

In an analysis of artificially intelligent systems for medical diagnostics and treatment planning we argue that patients should be able to exercise a right to withdraw from AI diagnostics and treatment planning for reasons related to (1) the physician’s role in the patients’ formation of and acting on personal preferences and values, (2) the bias and opacity problem of AI systems, and (3) rational concerns about the future societal effects of introducing AI systems in the health care sector.
Fußnoten
1
In this paper we use the term ‘AI systems’ to cover both systems based on ‘symbolic AI’ and systems based on machine learning techniques such as deep learning and neural networks.
 
2
In this paper we use the term ‘physician’. Diagnostic and treatment decisions are also made by many other types of health care professionals, but we are focusing on medical doctors because they are involved in many of these decisions.
 
3
There is a parallel issue raised by AI controlled treatment, e.g. AI controlled surgical robots, but this is outside the scope of this paper.
 
Literatur
Zurück zum Zitat Bedi, G., F. Carrillo, G.A. Cecchi, D.F. Slezak, M. Sigman, N.B. Mota, et al. 2015. Automated Analysis of Free Speech Predicts Psychosis Onset in High-Risk Youths. npj Schizophrenia 1: 15030.CrossRef Bedi, G., F. Carrillo, G.A. Cecchi, D.F. Slezak, M. Sigman, N.B. Mota, et al. 2015. Automated Analysis of Free Speech Predicts Psychosis Onset in High-Risk Youths. npj Schizophrenia 1: 15030.CrossRef
Zurück zum Zitat Bird, S., S. Barocas, K. Crawford, F. Diaz, H. Wallach. 2016. Exploring or Exploiting? Social and Ethical Implications of Autonomous Experimentation in AI. Rochester: Social Science Research Network. Report No.: ID 2846909. https://papers.ssrn.com/abstract=2846909. Accessed 29 May 2018. Bird, S., S. Barocas, K. Crawford, F. Diaz, H. Wallach. 2016. Exploring or Exploiting? Social and Ethical Implications of Autonomous Experimentation in AI. Rochester: Social Science Research Network. Report No.: ID 2846909. https://​papers.​ssrn.​com/​abstract=​2846909. Accessed 29 May 2018.
Zurück zum Zitat Bostrom, N. 2014. Superintelligence: Paths, Dangers, Strategies, 352. Oxford, New York: Oxford University Press. Bostrom, N. 2014. Superintelligence: Paths, Dangers, Strategies, 352. Oxford, New York: Oxford University Press.
Zurück zum Zitat Bostrom, N. 2017. Strategic Implications of Openness in AI Development. Global Policy 8 (2): 135–148.CrossRef Bostrom, N. 2017. Strategic Implications of Openness in AI Development. Global Policy 8 (2): 135–148.CrossRef
Zurück zum Zitat Bozdag, E. 2013. Bias in Algorithmic Filtering and Personalization. Ethics and Information Technology 15 (3): 209–227.CrossRef Bozdag, E. 2013. Bias in Algorithmic Filtering and Personalization. Ethics and Information Technology 15 (3): 209–227.CrossRef
Zurück zum Zitat Burrell, J. 2016. How the Machine ‘Thinks’: Understanding Opacity in Machine Learning Algorithms. Big Data & Society 3 (1): 2053951715622512.CrossRef Burrell, J. 2016. How the Machine ‘Thinks’: Understanding Opacity in Machine Learning Algorithms. Big Data & Society 3 (1): 2053951715622512.CrossRef
Zurück zum Zitat Cabitza, F., R. Rasoini, and G.F. Gensini. 2017. Unintended Consequences of Machine Learning in Medicine. JAMA 318 (6): 517–518.CrossRef Cabitza, F., R. Rasoini, and G.F. Gensini. 2017. Unintended Consequences of Machine Learning in Medicine. JAMA 318 (6): 517–518.CrossRef
Zurück zum Zitat Calders, T., and S. Verwer. 2010. Three Naive Bayes Approaches for Discrimination-Free Classification. Data Mining and Knowledge Discovery 21 (2): 277–292.CrossRef Calders, T., and S. Verwer. 2010. Three Naive Bayes Approaches for Discrimination-Free Classification. Data Mining and Knowledge Discovery 21 (2): 277–292.CrossRef
Zurück zum Zitat Dilsizian, S.E., and E.L. Siegel. 2014. Artificial Intelligence in Medicine and Cardiac Imaging: Harnessing Big Data and Advanced Computing to Provide Personalized Medical Diagnosis and Treatment. Current Cardiology Reports 16 (1): 441.CrossRef Dilsizian, S.E., and E.L. Siegel. 2014. Artificial Intelligence in Medicine and Cardiac Imaging: Harnessing Big Data and Advanced Computing to Provide Personalized Medical Diagnosis and Treatment. Current Cardiology Reports 16 (1): 441.CrossRef
Zurück zum Zitat Dunbar-Jacob, J., and M.K. Mortimer-Stephens. 2001. Treatment Adherence in Chronic Disease. Journal of Clinical Epidemiology 54 (12, Supplement 1): S57–S60.CrossRef Dunbar-Jacob, J., and M.K. Mortimer-Stephens. 2001. Treatment Adherence in Chronic Disease. Journal of Clinical Epidemiology 54 (12, Supplement 1): S57–S60.CrossRef
Zurück zum Zitat Esteva, A., B. Kuprel, R.A. Novoa, J. Ko, S.M. Swetter, H.M. Blau, et al. 2017. Dermatologist-Level Classification of Skin Cancer with Deep Neural Networks. Nature 542 (7639): 115–118.CrossRef Esteva, A., B. Kuprel, R.A. Novoa, J. Ko, S.M. Swetter, H.M. Blau, et al. 2017. Dermatologist-Level Classification of Skin Cancer with Deep Neural Networks. Nature 542 (7639): 115–118.CrossRef
Zurück zum Zitat Friedman, B., and H. Nissenbaum. 1996. Bias in Computer Systems. ACM Transactions on Information Systems 14 (3): 330–347.CrossRef Friedman, B., and H. Nissenbaum. 1996. Bias in Computer Systems. ACM Transactions on Information Systems 14 (3): 330–347.CrossRef
Zurück zum Zitat Goddard, K., A. Roudsari, and J.C. Wyatt. 2012. Automation Bias: A Systematic Review of Frequency, Effect Mediators, and Mitigators. Journal of the American Medical Informatics Association 19 (1): 121–127.CrossRef Goddard, K., A. Roudsari, and J.C. Wyatt. 2012. Automation Bias: A Systematic Review of Frequency, Effect Mediators, and Mitigators. Journal of the American Medical Informatics Association 19 (1): 121–127.CrossRef
Zurück zum Zitat Goddard, K., A. Roudsari, and J.C. Wyatt. 2014. Automation Bias: Empirical Results Assessing Influencing Factors. International Journal of Medical Informatics 83 (5): 368–375.CrossRef Goddard, K., A. Roudsari, and J.C. Wyatt. 2014. Automation Bias: Empirical Results Assessing Influencing Factors. International Journal of Medical Informatics 83 (5): 368–375.CrossRef
Zurück zum Zitat Habermas, J. 2018. Inclusion of the Other: Studies in Political Theory, 341. Hoboken: Wiley. Habermas, J. 2018. Inclusion of the Other: Studies in Political Theory, 341. Hoboken: Wiley.
Zurück zum Zitat Hoff, T. 2011. Deskilling and Adaptation Among Primary Care Physicians Using Two Work Innovations. Health Care Management Review 36 (4): 338–348.CrossRef Hoff, T. 2011. Deskilling and Adaptation Among Primary Care Physicians Using Two Work Innovations. Health Care Management Review 36 (4): 338–348.CrossRef
Zurück zum Zitat Ipsos, M.O.R.I. 2017. Public Views of Machine Learning. Report Title:92. Ipsos, M.O.R.I. 2017. Public Views of Machine Learning. Report Title:92.
Zurück zum Zitat Jiang, L., C.C. Yang. 2016. Personalized Recommendation in Online Health Communities with Heterogeneous Network Mining. In 2016 IEEE International Conference on Healthcare Informatics (ICHI), 281–284. Jiang, L., C.C. Yang. 2016. Personalized Recommendation in Online Health Communities with Heterogeneous Network Mining. In 2016 IEEE International Conference on Healthcare Informatics (ICHI), 281–284.
Zurück zum Zitat Krämer, N.C., and S. Winter. 2008. Impression Management 2.0: The Relationship of Self-esteem, Extraversion, Self-efficacy, and Self-presentation Within Social Networking Sites. Journal of Media Psychology: Theories, Methods, and Applications 20 (3): 106–116.CrossRef Krämer, N.C., and S. Winter. 2008. Impression Management 2.0: The Relationship of Self-esteem, Extraversion, Self-efficacy, and Self-presentation Within Social Networking Sites. Journal of Media Psychology: Theories, Methods, and Applications 20 (3): 106–116.CrossRef
Zurück zum Zitat Leung, M.K.K., A. Delong, B. Alipanahi, and B.J. Frey. 2016. Machine Learning in Genomic Medicine: A Review of Computational Problems and Data Sets. Proceedings of the IEEE 104 (1): 176–197.CrossRef Leung, M.K.K., A. Delong, B. Alipanahi, and B.J. Frey. 2016. Machine Learning in Genomic Medicine: A Review of Computational Problems and Data Sets. Proceedings of the IEEE 104 (1): 176–197.CrossRef
Zurück zum Zitat Mittelstadt, B.D., and L. Floridi. 2015. The Ethics of Big Data: Current and Foreseeable Issues in Biomedical Contexts. Science and Engineering Ethics 22 (2): 303–341.CrossRef Mittelstadt, B.D., and L. Floridi. 2015. The Ethics of Big Data: Current and Foreseeable Issues in Biomedical Contexts. Science and Engineering Ethics 22 (2): 303–341.CrossRef
Zurück zum Zitat Morrell, R.W., D.C. Park, D.P. Kidder, and M. Martin. 1997. Adherence to Antihypertensive Medications Across the Life Span. Gerontologist 37 (5): 609–619.CrossRef Morrell, R.W., D.C. Park, D.P. Kidder, and M. Martin. 1997. Adherence to Antihypertensive Medications Across the Life Span. Gerontologist 37 (5): 609–619.CrossRef
Zurück zum Zitat Powles, J., and H. Hodson. 2017. Google DeepMind and Healthcare in an Age of Algorithms. Health and Technology 7 (4): 351–367.CrossRef Powles, J., and H. Hodson. 2017. Google DeepMind and Healthcare in an Age of Algorithms. Health and Technology 7 (4): 351–367.CrossRef
Zurück zum Zitat Rawls, J. 2005. Political Liberalism, 589. New York: Columbia University Press. Rawls, J. 2005. Political Liberalism, 589. New York: Columbia University Press.
Zurück zum Zitat Schermer, B.W. 2011. The Limits of Privacy in Automated Profiling and Data Mining. Computer Law & Security Review 27 (1): 45–52.CrossRef Schermer, B.W. 2011. The Limits of Privacy in Automated Profiling and Data Mining. Computer Law & Security Review 27 (1): 45–52.CrossRef
Zurück zum Zitat Stein, N., and K. Brooks. 2017. A Fully Automated Conversational Artificial Intelligence for Weight Loss: Longitudinal Observational Study Among Overweight and Obese Adults. JMIR Diabetes 2 (2): e28.CrossRef Stein, N., and K. Brooks. 2017. A Fully Automated Conversational Artificial Intelligence for Weight Loss: Longitudinal Observational Study Among Overweight and Obese Adults. JMIR Diabetes 2 (2): e28.CrossRef
Zurück zum Zitat Sunstein, C.R., D. Kahneman, D. Schkade, and I. Ritov. 2002. Predictably Incoherent Judgments. Stanford Law Review 54 (6): 1153–1215.CrossRef Sunstein, C.R., D. Kahneman, D. Schkade, and I. Ritov. 2002. Predictably Incoherent Judgments. Stanford Law Review 54 (6): 1153–1215.CrossRef
Zurück zum Zitat Thaler, R.H. 2000. From Homo Economicus to Homo Sapiens. The Journal of Economic Perspectives 14 (1): 133–141.CrossRef Thaler, R.H. 2000. From Homo Economicus to Homo Sapiens. The Journal of Economic Perspectives 14 (1): 133–141.CrossRef
Zurück zum Zitat Tversky, A., and D. Kahneman. 1986. Rational Choice and the Framing of Decisions. The Journal of Business 59 (4): S251–S278.CrossRef Tversky, A., and D. Kahneman. 1986. Rational Choice and the Framing of Decisions. The Journal of Business 59 (4): S251–S278.CrossRef
Zurück zum Zitat Vellido, A. 2019. Societal Issues Concerning the Application of Artificial Intelligence in Medicine. KDD 5 (1): 11–17. Vellido, A. 2019. Societal Issues Concerning the Application of Artificial Intelligence in Medicine. KDD 5 (1): 11–17.
Zurück zum Zitat Weng, S.F., J. Reps, J. Kai, J.M. Garibaldi, and N. Qureshi. 2017. Can Machine-Learning Improve Cardiovascular Risk Prediction Using Routine Clinical Data? PLoS ONE 12 (4): e0174944.CrossRef Weng, S.F., J. Reps, J. Kai, J.M. Garibaldi, and N. Qureshi. 2017. Can Machine-Learning Improve Cardiovascular Risk Prediction Using Routine Clinical Data? PLoS ONE 12 (4): e0174944.CrossRef
Zurück zum Zitat Zarsky, T.Z. 2013. Transparent Predictions. University of Illinois Law Review 2013: 1503. Zarsky, T.Z. 2013. Transparent Predictions. University of Illinois Law Review 2013: 1503.
Zurück zum Zitat Zarsky, T. 2016. The Trouble with Algorithmic Decisions: An Analytic Road Map to Examine Efficiency and Fairness in Automated and Opaque Decision Making. Science, Technology and Human Values 41 (1): 118–132.CrossRef Zarsky, T. 2016. The Trouble with Algorithmic Decisions: An Analytic Road Map to Examine Efficiency and Fairness in Automated and Opaque Decision Making. Science, Technology and Human Values 41 (1): 118–132.CrossRef
Metadaten
Titel
The right to refuse diagnostics and treatment planning by artificial intelligence
verfasst von
Thomas Ploug
Søren Holm
Publikationsdatum
29.07.2019
Verlag
Springer Netherlands
Erschienen in
Medicine, Health Care and Philosophy / Ausgabe 1/2020
Print ISSN: 1386-7423
Elektronische ISSN: 1572-8633
DOI
https://doi.org/10.1007/s11019-019-09912-8

Weitere Artikel der Ausgabe 1/2020

Medicine, Health Care and Philosophy 1/2020 Zur Ausgabe