Skip to main content
Erschienen in: European Radiology 9/2021

Open Access 20.03.2021 | Imaging Informatics and Artificial Intelligence

An international survey on AI in radiology in 1,041 radiologists and radiology residents part 1: fear of replacement, knowledge, and attitude

verfasst von: Merel Huisman, Erik Ranschaert, William Parker, Domenico Mastrodicasa, Martin Koci, Daniel Pinto de Santos, Francesca Coppola, Sergey Morozov, Marc Zins, Cedric Bohyn, Ural Koç, Jie Wu, Satyam Veean, Dominik Fleischmann, Tim Leiner, Martin J Willemink

Erschienen in: European Radiology | Ausgabe 9/2021

Abstract

Objectives

Radiologists’ perception is likely to influence the adoption of artificial intelligence (AI) into clinical practice. We investigated knowledge and attitude towards AI by radiologists and residents in Europe and beyond.

Methods

Between April and July 2019, a survey on fear of replacement, knowledge, and attitude towards AI was accessible to radiologists and residents. The survey was distributed through several radiological societies, author networks, and social media. Independent predictors of fear of replacement and a positive attitude towards AI were assessed using multivariable logistic regression.

Results

The survey was completed by 1,041 respondents from 54 mostly European countries. Most respondents were male (n = 670, 65%), median age was 38 (24–74) years, n = 142 (35%) residents, and n = 471 (45%) worked in an academic center. Basic AI-specific knowledge was associated with fear (adjusted OR 1.56, 95% CI 1.10–2.21, p = 0.01), while intermediate AI-specific knowledge (adjusted OR 0.40, 95% CI 0.20–0.80, p = 0.01) or advanced AI-specific knowledge (adjusted OR 0.43, 95% CI 0.21–0.90, p = 0.03) was inversely associated with fear. A positive attitude towards AI was observed in 48% (n = 501) and was associated with only having heard of AI, intermediate (adjusted OR 11.65, 95% CI 4.25–31.92, p < 0.001), or advanced AI-specific knowledge (adjusted OR 17.65, 95% CI 6.16–50.54, p < 0.001).

Conclusions

Limited AI-specific knowledge levels among radiology residents and radiologists are associated with fear, while intermediate to advanced AI-specific knowledge levels are associated with a positive attitude towards AI. Additional training may therefore improve clinical adoption.

Key Points

• Forty-eight percent of radiologists and residents have an open and proactive attitude towards artificial intelligence (AI), while 38% fear of replacement by AI.
• Intermediate and advanced AI-specific knowledge levels may enhance adoption of AI in clinical practice, while rudimentary knowledge levels appear to be inhibitive.
• AI should be incorporated in radiology training curricula to help facilitate its clinical adoption.
Begleitmaterial
Hinweise

Supplementary Information

The online version contains supplementary material available at https://​doi.​org/​10.​1007/​s00330-021-07781-5.

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Introduction

Artificial intelligence (AI) and deep learning (DL) algorithms have shown a promising performance when applied to medical imaging [14]. AI offers substantial opportunities for radiologists, such as increasing workflow efficiency and faster and more reproducible segmentation and detection tasks [57]. Although AI currently dominates conferences and literature, it is still in its early phase of clinical adoption. So far, only scarce narrow task detection DL-based models have been implemented in selected centers [8].
A common recommendation for radiologists is to get involved in AI and hold matters within their own hands to avoid turf losses to industry or other specialties [9, 10]. Medicine is an industry known for trailing behind the technological advancements of other industries. Radiologists and residents with an open and proactive attitude (i.e., those who are willing to invest extra time in AI in an already full clinical schedule) can be considered early adopters. These proactive physicians are needed to drive the next phase so that the early majority will start using the tools and a tipping point can be reached [11]. This is crucial, because this will enable thorough validation of AI tools in clinical practice while feedback of the end-user is generated. Adoption of AI by radiologists may also prevent the dreaded scenario that data is used for financial reasons rather than improvement of patient care [12].
With impressive software results as well as unnuanced and often misleading statements in literature and the mainstream media, a general undertone of “fear of replacement,” either by computers or other disciplines, seems to have developed amongst medical students, trainees, and even radiologists, as was shown in smaller scale surveys [1317]. Other smaller scale surveys (ranging from 69 to 270 respondents), as well as a recent larger (n = 675) survey, have suggested that this fear is passing and showed a positive attitude towards the topic of AI amongst medical students or radiology professionals [14, 1822]. Only one survey (n = 270) investigated the existing knowledge level of radiologists pertaining to AI [20]. The current general attitude and level of knowledge of AI among residents and radiologists at large remain relatively unknown. The purpose of this large-scale international study was to investigate the existing knowledge and general attitude towards AI among international radiologists and residents, and to explore their associations.

Materials and methods

Questionnaire

No institutional review board approval was needed. Analysis was done with anonymized data. A web-based survey using Google Forms (Google LLC) was created consisting of 39 questions on demographics, background, social media use, awareness and existing knowledge, attitude towards AI, willingness to actively engage, AI integration in radiology training, and anticipated hurdles to AI implementation. Answers were multiple choice or open (Appendix 1). A pilot was done with 10 radiologists and residents to eliminate ambiguity [23]. The survey was then adjusted and translated by native speakers in nine languages (English, French, German, Spanish, Italian, Dutch, Czech, Russian, and Turkish).

Participant outreach

The survey and a brief cover letter were accessible between April 18 and July 12, 2019 on www.​airadiologysurve​y.​com. The survey was distributed through the Radiological Society of the Netherlands (NVvR, n = 2,002 members), the Italian Society of Medical Radiology (SIRM, n = 10,320 members), and the French Society of Radiology (SFR, n = 8,300 members) by email to all members. The NVvR and European Society of Medical Imaging Informatics (EuSoMII) featured a bulletin on their website. The Canadian Association of Radiology (CAR) promoted the survey through social media. Furthermore, the authors promoted the survey through their professional network and emails were sent to radiologists and residents within some authors’ institutions (i.e., five Dutch hospitals). In addition, 13 Canadian and 15 American program directors were approached with the request to forward the survey in their institutions. The survey was included in resident and fellow section (RFS) AI Journal Club newsletter on May 28, 2019. Additionally, the survey was featured in AuntMinnie [24] and AuntMinnieEurope [25]. The survey was also repeatedly promoted on social media (LinkedIn and Twitter) via the personal accounts of the authors and EuSoMII. The pre-defined sample size was n = 1,000 to allow for robust analyses and conclusions, and the survey was closed once that target was reached.

Statistical analysis

Continuous data are presented as means with standard deviations or medians with ranges. Categorical data are presented as proportions. Univariable analysis for categorical data was done using chi-square tests and a Kruskal-Wallis test for age. Associations of independent variables with the outcomes on knowledge and attitude were assessed using multivariable logistic regression (enter method) to correct for possible confounders and/or effect modifiers. Variables (age, gender, region (European versus non-European), working in academia, scientific background, current position (resident versus radiologist), source population (SIRM, SFR, NvVR, other), professional social media use, knowledge of informatics/statistics, AI-specific knowledge, and subspecialty were selected beforehand. Age was modeled as a continuous variable; all other variables were modeled as categorical variables. For AI-specific knowledge, the categories 4 (advanced knowledge) and 5 (actively engaged in research/development) were combined for robustness, and labeled “advanced knowledge.” Category 2 was labeled “basic knowledge,” and category 3 on the 5-point scale was labeled “intermediate knowledge.” The variable “fear of replacement” was dichotomized in “yes and maybe” versus “no” for question 25 (“Do you think the diagnostic radiologist’s job is in danger due to AI?”). An open and proactive attitude towards AI was defined as readiness to use and learn about AI, willingness to collaborate with data scientists, and agreement that radiologists should take the lead. For statistical analysis, “open and proactive attitude” was dichotomized according to having answered “yes” versus “no” or “maybe” on questions 37 (Should radiologists take the lead in development of AI technology?), 33 (Would you be willing to use AI software in the clinical setting?), 34 (Would you be interested in collaborating with computer scientists or data scientists to develop an AI algorithm?), and 31 (Are you planning on learning about this topic, even if it’s not a program or CME requirement?) (see Appendix 1). Results of the logistic regression analyses are presented as adjusted odds ratios (ORs) with 95% confidence intervals (CI). Statistical analysis of the results was done in IBM SPSS Statistics for Windows (Version 24.0.: IBM Corp.). A p value < 0.05 was deemed statistically significant.

Results

Demographics

A total of 1,086 respondents completed the survey. Forty-five respondents were excluded because they were the not the target population (e.g., student, industry, researcher, entrepreneur) or were double entries, resulting in a final population of 1,041 respondents from 54 countries (Fig. 1). Of respondents, n = 272 (26%) were SIRM members, n = 185 (18%) SFR members, and n = 274 (26%) NVvR members, with response rates of 2.6%, 2.2%, and 13.7% respectively. N = 310 (30%) respondents were recruited through social media or personal networks.
Most respondents (n = 867, 83%) worked in European countries, n = 109 (11%) worked in non-European countries, and (n = 64, 6%) worked in North America/Canada. Most respondents were male (n = 670, 65%) and the median age was 38 (24–74) years. Respondents were working either in non-academic hospitals (n = 367, 35%) or in the private sector (n = 203, 20%), and n = 471 (45%) worked in an academic center. Mostly, respondents were radiologists (n = 692, 66%) with a median of 12 (0–44) years of experience, not including residency. N = 142 (35%) were residents, the majority senior (n = 173, 56%, defined as completed > 50% of program). Only a minority were fellows (n = 27, 3%).
A quarter of respondents indicated being a generalist (i.e., > 4 subspecialties chosen, n = 255, 25%). Of the residents and radiologists, most had one subspecialty (n = 513, 49%), and n = 273 (26%) two or more subspecialties. The most commonly listed subspecialties were abdominal imaging (n = 328, 32%), musculoskeletal imaging (n = 241, 23%), and neuroradiology (n = 208, 20%). Molecular/nuclear imaging was the subspecialty of n = 41 (4%) respondents.
The majority of respondents (n = 727, 70%) had no scientific background, apart from the MD degree. A minority (n = 171, 16%) completed a PhD. Those with a scientific background tended to work more often in academia (p < 0.001), independent of gender and current position. The source populations were different with respect to most characteristics, except for gender, which was evenly distributed. A summary of the respondents’ demographics stratified per source population is given in Table 1.
Table 1
Baseline characteristics of respondents per source population (n = 1,041)
Category
SIRM (n = 272)
SFR (n = 185)
NVvR (n = 274)
Other (n = 310)
Total N (%)
p value
Gender (male)
180 (69%)
112 (61%)
161 (61%)
209 (68%)
670 (65%)a
NS
Age (median (range)
41 (26–74)
50 (24–70)
37 (25–73)
43 (24–65)
38 (24–70)
< 0.001
Region
Africa
0 (0%)
10 (5%)
0 (0%)
4 (1%)
14 (1%)
< 0.001
Asia
0 (0%)
3 (2%)
0 (0%)
70 (23%)
73 (7%)
 
Australia
0 (0%)
2 (1%)
3 (1%)
3 (1%)
8 (1%)
 
Europe
272 (100%)
162 (88%)
269 (98%)
164 (53%)
867 (83%)
 
North America
0 (0%)
0 (0%)
1 (0.5%)
64 (21%)
65 (6%)
 
South America
0 (0%)
8 (4%)
1 (0.5%)
5 (1%)
14 (1%)
 
Type of hospital
Academic
120 (44%)
55 (30%)
99 (36%)
197 (64%)
471 (45%)
< 0.001
Non-academic
103 (38%)
41 (22%)
168 (61%)
55 (18%)
367 (35%)
 
Private
49 (18%)
89 (48%)
7 (3%)
58 (19%)
203 (20%)
 
Current position
Radiologist
196 (72%)
163 (88%)
157 (57%)
176 (57%)
692 (66%)
< 0.001
Fellow
1 (0%)
0 (0%)
13 (5%)
13 (4%)
27 (3%)
 
Resident
75 (28%)
22 (12%)
104 (38%)
121 (39%)
322 (31%)
 
Sub specialization
Abdominal
108 (40%)
64 (35%)
49 (18%)
107 (35%)
328 (32%)
< 0.001
Musculoskeletal
79 (29%)
38 (21%)
45 (16%)
79 (26%)
214 (23%)
< 0.01
Neuro
40 (15%)
36 (20%)
39 (14%)
93 (30%)
208 (20%)
< 0.001
Interventional
43 (16%)
40 (22%)
41 (15%)
59 (19%)
183 (18%)
NS
Breast
50 (18%)
4 (2%)
20 (7%)
41 (13%)
115 (11%)
< 0.001
Cardiothoracic
56 (21%)
21 (11%)
28 (10%)
74 (24%)
179 (17%)
< 0.001
Pediatric
23 (9%)
25 (14%)
7 (3%)
34 (11%)
89 (9%)
< 0.001
Molecular/nuclear
2 (1%)
3 (2%)
19 (7%)
17 (6%)
41 (4%)
< 0.001
Advanced scientific backgroundb
No
230 (84%)
137 (74%)
165 (60%)
195 (63%)
727 (70%)
< 0.001
PhD
16 (6%)
14 (7%)
71 (26%)
47 (15%)
148 (14%)
 
Research fellowship
10 (4%)
20 (11%)
3 (1%)
18 (6%)
51 (5%)
 
PhD and research fellowship
3 (1%)
9 (5%)
6 (2%)
5 (2%)
23 (2%)
 
Obtaining PhD/research fellowship
13 (5%)
5 (3%)
29 (11%)
45 (15%)
92 (9%)
 
Social media use (professional)
No
128 (47%)
127 (69%)
112 (41%)
110 (36%)
477 (46%)
< 0.001
Yes
144 (53%)
58 (31%)
162 (59%)
200 (65%)
564 (54%)
 
LinkedIn
81 (30%)
33 (18%)
149 (54%)
97 (31%)
360 (64%)
< 0.001
Twitter
14 (5%)
12 (7%)
22 (8%)
67 (22%)
115 (20%)
< 0.001
Instagram
24 (9%)
4 (2%)
11 (4%)
60 (19%)
99 (18%)
< 0.001
Facebook
67 (25%)
25 (14%)
22 (8%)
85 (27%)
78 (14%)
< 0.001
aPrefer not to say (n = 14)
bIn addition to medical school
SIRM, Italian Society of Medical Radiology; SFR, French Society of Radiology; NVvR, Radiological Society of the Netherlands

Knowledge of statistics/informatics

Almost half of the participants indicated to have knowledge of informatics/statistics (n = 504, 48%), mostly without a formal degree (n = 465, 45%). A university degree in informatics or statistics was observed in n = 29 (3%) respondents. Coding skills were indicated in n = 77/312 (24%, Table 2). Males were more likely to have knowledge of statistics/informatics (adjusted OR 2.39, 95% CI 1.78–3.21, p < 0.001) as well as having a scientific background (adjusted OR 2.29, 95% CI 1.68–3.11, p < 0.001). Knowledge of statistics/informatics was evenly distributed among subspecialties.
Table 2
Self-assessed knowledge, fear and attitude (n = 1,041)
Self-assessed knowledge
Knowledge of informatics/statistics
No
537 (52%)
Yes, no degree
465 (45%)
Yes, degree
39 (4%) any degree
29 (3%) university level
AI-specific knowledge
0 Never heard of AI
47 (4%)
1 Heard of AI
221 (21%)
2 Basic knowledge
307 (30%)
3 Intermediate knowledge
296 (28%)
4 Advanced knowledge
111 (11%)
5 Active research/development
57 (6%)
Coding skills (any language)a
None
235 (75%)
Basic
63 (20%)
Advanced
14 (4%)
Fear of replacement
Do you think the diagnostic radiologist's job is in danger due to AI?
No
640 (62%)
Yes
140 (13%)
Maybe
261 (25%)
Career doubt
Would you have chosen for a career as a radiologist again with your current knowledge of AI?
No
86 (8%)
Yes
795 (77%)
Maybe
160 (15%)
Attitude
Should radiologist take the lead in the development of AI technology?
No
36 (4%)
Yes
826 (79%)
Maybe
179 (17%)
Would you be willing to use AI software in the clinical setting?
No
14 (1%)
Yes
885 (85%)
Maybe
142 (14%)
Would you be interested in collaborating with computer scientists or data scientists to develop an AI algorithm?
No
94 (9%)
Yes
724 (70%)
Maybe
223 (21%)
Are you planning on learning about this topic (i.e. AI), even if it's not a program or CME requirement?
No
63 (6%)
Yes
780 (75%)
Maybe
198 (19%)
Respondents with an open and proactive attitudeb
 
501 (48%)
aThis questions was only incorporated in the English, Dutch, French, Czech, German, and Russian translations (total n respondents = 312)
bDefined as having answered “yes” to all four attitude questions

AI-specific knowledge

A minority of respondents had only heard of AI (n = 221, 21%, Table 2). Only having heard of AI was significantly less often observed in respondents with a scientific background (adjusted OR 0.51, 95% CI 0.34–0.78, = 0.002) as well in cardiothoracic subspecialists (adjusted OR 0.53, 95% CI 0.32–0.86, p = 0.01).
A minority of respondents (n = 168, 16%) had advanced knowledge or were actively engaged in research and/or development of AI (Table 2). Advanced knowledge or active engagement was significantly more often observed in males (adjusted OR 2.10, 95% CI 1.34–3.31, p = 0.001), Europe (adjusted OR 2.33, 95% CI 1.29–4.22, p = 0.005), academia (adjusted OR 1.80, 95% CI 1.18–2.73, p = 0.006), having a scientific background (adjusted OR 2.74, 95% CI 1.85–4.07, p < 0.001), and professional social media use (adjusted OR 2.76, 95% CI 1.82–4.19, p < 0.001). Participants with musculoskeletal interest (adjusted OR 0.40, 95% CI 0.23–0.69, p = 0.001) reported less commonly to be knowledgeable on AI.

Fear of replacement and career doubt

Fear of replacement was found in 38% (n = 401, Table 2). Fear was significantly more often reported in males (adjusted OR 1.86 95% CI 1.38–2.52, p < 0.001) and participants with basic AI-specific knowledge (adjusted OR 1.56, 95% CI 1.10–2.21, p = 0.01). Fear was significantly less often reported with increasing age (adjusted OR 0.77 per 10-year interval, 95% CI 0.66–0.90, p = 0.002), and those with intermediate AI-specific knowledge (adjusted OR 0.40, 95% CI 0.20–0.80, p = 0.01) or advanced AI-specific knowledge (adjusted OR 0.43, 95% CI 0.21–0.90, p = 0.03). Fear was not associated with region, source population, current position, working in academia, or subspecialty.
The most common reasons for fearing replacement were predicting that the role of the diagnostic radiologist would be altered, however not being replaced (n = 329, 82%), suspecting full replacement (n = 42, 10%), and suspecting partial replacement resulting in a decline in demand for radiologists (n = 23, 6%).
Given the respondent’s knowledge level of AI, n = 86 (8%) indicated that they would have chosen a career as a radiologist again, and n = 160 (15%) might not have chosen a career as a radiologist again (Table 2). This career doubt was significantly associated with fear of replacement (adjusted OR 4.41, 95% CI 3.16–6.17, p < 0.001). Professional social media use appeared to be a protective factor against career doubt (adjusted OR 0.69, 95% CI 0.49–0.96, p = 0.03). Career doubt was not associated with age, gender, region, current position, working in academia, AI-specific knowledge, or subspecialty.

Open and proactive attitude

Agreeing that radiologists should take the lead in development of AI technology (n = 826, 79%) was significantly more observed in males (adjusted OR 1.82, 95% CI 0.1.30–2.59, p = 0.001), those only having heard of AI (adjusted OR 3.62, 95% CI 1.76–7.42, p < 0.001), as well as having intermediate (adjusted OR 4.29, 95% CI 2.04–9.00, p < 0.001) or advanced AI-specific knowledge (adjusted OR 6.49, 95% CI 2.78–15.17, p < 0.001). Neuroradiologists disagreed significantly more often (adjusted OR 0.59, 95% CI 0.40–0.87, p = 0.009).
A willingness to use AI in clinical practice (n = 885, 85%) negatively correlated with a fear of replacement (adjusted OR 0.67, 95% 0.46–0.98, p = 0.04). Males were more willing to use AI in clinical practice (adjusted OR 1.77, 95% CI 1.19–2.63, p < 0.01). Having heard of AI (adjusted OR 2.50, 95% CI 1.24–5.06, p = 0.01), and having intermediate (adjusted OR 4.80, 95% CI 2.22–10.38, p< 0.001) or advanced AI-specific knowledge (adjusted OR 5.38, 95% CI 2.15–13.51, p < 0.001) were associated with a willingness to use AI in clinical practice as well.
Basic knowledge of AI was a negative predictor for wanting to collaborate with data scientists (adjusted OR 0.66, 95% CI 0.46–0.96, p = 0.03). Male gender (adjusted OR 1.49, 95% CI 1.08–2.05, p = 0.01), professional social media use (adjusted OR 1.58, 95% CI 1.17–2.14, p = 0.003), and intermediate (adjusted OR 2.22, 95% CI 1.09–4.51, p = 0.03) or advanced knowledge (adjusted OR 7.12, 95% CI 2.90–17.47, p < 0.001) were positive predictors.
Positive predictors for interest to learn about AI (n = 780, 75%) were having heard of AI (adjusted OR 2.27, 95% CI 1.15–4.52, p = 0.02), as well as having intermediate (adjusted OR 6.22, 95% CI 3.00–12.88, p < 0.001) or advanced AI-specific knowledge (adjusted OR 15.29, 95% CI 6.07–38.50, p < 0.001), independent of age, gender, and other demographics.
Almost half of the respondents appeared to have an open and proactive attitude towards AI (n = 501, 48%, Table 3). Positive predictors for an open and proactive attitude were male gender (adjusted OR 1.77, 95% CI 1.29–2.42, p < 0.001), only having heard of AI (adjusted OR 4.78, 95% CI 1.78–13.32, p = 0.002), intermediate (adjusted OR 11.65, 95% CI 4.25–31.92, p < 0.001) or advanced AI-specific knowledge (adjusted OR 17.65, 95% CI 6.16–50.54, p < 0.001). Negative predictors for an open and proactive attitude were increasing age (adjusted OR 0.78 per 10-year interval, 95% CI 0.66–0.93, p = 0.006) and basic AI-specific knowledge (adjusted OR 0.58, 95% CI 0.41–0.83, p = 0.002). Having an open and proactive attitude was not associated with region, source population, working in academia, current position, subspecialty, or fear of replacement. All predictors for an open and proactive attitude are listed in Table 3.
Table 3
Predictors for an open and proactive attitude in a multivariable logistic regression model (n = 1,041)
Predictor
Odds ratioa
CIb
p value
Male
1.77
1.29–2.42
< 0.001+
Age (per 10-year interval)
0.78
0.66–0.93
0.006
Professional social media use
1.64
1.23–2.18
0.001
Scientific background
1.63
1.18–2.45
0.003
Knowledge of informatics/statistics
1.48
1.11–1.97
0.008
Heard of AI
4.78
1.78–13.32
0.002
AI-specific knowledge
Basic
0.58
0.41–0.81
0.002
Intermediate
11.65
4.25–31.92
< 0.001
Advanced knowledge or active engagement
17.65
6.16–50.54
< 0.001
aAdjusted for region, source population, working in academia, resident, subspecialty, and fear of replacement
bCI, confidence interval

Discussion

This large (n = 1,041) survey of radiologists and residents showed that intermediate and advanced AI-specific knowledge levels were associated with an open and proactive attitude towards AI. Radiologists and residents with basic knowledge levels, on the other hand, had a significantly less open and proactive attitude towards AI. This may indicate that increased AI-specific knowledge enhances adoption of AI in clinical practice, while basic knowledge levels may be inhibitive. Fear of replacement by AI still exists in the radiology community, as this was reported by 39% (n = 401). Career doubt was reported in 23% (n = 246). An open and proactive attitude towards AI was observed in almost half of respondents (48%, n = 501). We found a significant independent association between an open and proactive attitude towards AI and male gender, younger age, scientific background, professional social media use, and knowledge of informatics/statistics. This indicates that radiology residents and radiologists inherently have a positive attitude towards the recent technological development of artificial intelligence, especially those who still have most of their career ahead of them, and those who are naturally more inclined to be interested in science and/or technology. Interestingly, basic AI-specific knowledge was independently associated with both fear of replacement and being less likely to have an open and proactive attitude towards AI. A possible explanation for this could be that those who have had only limited exposure to AI may not be entirely informed about the limitations of AI, and hence fear job replacement. As they have a less nuanced frame of reference regarding AI, and may perceive the technology as advanced than their own skillset, it is possible that this group does not realize that radiologists can be key players in development, validation, and implementation into clinical practice, and therefore appear less open and proactive. Unfortunately, underlying reasons for this observation cannot be deducted from this study.
The largest (n = 675) published survey to date regarding AI in radiology, held by the European Society of Radiology (ESR) among its members in November 2018, had a somewhat different focus. The researchers investigated the expected impact of AI on different aspects of the radiologists’ daily job (e.g., subspecialties and modalities) rather than attitude and knowledge, although impact on job opportunities was assessed as well [19]. Also, the ESR survey targeted a slightly different population, including fewer residents, i.e., 4% vs. 31% in our study, and slightly more academic participants, 51% vs. 45% respectively. Therefore, the surveys can be seen as complimentary. Furthermore, in our study, the large data set allows for robust analyses regarding predictors for a radiology resident and radiologists’ AI-specific knowledge and attitude, something that has not been done before. In the ESR survey, a generally favorable attitude towards AI was observed, in line with our survey. In their survey, 42% foresaw a decrease of job opportunities, comparable to the 39% of participants fearing for (partial) replacement in our study. In the survey by Waymel et al conducted in early 2019 with 270 radiology residents and radiologists responding, the knowledge and willingness to learn was also assessed [20]. They reported that 73% had insufficient knowledge of AI, while 23% had basic knowledge as defined by the authors. Our study showed higher levels of AI-specific knowledge, with at least basic AI-specific knowledge in 76% (n = 771/1,041) of respondents.
In our study, the response rate was low, namely 3.9% for the combined society populations, slightly higher than reported in the ESR survey (2.8%) [19]. This introduces selection bias, a common problem encountered in questionnaire research, especially when a convenience sample is taken [26]. Therefore, the true level of knowledge and the proportion having an open and proactive attitude is most likely lower, and the level of fear may be higher. Nevertheless, the associations found between knowledge and attitude were significant and consistent throughout the analysis and therefore should hold true for the domain of interest. The determination for the level of knowledge in this survey was entirely subjective, a problem inherent to this method of research. The levels of knowledge endorsed by the respondents are a mere indication of the self-perceived knowledge, not an absolute measure. Furthermore, the definition of an “open and proactive attitude” is also a subjective measure defined by the authors. Answering yes to the four questions of interest does not guarantee that a respondent will invest extra time to help adoption of AI in clinical practice; however, it does reflect an overall positive attitude. North America is underrepresented in this survey, potentially due the tendency of their societies (e.g., RSNA) not to participate in third-party initiatives. Also, South America, Asia, and Africa were not systematically included in this survey through official channels. Therefore, the results should be interpreted as a reflection of the opinion of the radiology community in western society, mainly Europe.
This large international survey shows that limited AI-specific knowledge levels among radiology residents and radiologists are associated with fear, while intermediate to advanced AI-specific knowledge levels are associated with a positive attitude towards AI and therefore may improve clinical adoption. These findings underline that AI should be incorporated into radiology training curricula and post-academic training.

Declarations

Guarantor

The scientific guarantor of this publication is Merel Huisman.

Conflict of interest

The authors of this manuscript declare relationships with the following companies: Segmed, Inc., Arterys, Quantib, Osimis.io.

Statistics and biometry

One of the authors has significant statistical expertise.
Written informed consent was obtained from all subjects (participants) in this study, by agreeing to participate in the survey.

Ethical approval

Institutional Review Board approval was not required because the study was a voluntary survey among radiology professionals not concerning any health information and all data was handled anonymously. Participants were informed that the results collected would be handled anonymously and may be used for scientific publication.

Methodology

• cross sectional study
• multicenter study
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://​creativecommons.​org/​licenses/​by/​4.​0/​.

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Unsere Produktempfehlungen

e.Med Interdisziplinär

Kombi-Abonnement

Für Ihren Erfolg in Klinik und Praxis - Die beste Hilfe in Ihrem Arbeitsalltag

Mit e.Med Interdisziplinär erhalten Sie Zugang zu allen CME-Fortbildungen und Fachzeitschriften auf SpringerMedizin.de.

e.Med Radiologie

Kombi-Abonnement

Mit e.Med Radiologie erhalten Sie Zugang zu CME-Fortbildungen des Fachgebietes Radiologie, den Premium-Inhalten der radiologischen Fachzeitschriften, inklusive einer gedruckten Radiologie-Zeitschrift Ihrer Wahl.

Anhänge

Supplementary Information

Literatur
1.
Zurück zum Zitat Liu X, Faes L, Kale AU et al (2019) A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. Lancet Digital Health 1:e271–e297CrossRef Liu X, Faes L, Kale AU et al (2019) A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. Lancet Digital Health 1:e271–e297CrossRef
2.
Zurück zum Zitat Jha S, Topol EJ (2016) Adapting to artificial intelligence: radiologists and pathologists as information specialists. JAMA 316:2353–2354CrossRef Jha S, Topol EJ (2016) Adapting to artificial intelligence: radiologists and pathologists as information specialists. JAMA 316:2353–2354CrossRef
3.
Zurück zum Zitat Hinton G (2018) Deep learning—a technology with the potential to transform health care. JAMA 320:1101–1102CrossRef Hinton G (2018) Deep learning—a technology with the potential to transform health care. JAMA 320:1101–1102CrossRef
4.
Zurück zum Zitat Nagendran M, Chen Y, Lovejoy CA et al (2020) Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies. BMJ 368:m689CrossRef Nagendran M, Chen Y, Lovejoy CA et al (2020) Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies. BMJ 368:m689CrossRef
5.
Zurück zum Zitat Wichmann J, Willemink M, De Cecco C (2020) Artificial intelligence and machine learning in radiology: current state and considerations for routine clinical implementation. Invest Radiol 55:619–627CrossRef Wichmann J, Willemink M, De Cecco C (2020) Artificial intelligence and machine learning in radiology: current state and considerations for routine clinical implementation. Invest Radiol 55:619–627CrossRef
6.
Zurück zum Zitat Willemink MJ, Noël PB (2019) The evolution of image reconstruction for CT-from filtered back projection to artificial intelligence. Eur Radiol 29:2185–2195CrossRef Willemink MJ, Noël PB (2019) The evolution of image reconstruction for CT-from filtered back projection to artificial intelligence. Eur Radiol 29:2185–2195CrossRef
7.
Zurück zum Zitat Willemink MJ, Koszek WA, Hardell C et al (2020) Preparing medical imaging data for machine learning. Radiology 295:4–15CrossRef Willemink MJ, Koszek WA, Hardell C et al (2020) Preparing medical imaging data for machine learning. Radiology 295:4–15CrossRef
8.
Zurück zum Zitat Lincoln C, Chatterjee R, Willis M (2019) Augmented radiology: looking over the horizon. Radiol Artif Intell 1:e180039CrossRef Lincoln C, Chatterjee R, Willis M (2019) Augmented radiology: looking over the horizon. Radiol Artif Intell 1:e180039CrossRef
10.
Zurück zum Zitat Tang A, Tam R, Cadrin-Chênevert A et al (2018) Canadian association of radiologists white paper on artificial intelligence in radiology. Can Assoc Radiol J 69:120–135CrossRef Tang A, Tam R, Cadrin-Chênevert A et al (2018) Canadian association of radiologists white paper on artificial intelligence in radiology. Can Assoc Radiol J 69:120–135CrossRef
11.
Zurück zum Zitat Rogers EM (1962) Diffusion of innovation. 4th Edition, Simon and Schuster, New York Rogers EM (1962) Diffusion of innovation. 4th Edition, Simon and Schuster, New York
12.
Zurück zum Zitat Geis JR, Brady AP, Wu CC et al (2019) Ethics of artificial intelligence in radiology: summary of the joint European and North American multisociety statement. Can Assoc Radiol J 70:329–334CrossRef Geis JR, Brady AP, Wu CC et al (2019) Ethics of artificial intelligence in radiology: summary of the joint European and North American multisociety statement. Can Assoc Radiol J 70:329–334CrossRef
13.
Zurück zum Zitat Gong B, Nugent JP, Guest W et al (2019) Influence of artificial intelligence on Canadian medical students’ preference for radiology specialty: a national survey study. Acad Radiol 26:566–577CrossRef Gong B, Nugent JP, Guest W et al (2019) Influence of artificial intelligence on Canadian medical students’ preference for radiology specialty: a national survey study. Acad Radiol 26:566–577CrossRef
14.
Zurück zum Zitat Collado-Mesa F, Alvarez E, Arheart K (2018) The role of artificial intelligence in diagnostic radiology: a survey at a single radiology residency training program. J Am Coll Radiol 15:1753–1757CrossRef Collado-Mesa F, Alvarez E, Arheart K (2018) The role of artificial intelligence in diagnostic radiology: a survey at a single radiology residency training program. J Am Coll Radiol 15:1753–1757CrossRef
16.
Zurück zum Zitat Gallix B, Chong J (2019) Artificial intelligence in radiology: who’s afraid of the big bad wolf? Eur Radiol 29:1637–1639CrossRef Gallix B, Chong J (2019) Artificial intelligence in radiology: who’s afraid of the big bad wolf? Eur Radiol 29:1637–1639CrossRef
17.
Zurück zum Zitat van Hoek J, Huber A, Leichtle A et al (2019) A survey on the future of radiology among radiologists, medical students and surgeons: students and surgeons tend to be more skeptical about artificial intelligence and radiologists may fear that other disciplines take over. Eur J Radiol 121:108742CrossRef van Hoek J, Huber A, Leichtle A et al (2019) A survey on the future of radiology among radiologists, medical students and surgeons: students and surgeons tend to be more skeptical about artificial intelligence and radiologists may fear that other disciplines take over. Eur J Radiol 121:108742CrossRef
18.
Zurück zum Zitat Eltorai AEM, Bratt AK, Guo HH (2019) Thoracic radiologists’ versus computer scientists’ perspectives on the future of artificial intelligence in radiology. J Thorac Imaging Eltorai AEM, Bratt AK, Guo HH (2019) Thoracic radiologists’ versus computer scientists’ perspectives on the future of artificial intelligence in radiology. J Thorac Imaging
19.
Zurück zum Zitat European Society of Radiology (ESR) (2019) Impact of artificial intelligence on radiology: a EuroAIM survey among members of the European Society of Radiology. Insights Imaging 10:105–103 European Society of Radiology (ESR) (2019) Impact of artificial intelligence on radiology: a EuroAIM survey among members of the European Society of Radiology. Insights Imaging 10:105–103
20.
Zurück zum Zitat Waymel Q, Badr S, Demondion X et al (2019) Impact of the rise of artificial intelligence in radiology: what do radiologists think? Diagn Interv Imaging 100:327–336CrossRef Waymel Q, Badr S, Demondion X et al (2019) Impact of the rise of artificial intelligence in radiology: what do radiologists think? Diagn Interv Imaging 100:327–336CrossRef
21.
Zurück zum Zitat Pinto Dos Santos D, Giese D, Brodehl S et al (2019) Medical students’ attitude towards artificial intelligence: a multicentre survey. Eur Radiol 29:1640–1646CrossRef Pinto Dos Santos D, Giese D, Brodehl S et al (2019) Medical students’ attitude towards artificial intelligence: a multicentre survey. Eur Radiol 29:1640–1646CrossRef
23.
Zurück zum Zitat Kelley K, Clark B, Brown V et al (2003) Good practice in the conduct and reporting of survey research. International J Qual Health Care 15:261–266CrossRef Kelley K, Clark B, Brown V et al (2003) Good practice in the conduct and reporting of survey research. International J Qual Health Care 15:261–266CrossRef
26.
Zurück zum Zitat Sedgwick P (2013) Questionnaire surveys: sources of bias. BMJ 347:f5265–f5265CrossRef Sedgwick P (2013) Questionnaire surveys: sources of bias. BMJ 347:f5265–f5265CrossRef
Metadaten
Titel
An international survey on AI in radiology in 1,041 radiologists and radiology residents part 1: fear of replacement, knowledge, and attitude
verfasst von
Merel Huisman
Erik Ranschaert
William Parker
Domenico Mastrodicasa
Martin Koci
Daniel Pinto de Santos
Francesca Coppola
Sergey Morozov
Marc Zins
Cedric Bohyn
Ural Koç
Jie Wu
Satyam Veean
Dominik Fleischmann
Tim Leiner
Martin J Willemink
Publikationsdatum
20.03.2021
Verlag
Springer Berlin Heidelberg
Erschienen in
European Radiology / Ausgabe 9/2021
Print ISSN: 0938-7994
Elektronische ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-021-07781-5

Weitere Artikel der Ausgabe 9/2021

European Radiology 9/2021 Zur Ausgabe

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Screening-Mammografie offenbart erhöhtes Herz-Kreislauf-Risiko

26.04.2024 Mammografie Nachrichten

Routinemäßige Mammografien helfen, Brustkrebs frühzeitig zu erkennen. Anhand der Röntgenuntersuchung lassen sich aber auch kardiovaskuläre Risikopatientinnen identifizieren. Als zuverlässiger Anhaltspunkt gilt die Verkalkung der Brustarterien.

S3-Leitlinie zu Pankreaskrebs aktualisiert

23.04.2024 Pankreaskarzinom Nachrichten

Die Empfehlungen zur Therapie des Pankreaskarzinoms wurden um zwei Off-Label-Anwendungen erweitert. Und auch im Bereich der Früherkennung gibt es Aktualisierungen.

Fünf Dinge, die im Kindernotfall besser zu unterlassen sind

18.04.2024 Pädiatrische Notfallmedizin Nachrichten

Im Choosing-Wisely-Programm, das für die deutsche Initiative „Klug entscheiden“ Pate gestanden hat, sind erstmals Empfehlungen zum Umgang mit Notfällen von Kindern erschienen. Fünf Dinge gilt es demnach zu vermeiden.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.