Podcasts as a teaching tool in orthopaedic surgery

Digitalization has an enormous impact on the world of working [2] and teaching [5] in the medical sector. The generation of medical students and doctors born since 1982 has grown up with information technology as an integral part of their lives [17]. Nevertheless, Internet-based teaching methods play a subordinate role in the training of young physicians [24]. The current range of digital teaching and learning formats in medical studies is heterogeneous and includes social communication tools, audio-based and video-based media, interactive formats and electronic examination systems [11].

A study conducted by the University of Leipzig in 2016 examined the influences of Internet-based media use in Germany. It was found that only 28% of the participants surveyed actively used the online media in classes. The main reasons given against the use of Internet-based media in classes were increased time expenditure and a lack of personnel support. Online media, such as interactive case studies, podcasts and subject-specific apps were rated as suitable for use in teaching. Social media such as Facebook and Twitter were rated as unsuitable for use in classes [24].

The recording of video podcasts in university teaching has been increasingly used since the beginning of the twenty-first century [11] either as an additional provision of flexibly retrievable learning materials [16], or as a teaching tool for direct feedback for students when learning clinical skills [10] or basics of medical communication [9, 10]. Video podcasts are also used as examination tools [9]. In general, the provision of video podcasts is perceived as positive by students [4‐6, 8, 18]; however, the effectiveness of video podcasts as teaching tools remains controversial [5, 21, 22] as does the concern that the provision of online learning material will reduce the number of students attending optional classes [1, 13].

The effectiveness of video podcasts as teaching tools has been studied from different angles: Early studies concluded that a classical video podcast that combines the audio or video files recorded during a course with the lecturer’s slides can be as effective as traditional lectures [12, 23, 25]. Most studies on the influence of video podcasts on examination results found no significant influence of podcast use on examination results [3, 7, 21, 22]; however, previous studies suggested that the provision of video podcasts does not lead to a loss of lecture attendances [1, 13, 15].

In the winter semester 2018/2019, video podcasts of lectures were recorded for the first time in the main lecture series of orthopaedic medicine at a Central German university and made available to students in a password-protected area (student portal). The aim of this study was to determine the influence of this change in teaching curriculum on examination results, attendance at lectures and the evaluation of courses by students.

Specifically, the study aimed at answering the following questions:

Additionally, the use of media preferred by students for examination preparation was analysed to classify the role of lectures in the context of teaching media in times of digitalization. We hope to be able to make recommendations for teaching in orthopaedics and trauma surgery on the basis of the results.

At the beginning of the lecture series approximately 80% of a sample of 85 students (questionnaire 1) wanted to attend more than half of the orthopaedics lectures (Fig. 2a); however, only 15.1% of the students surveyed at the end of the lecture series (questionnaire 2) stated that they had attended more than 50% of the orthopaedics lectures (Fig. 2b). This self-assessment is in line with our count of the number of lecture attendees during the lecture series, which was 14.4% with an average of 44 attendees to the lectures out of 306 students surveyed. We assume that the discrepancy between the declaration of intent of the students and the actual attendance of the lecture results from our research setting: The first questionnaire was handed out during the facultative first lecture, which was presumably attended by students who were more interested in the subject and had an affinity for the lecture. The second questionnaire was handed out before the obligatory final orthopaedics examination, in which all students for the corresponding semester had to participate.

The video podcasts were used about twice as often as the lecture visit for examination preparation (Fig. 7), this assessment of the students was confirmed by our counts of lecture attendees and podcast users (Fig. 6). It should be noted that the use of the podcast offer does not exclude attending lectures: 10.7% of the students surveyed stated that they had always used the podcast and 22.5% frequently as a supplement to attending lectures (Fig. 4). Additionally, based on our survey design it could not be excluded that some students watched individual podcasts more than one time or did not watch the podcasts completely.

Only 13% of the students surveyed answered the concrete question of how often they had given up attending lectures due to the provision of a podcasts, with always, while 23% said they had done so frequently (Fig. 5). This observation coincides with previous studies which suggest that the provision of video podcasts does not lead to a heavy loss of lecture visits [1, 13, 15].

Mattick et al. compared the number of students attending facultative telemedical courses and courses with a lecturer present in 2003/2004. They found no statistically significant difference between the numbers of participants for both groups. Interestingly, Mattick et al. also described the trend observed by us that as courses progressed, fewer students participated in facultative courses with a lecturer present [13]. Later, during a 3-year observation period (2004–2006), Billings-Gagliardi and Mazor observed the participation behaviour of students at the University of Massachusetts Medical School, with at least 95% of the optional courses recorded and the material made available online for viewing or downloading. In an open question 197 students justified their decision to attend individual courses or to stay away from them. Of these students 90% stated that the availability of electronic learning materials had no influence on their decision to attend or stay away from events. The remaining 10% indicated that the availability of electronic teaching materials had contributed more to participation in the courses concerned [1]. These results are consistent with our observations that 91–95% of students consider the availability of lecture podcasts to be a meaningful complement to lecture attendance (Figs. 3 and 4).

According to Kuhn et al. almost all medical students [11] make intensive use of classical digital media such as PDF files and PowerPoint® presentations. At the same time, these classical digital media represent the only format that is established throughout Germany as part of medical studies [19]. In addition, a large number of students now use web-based knowledge and examination platforms for efficient examination preparation [11]. This statement is in line with our findings, showing a clear preference of the students for examination preparation with digitally available learning materials, such as lecture slides, web-based knowledge and examination platforms (AMBOSS) and video podcasts, coincides with classical analogue learning options through attendance at lectures or textbooks (Fig. 7).

There are several studies on the influence of video podcasts on medical examination results [3, 7, 21, 22]. Brockfeld et al. compared the results of 205 students in a 301 MC questionnaire in 2014, where 1 group followed a 41‑h course with a lecturer present and the other group followed the 41‑h course as a video. The first group answered 78.3% of the questions in the subsequent MC test correctly, the second group 78.6% [3]. In our study, those students who used podcasts to prepare for the final examination answered 89.8% of the questions correctly on average, and those who prepared without podcasts answered 89.0% correctly on average. Schreiber et al. came to similar conclusions: 100 students were randomized to attend either a lecture with a lecturer present or watch a video podcast on two clinical topics and then examined both groups with a MC questionnaire. The lecture groups answered 90.2% of the questions correctly on average, the podcast groups 87.8% without being able to find a statistically significant difference [21]. Davis et al. also found no significant difference in the increase in knowledge between a lecture group and a podcast group on the same medical topic in a similarly designed experimental setup with 229 medical students [7]. An exception is the study by McNulty et al. in which the frequency of podcast use by students was correlated with their course grades: Interestingly, the group of students who had used the fewest video podcasts for preparation had significantly better results than the group of students who had used the video podcast most intensively [15]. The authors justified their observation with the fact that the frequency of use of video podcasts seemed to be higher among students who had problems understanding the topic. Another study by the same research group showed that more frequent use of Internet-based learning materials by students was associated with better examination results [14]. In a study by Rizzolo et al. those students in the examinations who relied the least on Internet-based media for examination preparation scored worst [20].

In the final evaluation of the orthopaedics lecture series, the students gave positive feedback throughout for the provision of online podcasts; however the thematic overlapping of lecture topics, an overloading of individual topics and a missing common theme during the lecture series were criticized. The statements of our students in the free text responses corresponded with the observations of Schreiber et al. who in their previously described experimental set-up had the students evaluate both the quality of the lecture and the online podcasts. The presentation and content quality of the podcasts were consistently rated somewhat worse than that of the lectures; however, the students praised the possibility of flexible learning over time with an online podcast and the ability to pause the podcast, repeat specific sections or the whole podcast [21].

Ultimately, the quality of the lectures in terms of content, an interdisciplinary structure and the lecturers’ lecturing skills seem to have been decisive for the students’ assessment.

From the perspective of the lecturers, a critical aspect of the provision of online podcasts as part of a lecture series which has to be discussed, are data protection aspects. The use of patient-related data and images must be made anonymously and with the written consent of the parties involved. Patients participating in the lectures for demonstration purposes must sign a consent form or, if necessary, be removed from the lecture transcript. A lack of personnel and technical support [24], uncertainties in dealing with legal aspects of the online availability of lecture materials and the associated increased workload are still existing obstacles in the digitalization of such courses.

A limitation of our investigation is that not all lectures in orthopaedics could be provided as podcasts and that not all lectures were provided with PDF lecture slides. A conclusion as to whether the absence of individual podcasts or lecture slides had an influence on the relevant lecture topic in the examination results was not possible due to the test setting.

Furthermore, the average very good results in the final examination make it more difficult to investigate the influence of the learning materials or learning times used on the examination results. It might have been possible to find correlations between these influencing factors and the individual examination results if there had been a greater disparity.

Based on the given data, another limitation lies in the fact that no exact comparison between the changes of students’ motivation to participate in a lecture was possible. The first questionnaire was answered during the facultative first lecture with possibly more interested students whereas the second and third questionnaires were taken before the compulsory examination, with all students of the semester participating. This possibly caused a bias and increased the difficulties in comparing the data. A follow-up of all questionnaires was not possible due to the anonymous data collection for the first and second questionnaires.

Finally, in order to determine whether the provision of video podcasts would reduce the number of students attending the lectures, it would be desirable to count the number of attendees in the previous years of the orthopaedics lectures in order to objectify the statements made by the students.

Students in the age of digitalization use a variety of learning materials and are no longer tied to classical analogue teaching methods. They are increasingly using digital media such as online lecture slides, web-based knowledge and examination platforms and online podcasts to prepare for examinations instead of traditional analogue methods, such as attending lectures or acquiring knowledge through textbooks. The use of online podcasts did not have a negative or positive impact on the test performance.

The provision of video podcasts of the main lectures in orthopaedics was no reason for the majority of students not to attend the lecture. For most students, lecture podcasts were a useful supplement to attending lectures, and students praised the expansion of the teaching curriculum to include additional digital offers with positive comments in the evaluations.