Ann Surg Treat Res. 2015 Aug;89(2):92-97. English.
Published online Jul 09, 2015.
Copyright © 2015, the Korean Surgical Society
Original Article

YouTube as a potential training method for laparoscopic cholecystectomy

Jun Suh Lee, Ho Seok Seo,1 and Tae Ho Hong
    • Department of Surgery, Seoul St. Mary's Hospital, The Catholic University of Korea College of Medicine, Seoul, Korea.
    • 1Department of Surgery, Armed Forces Capital Hospital, Seongnam, Korea.
Received January 05, 2015; Revised January 27, 2015; Accepted March 10, 2015.

Annals of Surgical Treatment and Research is an Open Access Journal. All articles are distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Purpose

The purpose of this study was to analyze the educational quality of laparoscopic cholecystectomy (LC) videos accessible on YouTube, one of the most important sources of internet-based medical information.

Methods

The keyword 'laparoscopic cholecystectomy' was used to search on YouTube and the first 100 videos were analyzed. Among them, 27 videos were excluded and 73 videos were included in the study. An arbitrary score system for video quality, devised from existing LC guidelines, were used to evaluate the quality of the videos. Video demographics were analyzed by the quality and source of the video. Correlation analysis was performed.

Results

When analyzed by video quality, 11 (15.1%) were evaluated as 'good', 40 (54.8%) were 'moderate', and 22 (30.1%) were 'poor', and there were no differences in length, views per day, or number of likes, dislikes, and comments. When analyzed by source, 27 (37.0%) were uploaded by primary centers, 20 (27.4%) by secondary centers, 15 (20.5%) by tertiary centers, 5 (6.8%) by academic institutions, and 6 (8.2%) by commercial institutions. The mean score of the tertiary center group (6.0 ± 2.0) was significantly higher than the secondary center group (3.9 ± 1.4, P = 0.001). The video score had no correlation with views per day or number of likes.

Conclusion

Many LC videos are accessible on YouTube with varying quality. Videos uploaded by tertiary centers showed the highest educational value. This discrepancy in video quality was not recognized by viewers. More videos with higher quality need to be uploaded, and an active filtering process is necessary.

Keywords
YouTube; Gallbladder; Laparoscopic cholecystectomy

INTRODUCTION

In 1999, Darcy DiNucci coined the term 'Web 2.0', which describes websites that allow users to interact with each other as creators of user-generated contents, in contrast to web sites where people are limited to the passive viewing of contents [1]. A widely used example of web 2.0 is YouTube (www.youtube.com), a video sharing website that allows unregistered users to watch videos and registered users to upload an unlimited number of videos. The viewers can express their thoughts on each video by clicking on 'like' or 'dislike', or by leaving a comment. The number of likes, dislikes, and comments, as well as the number of views, are shown beneath the title of each video.

As more people use the internet to access medical information, YouTube is becoming one of the most important sources of internet-based medical information. Accordingly, many authors have published studies assessing the quality of medical information on YouTube. While some studies have focused on videos aimed at the general public [2, 3, 4], others have focused on videos aimed at the medical professionals [5, 6, 7].

Gallstone disease is one of the most prevalent gastrointestinal disorders [8]. The gold standard of treatment for symptomatic gallstone disease is laparoscopic cholecystectomy (LC) [9]. LC is also one of the essential procedures in a surgeon's training program. Due to the video-based characteristic of laparoscopic surgery, YouTube is a potential training aid for young surgeons, but the quality has not been assessed.

The purpose of this study was to analyze the quality of LC videos accessible on YouTube from a procedural point of view, and to assess whether these videos are appropriate for the training surgeon.

METHODS

Study design

YouTube was searched on March 1, 2014 by using the keyword 'laparoscopic cholecystectomy'. Under the assumption that the viewer would not go past the first five pages of the search results, the first 100 videos were analyzed. The surgical videos demonstrating the procedures of LC were included, and the videos with contents other than surgery, such as patient education, 3-dimensional animation, or hospital commercials were excluded. Also, videos demonstrating other procedures such as common bile duct exploration were excluded.

The patient factors and outcome variables were reviewed based on the following: lengths of the videos; sources of the videos (primary center, secondary center, tertiary center, academic institution, or commercial institution); number of views, likes, dislikes, and comments; countries of origin; and surgical techniques (method of access, video score, intraoperative cholangiogram, method of removal, etc.).

Institutional Review Board approval was unnecessary for this study, because only public access data were used.

Outcome measurement

Since there are no established standards for assessing video quality, an arbitrary score system was devised, based on existing LC guidelines [10, 11, 12, 13]. The categories comprising the video score and the scoring system for each category are shown in Table 1. The video score consists of seven categories, with a total score of 0 to 10. The following were analyzed: starting point of dissection, the direction of infundibular retraction, demonstration of the critical view of safety (CVS), the sequence of cutting structures, the length of the cystic duct stump, use of electrocautery, and demonstration of final hemostasis. The most importance was given to demonstration of the CVS. Videos with a score of 0 to 3 were deemed as 'poor', 4 to 7 as 'moderate', and 8 to 10 as 'good'.

Three individual researchers evaluated the quality of the video. To minimize the rate of disagreement, specific standards were devised for the each criterion of the video score. In case of disagreement, all three researchers conferred and decided on an appropriate score.

Statistical analysis

The data was analyzed with IBM SPSS Statistics ver. 20.0 (IBM Co., Armonk, NY, USA). Continuous variables were compared using Kruskal-Wallis analysis, with post hoc analysis using the Mann-Whitney test. The Bonferroni method was used to set the significance method. Spearman rank coefficient was used to analyze correlation. A weighted kappa score was calculated to evaluate interobserver variability.

RESULTS

One hundred videos were analyzed. Among the 100 videos, 27 were excluded and 73 videos were included in the study. Of the 27 excluded videos, 12 videos contained contents other than LC such as hospital promotion, 8 were incomplete videos, and 7 were duplicates.

The videos included in the study were categorized by video quality and upload source. Table 2 shows the demographics of videos by quality. Among 73 videos, 11 (15.1%) were evaluated as 'good', 40 (54.8%) were 'moderate', and 22 (30.1%) were 'poor'. Since the categorization was based on video quality, significant differences were noted in the mean score between all groups (P < 0.001). The mean scores were 8.4 ± 0.5 for the good video quality group, 5.4 ± 1.0 for the moderate video quality group, 2.9 ± 0.3 for the poor video quality group, and 5.1 ± 1.9 for the entire group.

Table 2
Analysis by video quality

There were no differences in the lengths of videos, views per day, or number of mean likes, dislikes, and comments. Most of the good videos were uploaded by tertiary centers (45.5%), whereas most of the poor videos were uploaded by secondary centers (54.5%).

Table 3 shows the demographics of videos by upload sources. Twenty seven (37.0%) were uploaded by primary centers, 20 (27.4%) by secondary centers, 15 (20.5%) by tertiary centers, 5 (6.8%) by academic institutions, and 6 (8.2%) by commercial institutions. The mean score of the tertiary center group (6.0 ± 2.0) was significantly higher than that of the secondary center group (3.9 ± 1.4). The number of mean views was significantly higher in the secondary center group, compared to the tertiary center group. There were no differences in views per day or number of mean likes, dislikes, and comments. Most videos included in the primary and tertiary center groups were of a moderate quality (primary 59.3%, tertiary 50.0%), but in the secondary center group, most videos were poor (60.0%).

Table 3
Analysis by video source

A correlation analysis was performed. The video score had no correlation with views per day or number of likes, dislikes, and comments. However the views per day and the number of likes, dislikes, and comments all had a positive correlation with each other.

The interobserver variability, calculated as a weighted kappa score, was 0.80 between researcher 1 and 2, 0.77 between 2 and 3, and 0.90 between 3 and 1.

DISCUSSION

YouTube is a website that was established in 2005. It has grown in size, to become one of the most popular websites in the world. In 2007, Keelan et al. [14] reported their results of analyzing immunization videos on YouTube. Since then, the number of studies published on this medical topic has been steadily increasing. These studies come from the various fields of medicine from pediatrics, orthopedics, and internal medicine. This study is the first one to evaluate the videos on general surgery procedures on YouTube.

Compared to open surgery, laparoscopic surgery is easier to record. In an open surgery, a separate video camera has to be set up to record the procedure. But in laparoscopic surgery, the entire procedure is already being performed through the videoscope. Also, in an open surgery, there is a considerable discrepancy between the surgeon's field of vision during the surgery and the recorded view. But in a laparoscopic surgery, the video shows exactly what the surgeon was viewing during the procedure. Due to these characteristics, many videos of laparoscopic surgery procedures have been uploaded on YouTube, and many viewers are watching them.

In this study, LC videos were analyzed. The potential viewers, of LC videos uploaded on YouTube, can be placed into the two broad categories, medical personnel and individuals seeking medical information. Medical personnel include medical students, surgical interns and residents, and active surgeons seeking to learn or master LC. Individuals seeking medical information would include the patients who are scheduled to undergo LC, family members of such patients, or individuals seeking information on LC for other reasons. Providing these individuals with the details of surgery are important to help them make informed decisions about their treatments. However, for the viewers who are medical personnel, demonstrating each step of the surgical procedure may have tremendous educational value.

In a recent article, the authors have analyzed YouTube videos on gallstone disease [15]. In conclusion, more than half of the videos had misleading contents. Also, the quality of videos did not correlate with the number of views or number of likes. The results of the present study were in line with these findings. As shown in Table 2, the number of likes, dislikes, and comments did not differ according to the video quality. Also, the correlation analysis showed no correlation between the video score and the number of likes, dislikes, and comments. It can be inferred that the videos of poor quality are equally viewed as much as the videos with higher quality. Also, the preference of the viewers did not seem to differ between these videos. The results on Table 3 show that the videos uploaded by the tertiary centers had a significantly higher mean score compared to that of the secondary centers. But the number of views was significantly lower in the tertiary center group. This finding may have limited significance, since the number of views per day did not differ. All things considered, it seems that videos of the tertiary center group have better quality than that of the secondary center group, yet the viewers are not showing differences in their preference between the two groups. Out of 15 videos uploaded by tertiary centers, 5 (33.3%) demonstrated CVS. In contrast, out of 20 videos uploaded by secondary centers, only 2 (10%) videos demonstrated CVS. Since many tertiary centers are teaching hospitals, the surgeons may have been more familiar with the concept of CVS. It can be inferred that the purpose of these videos from the secondary centers was to promote and advertise their hospitals, rather than to teach novice surgeons.

The standard procedure in LC uses 4 trocars. Many authors have published studies evaluating alternative methods for using less trocars. In our study, 50 videos (68.5%) used 4 trocars, 9 (12.3%) used 3 trocars, and 14 (19.2%) used a single incision. In the case of single incision laparoscopic surgery (SILS), the lack of triangulation makes the surgery difficult. There is evidence that CVS is necessary even in SILS [16], but in most videos using SILS, CVS was not demonstrated. But some videos demonstrated CVS even in SILS, by using intracorporeal suture to retract the fundus. With the fundus retracted, one instrument can be used to retract the infundibulum laterally, exposing the triangle of Calot. After dissection, CVS can be demonstrated. A recent study concluded that postoperative pain is most severe after LC with 4 trocars, when compared to the methods using less trocars [17]. In a different study, no significant advantages were noted in the surgery using fewer than 4 ports [18]. Even with contradictory evidence, performing surgery with less trocars has obvious advantages for the patient. However, if a novice surgeon who has not yet mastered LC, attempts to perform surgery using fewer than 4 ports, there is a risk of complications.

As discussed before, there has been a surge in articles evaluating YouTube videos. A recent systematic review concluded that YouTube holds a vast amount of data regarding health care, some of which are incorrect or misleading [19]. But a standard method of analysis has not yet been established, so the analyzing methods widely vary according to the authors. There have been efforts to establish guidelines for analyzing YouTube video contents, which gave limited results [20]. A standard guideline is necessary for the future research.

This study has several limitations. We used a 'snapshot' analysis and the contents of videos may change over time. Also, the videos were searched in the order of relevance, which is the default setting for sorting on the YouTube website. The results may change if the videos were sorted in a different order.

In conclusion, there are many YouTube videos demonstrating LC with a wide range of video quality. Videos uploaded by tertiary centers showed the highest educational value. The discrepancy in video quality was not recognized by the video viewers. More videos with higher quality need to be uploaded, and an active filtering process should be implemented on the YouTube website.

Notes

CONFLICTS OF INTEREST:No potential conflict of interest relevant to this article was reported.

References

    1. Web 2.0 [Internet]. San Francisco (CA): Wikimedia Foundation Inc.; c2015 [cited 2014 Apr 3].
    1. Sorensen JA, Pusz MD, Brietzke SE. YouTube as an information source for pediatric adenotonsillectomy and ear tube surgery. Int J Pediatr Otorhinolaryngol 2014;78:65–70.
    1. Strychowsky JE, Nayan S, Farrokhyar F, MacLean J. YouTube: a good source of information on pediatric tonsillectomy? Int J Pediatr Otorhinolaryngol 2013;77:972–975.
    1. Tan ML, Kok K, Ganesh V, Thomas SS. Patient information on breast reconstruction in the era of the world wide web. A snapshot analysis of information available on youtube.com. Breast 2014;23:33–37.
    1. Fischer J, Geurts J, Valderrabano V, Hugle T. Educational quality of YouTube videos on knee arthrocentesis. J Clin Rheumatol 2013;19:373–376.
    1. Koya KD, Bhatia KR, Hsu JT, Bhatia AC. YouTube and the expanding role of videos in dermatologic surgery education. Semin Cutan Med Surg 2012;31:163–167.
    1. Topps D, Helmer J, Ellaway R. YouTube as a platform for publishing clinical skills training videos. Acad Med 2013;88:192–197.
    1. Yoo EH, Lee SY. The prevalence and risk factors for gallstone disease. Clin Chem Lab Med 2009;47:795–807.
    1. Duncan CB, Riall TS. Evidence-based current surgical practice: calculous gallbladder disease. J Gastrointest Surg 2012;16:2011–2025.
    1. Eikermann M, Siegel R, Broeders I, Dziri C, Fingerhut A, Gutt C, et al. Prevention and treatment of bile duct injuries during laparoscopic cholecystectomy: the clinical practice guidelines of the European Association for Endoscopic Surgery (EAES). Surg Endosc 2012;26:3003–3039.
    1. Overby DW, Apelgren KN, Richardson W, Fanelli R. Society of American Gastrointestinal and Endoscopic Surgeons. SAGES guidelines for the clinical application of laparoscopic biliary tract surgery. Surg Endosc 2010;24:2368–2386.
    1. Strasberg SM, Brunt LM. Rationale and use of the critical view of safety in laparoscopic cholecystectomy. J Am Coll Surg 2010;211:132–138.
    1. Wauben LS, Goossens RH, van Eijk DJ, Lange JF. Evaluation of protocol uniformity concerning laparoscopic cholecystectomy in the Netherlands. World J Surg 2008;32:613–620.
    1. Keelan J, Pavri-Garcia V, Tomlinson G, Wilson K. YouTube as a source of information on immunization: a content analysis. JAMA 2007;298:2482–2484.
    1. Lee JS, Seo HS, Hong TH. YouTube as a source of patient information on gallstone disease. World J Gastroenterol 2014;20:4066–4070.
    1. Ross S, Rosemurgy A, Albrink M, Choung E, Dapri G, Gallagher S, et al. Consensus statement of the consortium for LESS cholecystectomy. Surg Endosc 2012;26:2711–2716.
    1. Li L, Tian J, Tian H, Sun R, Wang Q, Yang K. The efficacy and safety of different kinds of laparoscopic cholecystectomy: a network meta analysis of 43 randomized controlled trials. PLoS One 2014;9:e90313.
    1. Gurusamy KS, Vaughan J, Rossi M, Davidson BR. Fewer-than-four ports versus four ports for laparoscopic cholecystectomy. Cochrane Database Syst Rev 2014;2:CD007109.
    1. Madathil KC, Rivera-Rodriguez AJ, Greenstein JS, Gramopadhye AK. Healthcare information on YouTube: a systematic review. Health Informatics J. 2014 Mar 25; [doi: 10.1177/1460458213512220]
      [Epub].
    1. Sampson M, Cumber J, Li C, Pound CM, Fuller A, Harrison D. A systematic review of methods for studying consumer health YouTube videos, with implications for systematic reviews. PeerJ 2013;1:e147.

Metrics
Share
Tables

1 / 3

PERMALINK