Quality and accuracy of gastric cancer related videos in social media videos platforms

With more than 1 million new cases and 769,000 deaths worldwide, gastric cancer was the fifth most frequent cancer and fourth in cancer-related deaths in 2020 [1]. The incidence of gastric cancer mortality was 37.5% in Japan [2] and 39.9% in the United States [3] compared with 48.6% in China [4].

Social media has affected the public’s daily lives in ways that no one ever thought possible. In July 2021, there were a reported 4.48 billion social media users, equating to more than 57 percent of the total global population [5]. Social media platforms, constituting a powerful means of communication, are increasingly used for health information dissemination. TikTok is one of the most popular social media platforms with more than 1.1 billion monthly active users, 130 million of whom are in the United States [5]. However, TikTok cannot be used in China because of internet censorship. Douyin, the Chinese version of TikTok, has averaged more than 600 million daily active users [6]. Douyin is the most popular short video platform in mainland China. TikTok for global users and Douyin for Chinese users offer the same features and tools.

As the fastest-growing social media applications, their potential as educational tools for health-related content cannot be overlooked. Several studies document health-related topics that can be found on the sites, such as recovering from eating disorders [7], sex education [8] and cancer treatment [9, 10]. However, videos posted on social media are not peer‐reviewed and are commonly ranked according to popularity. Like other social media platforms, the spread of misinformation is a concern on TikTok [11]. Misinformation can confuse the public about diseases and dissuade patients from pursuing treatment. A few studies document the spread of public health-related misinformation on the topics of COVID-19 [12], vaccines [12] and other diseases, such as prostate cancer [13]. A recent study showed that misinformation regarding COVID-19 has undermined public health efforts to control the novel coronavirus [14].

To date, the characteristics of TikTok videos focusing on gastric cancer are unknown. Therefore, this study aims to assess the content, accuracy, and completeness of social media about gastric cancer on TikTok in multiple countries. We also want to share our thoughts on important future directions for managing social media for gastric cancer.

We queried the TikTok and Douyin mobile application on August 17, 2021, to locate videos that included any information about gastric cancer. The keyword “gastric cancer” was searched on TikTok in both English and Japanese and on Douyin in Chinese to identify related video clips. The results were sorted according to the applications’ proprietary search algorithm. The first 100 most popular videos were gathered and analyzed. The languages were limited to English and Japanese in TikTok and Chinese in Doyin. Videos that were duplicated, had no sound and were not directly related to gastric cancer were excluded.

Each video was assessed for content quality by two independent gastroenterological surgeons. All coders had studied in Japan at least one year and had sufficient experience in the diagnosis and management of gastric cancer. Any disagreements were discussed until a consensus was reached. The videos were further categorized as useful or useless according to educational content. Useful definitions contained scientifically correct information such as etiology, anatomy, symptoms, prevention, treatment, or prognosis. Useless definitions only addressed personal experience or testimony without any scientific content.

We employed the Quality Evaluation Scoring Tool (QUEST) and DISCERN as the instruments for assessing the quality of the information in each video. The QUEST has been confirmed to be a valid, reliable appraisal tool for websites [15]. It has a scoring matrix and range of possible total scores of 0–28 with a higher score indicating better quality. DISCERN has been one of the most widely adopted instruments for assessing the quality of health information [16]. It consisted of 16 questions in total, with each question scored from 1 to 5 points. Questions were divided into three sections: reliability (questions 1–8), quality information about treatment options (questions 9–15), and overall score (question 16).

To date, there are no validated tools for assessing the video content of gastric cancer. We developed a completeness checklist for evaluating gastric cancer video quality as shown in Table 1. The six categories cover most aspects of gastric cancer from etiology and treatment to prognosis. We first applied the completeness score in our previous study about internet videos and colorectal cancer [17]. The completeness score compared with that of a previous study that contained the same six categories, but the details were slightly different according to the different types of cancer.

Statistical analysis was performed with SPSS Version 23 software. Data were summarized as frequencies (n) and percentages (%) for categorical variables and means or medians (standard deviations or ranges) for continuous and ordinal variables, respectively. The one‐way ANOVA was used to compare the differences between the groups. A p value less than 0.05 was considered significant.

The use of video broadcasting sites as a source of information about malignant tumors, such as colorectal cancer [18], thyroid cancer [19], larynx cancer [20] and skin cancer [21], has been evaluated. Many studies have reported that video broadcast sites have positive and negative effects on health information dissemination. Some videos can provide useful information for surgery education [22, 23]. Videos may also promote misleading information, such as promoting -anorexia as a healthy lifestyle [24] and describing ineffective or potentially dangerous natural therapies for gallstone disease [25]. Not only were audience members attempting therapies that might be harmful, but they were not going in for proven therapies, which could lead to other complications.

TikTok, known in China as Douyin (literally “shaking sound” in Chinese), is a video-sharing platform and social networking service. TikTok and Douyin have almost the same user interface but no access to each other’s content. Since its launch in 2016, TikTok/Douyin has rapidly gained popularity worldwide.

There are huge differences in the global distribution of morbidity and mortality associated with gastric cancer. Half of the incidence of gastric cancer has been reported in East Asian countries, especially in Japan and China. The mortality from gastric cancer in Japan and China 'ranks first among all cancers. Japan’s is leading the way in the prevention, diagnosis and treatment of gastric cancer worldwide, which is considered a good example for Chinese doctors to follow. There are some differences in gastric cancer between the two countries. The 5-year survival of gastric cancer in China is low because more than 80% of patients are diagnosed at an advanced stage [26]. However, due to the national program for gastric cancer screening, the rate of diagnosis and treatment of early gastric cancer in Japan is 70% [27]. In this study, we also want to explore the difference between the contents in the two countries. The Japanese and Chinese keywords were searched in the video platforms.

Private users represent the greatest number of sources in English and Japanese. The contents were mainly about personal experiences regarding surgical procedures or hospital stays. Content concerning self-motivation or supportive families was found in some English and Japanese videos but not in Chinese videos. Patients in these developed countries were more optimistic than those in China. The Chinese videos uploaded by private users accounted for only 3%. Chinese cancer patients have a higher risk of anxiety and depression with cancer [28]. More than half of the patients in China did not know their exact diagnosis before chemotherapy [29]. In China, when disclosing a life-threatening diagnosis such as cancer to a patient, the “family consent for disclosure” approach is adopted by physicians [30]. Our results also show that English-speaking and Japanese doctors contribute fewer videos to the platforms. Some studies reported the use of other video-based platforms (e.g., Vimeo and YouTube) for medical education [31, 32]. Doctors in the United States and Japan may use such social media platforms to disseminate health information [33, 34]. They frequently experience intense and stressful work [35, 36] and tend to experience burnout, which may be the other reason for the result. Health professionals contributed the most videos in Chinese. Chinese patients prefer specialist hospitals and large hospitals, as measured by the number of beds and surgeries [37]. With the increasing popularity of Web 2.0 technologies, people are seeking health information online more frequently. Both the effort and reputation of physicians online contribute to the increased number of patient consultations [38]. To attract more patients, Chinese doctors are focusing on social media to extend their influence.

When video content was analyzed, the most popular video topics were prognoses in English, symptoms in Japanese, and preventative measures in Chinese. This may indicate that prognosis was the most important aspect for most English-speaking uploaders. The incidence of gastric cancer is steadily declining in Europe and the United States, and the overall five-year survival rate is 31% [39]. Most uploaders were private users who were more concerned about the prognosis. The aspect of symptoms is the most covered topic among Japanese individuals, which may be related to early cancer screening and the popularization of disease knowledge among the public in Japan. China has a great burden of gastric cancer, and the diagnosis rate of early-stage disease is relatively low. Awareness of the disease is essential for screening and early detection. The aspect of gastric cancer prevention has garnered increasing attention recently in China.

The average scores for completeness in our study were not high. Most of the analyzed videos only included one or two categories. It has been reported that videos with longer durations and higher video power indices seem to be associated with higher quality scores [19, 40]. Videos on TikTok are limited to 3 min. Due to the short length of videos, it is impossible to expect each video to comprehensively cover all aspects of gastric cancer; therefore, individuals will view videos that do not contain important and valuable content. However, recent research suggests that TikTok has great potential in conveying important public health messages to various segments of the population. Some videos can provide useful resources for information dissemination for chronic disease management [40] and personal protection [41]. Our results indicated that videos from health professionals have significantly higher completeness scores than those posted by private users. Studies on other video platforms, such as YouTube, also showed that the overall quality of the cancer videos was poor [42]. Health care professionals should be encouraged to upload cancer-related videos with accurate information to encourage patients to screen and direct them appropriately [43, 44]. Patients are increasingly turning to social media for health information, where most TikTok videos are posted by laypeople. The study illustrates that professionals should contribute more high-quality videos and leverage the power of this social media channel as a public information source.

There are limitations to our study. First, We only use QUEST and DISCERN to assess the quality of included videos. However, we encourage more studies using a variety of instruments to triangulate the validity of these findings in the future. Second we only used “gastric cancer” without including “stomach cancer” or “stomach neoplasm” to search videos on TikTok which may led miss some appropriate videos. Third, we only selected TikTok to analyze gastric cancer videos, given that it is reported as the most popular social media app. There are other platforms such as YouTube and Vimeo, etc. And content in other platforms may show different results and conclusions. Fourth, This study only comprises a snapshot of information when the study data were collected and may change due to new videos being uploaded or removed with time.

Despite these limitations and delimitations, this study is one of the first to describe how TikTok is being used to disseminate information about gastric cancer. TikTok has great potential in conveying important health messages to public due to its widespread reach, but its limitations are also obvious, including too short videos containing not enough information, issues with unchecked spread of misinformation, difficulty identifying source credibility. TikTok in English and Japanese might not fully meet the gastric cancer information needs of public, but Douyin in Chinese was the opposite. Patients should remain cautious and selective when watching gastric cancer videos on TikTok. If patients want to seek useful information, it is better to seek videos uploaded by health professionals. It is necessary that healthcare professionals and academic institutions apply the characteristics of highly viewed video and think useful methods to solve the variable quality of information uploaded on TikTok. Content creators should be encouraged to direct public to evidence-based resources from health professionals and institutions. To maximize the potential of video-based information and minimize the quantity misleading or unhelpful information, multilateral efforts between healthcare professors, governments and social media platforms are needed.