Background
Methods
Inclusion criteria
Search strategy
1. (appointment$ OR consultation$).tw,kf | 49. exp Attitude to Health.sh (includes Health Knowledge, Attitudes, Practice/, Patient Acceptance of Health Care/)
|
2. Health Communication.sh | 50. Self Efficacy.sh |
3. (health ADJ3 communicat$).tw,kf | 51. (self ADJ efficacy).tw,kf |
4. OR/ 1-3 | 52. (health ADJ competence).tw,kf |
5. (e-communicat$ OR ecommunicat$).tw,kf | 53. Health Behavior.sh |
6. (e-health OR ehealth).tw,kf | 54. ((health ADJ behavi*r$) OR (chang$ ADJ3 behavi*r$) OR (behavi*r$ ADJ3 change$)).tw,kf |
7. electronic$.tw,kf | 55. exp Self Care.sh (includes Blood Glucose Self-Monitoring/, Self Administration/ and Self Medication/)
|
8. virtual.tw,kf | 56. (self ADJ manag$).tw,kf |
9. Virtual Reality.sh | 57. exp Patient Satisfaction.sh (includes Patient Preference/)
|
10. (virtual ADJ reality).tw,kf | 58. OR/ 39-57 |
11. (Hypermedia OR Multimedia).sh,tw,kf | 59. Randomized Controlled Trial.sh |
12. animation.tw,kf | 60. Randomized Controlled Trials as Topic.sh |
13. ((information ADJ technolog$) OR IT).tw,kf | 61. (randomized controlled trial).pt |
14. (Decision Making, Computer-Assisted OR Therapy, Computer-Assisted).sh | 62. (controlled clinical trial).pt |
15. (computer ADJ (assisted OR based OR mediated)).tw,kf | 63. Random Allocation.sh |
16. (Computers OR Computers, Handheld).sh | 64. Double-blind Method.sh |
17. (computer$ OR (hand ADJ held ADJ3 computer$) OR (handheld ADJ3 computer$)).tw,kf | 65. Single-blind Method.sh |
18. (mobile ADJ communic$).tw,kf | 66. OR/ 59-65 |
19. ((personal ADJ digital ADJ assistant) OR pda$ OR (pocket ADJ pc) OR (pocket ADJ computer$)).tw,kf | 67. Animals.sh NOT Humans.sh |
20. ipad$.tw,kf | 68. 66 NOT 67 |
21. Internet.sh,tw,kf | 69. (clinical trial).pt |
22. World Wide Web.sh | 70. exp Clinical Trial.sh (includes Clinical Trial, Phase I/, Clinical Trial, Phase II/, Clinical Trial, Phase III/, Clinical Trial, Phase IV/, Controlled Clinical Trial/, Multicenter Study/ and Randomized Controlled Trial/)
|
23. ((world ADJ wide ADJ web) OR www OR website$ OR (web-site$) OR (web ADJ based) OR (web-based) OR webbased).tw,kf | 71. Case-Control Studies.sh |
24. Online Systems.sh | 72. (clin$ ADJ25 trial$).tw,kf |
25. (online OR on-line OR portal).tw,kf | 73. ((single OR double OR triple OR treble) ADJ25 mask$).tw,kf |
26. Compact Disks.sh OR CD-I.sh OR CD-ROM.sh | 74. Placebos.sh |
27. ((cd ADJ rom$) OR cd-rom$ OR cdrom$).tw,kf | 75. (placebo$ OR random$).tw,kf |
28. Software.sh,tw,kf | 76. Research Design.sh |
29. (interactive ADJ3 (technolog$ OR application$ OR program$) OR ITA).tw,kf | 77. OR/ 69-76 |
30. Video Games.sh | 78. 77 NOT 67 |
31. ((video OR computer) ADJ game$).tw,kf | 79. 78 NOT 68 |
32. (wii OR nintendo).tw,kf | 80. (Comparative Study OR Evaluation Studies OR Follow-Up Studies OR Prospective Studies).sh |
33. OR/ 5-32 | 81. (control$ OR prospectiv$ OR volunteer$).tw,kf |
34. Pediatrics.sh | 82. intervention$.tw,kf |
35. (p*ediatric OR p*ediatrics).tw,kf | 83. OR/ 80-82 |
36. Child.sh,tw,kf | 84. 83 NOT 67 |
37. (children OR childhood).tw,kf | 85. 84 NOT (68 OR 79) |
38. OR/ 34-37 | 86. 68 OR 79 OR 85 |
39. (Diet OR Diet Therapy OR Nutrition Therapy).sh | 87. 4 AND 33 AND 38 AND 58 AND 86 |
40. (diet$ OR nutrition$).tw,kf | 88. limit 87 to yr=1990-2012 |
41. (Health Education OR Patient Education as Topic).sh | 89. exp Schools.sh (includes Schools Medical/, Schools Nursery/ and Universities/)
|
42. (health ADJ education).tw,kf | 90. Vocational Education.sh |
43. Health Promotion.sh | 91. 88 NOT (89 OR 90) |
44. ((health ADJ promotion) OR (promot$ ADJ health)).tw,kf | |
45. Patient Participation.sh | |
46. exp Patient Compliance.sh (includes Medication Adherence/)
| |
47. Motivation.sh | |
48. motivat$.tw,kf |
Exclusion criteria | No. of studies | and references |
---|---|---|
No children 7–11 years | 0 |
2
|
No educational multimedia | 3 | |
Not recruited from active clinical treatment lists | 11 | |
Participants have no diagnosed health condition | 2 | |
No comparison group | 8 | |
Descriptive paper, not an intervention study | 5 | |
Abstract/summary article | 1 | [53] |
Data extraction
Quality appraisal
Category | Quality item | Scoring criteria |
---|---|---|
MI development
| Evidence-basis and theoretical underpinning of intervention design | Was the multimedia intervention (MI) developed according to cited evidence-based guidelines related to the health condition? And/or was mention made of theoretical constructs used in the development of the MI? |
• If either or both of these aspects were mentioned, the quality is coded as YES, otherwise it is coded as NO
| ||
• PARTIAL YES (½) is given to interventions that only invite health professionals to be involved in the design and/or development, i.e. no reference to clinical guidelines or theoretical underpinning | ||
Intervention piloting/ testing prior to study commencement | Was the MI piloted during or after the development phase with children of the appropriate age range? Was the MI developed for children of a specified age range, and was it then piloted with this age group prior to undertaking the study? | |
• The quality is coded as YES if piloting, or iterative child-involvement, has been integral to the MI design and/or development or post-development piloting has taken place that may have led to amendments | ||
• Where piloting or testing has been mentioned, without details about the rigour of the process (such as the ages of the children, the number of children involved, the outcome of the piloting process, etc.), the quality is coded as PARTIAL YES (½) | ||
• The quality is coded as NO if no mention is made of child-involvement during development, piloting or testing | ||
Study design
| Appropriately selected age ranges for potential research participants | Did the study include children of an appropriate age range? If the MI was piloted or developed in conjunction with children, are study subjects of a similar age range? Could the MI design be developmentally appropriate for the youngest and the oldest study subjects? In other words, is the age range appropriate or is it too large? |
• The quality is coded as YES where the MI has been piloted or tested with children of a similar age to those recruited as study subjects, and the age range is ≤ 7-years | ||
• YES is also given to MIs catering for a wider range of ages, e.g. by way of different levels or difficulties, designed cope with the discrepancies in developmental ability of the children, and study data have been analysed and presented within narrower age ranges | ||
• PARTIAL YES (½) is given to studies where the age range is 7 to 8-years, and the above conditions have not been met | ||
• The quality is coded as NO if piloting of the MI took place with a different age group of children to those recruited to the study, without valid reason or explanation, or the age range of study participants was > 8-years with no stated strategy to deal with differences in developmental abilities | ||
Data collection
| Amount of time children viewed the multimedia intervention | How much time did children have to familiarise themselves with the content of the MI? Was the number of sessions reported? Was the length of these sessions stated? |
• In order to be coded as YES, the paper must indicate (even if a calculated estimate) the amount of time children spent using the intervention. This may be stated as a total time, or length of time for each session | ||
• A PARTIAL YES (½) is given if the total number of sessions is stated, with no indication of time spent viewing the MI | ||
• The quality is coded as NO if no data, data is unclear, or only partial data is provided (e.g. the length of the first session but not subsequent sessions) |
Results
Studies retrieved
-
Age–participants fell beyond the target 7 to 11-year age group (such as studies with exclusively preschool, adolescent or adult subjects);
-
No diagnosed health condition;
-
Participants not recruited from active clinical treatment lists;
-
No comparison or control group.
Study characteristics
Criterion | Category | No. of studies | And references |
---|---|---|---|
Country | United States | 11 | |
United Kingdom | 2 | ||
Germany | 1 | [73] | |
Ethnic majority | White and ‘Caucasian’ | 5 | |
African-American | 2 | ||
Hispanic-American | 2 | ||
Not reported | 5 | ||
Health condition | Type 1 diabetes | 1 | [70] |
Dental malocclusion | 1 | [9] | |
Leukemia (remission) | 1 | [69] | |
Nocturnal enuresis | 1 | [6] | |
Asthma | 7 | ||
Cystic fibrosis | 1 | [74] | |
Encopresis | 1 | [71] | |
Sickle cell disease | 1 | [65] | |
Recurrent headache (non-malignant) | 1 | [72] | |
Sample size | Reported sample size calculation | 3 | |
No sample size calculation; total participants n < 120 | 6 | ||
No sample size calculation; total participants n ≥ 120 | 5 | ||
Intervention | < 6 months | 7 | |
length | ≥ 6 months | 7 | |
Follow-up | None | 10 | |
(post- intervention) | < 6 months | 1 | [72] |
≥ 6 months | 3 | ||
Quality assessment ratings | 0 | 0 | |
½ | 0 | ||
1 | 1 | [9] | |
1½ | 1 | [74] | |
2 | 5 | ||
2½ | 3 | ||
3 | 3 | ||
3½ | 1 | [8] | |
4 | 0 |
Risk of bias
Quality assessment
Heterogeneity
Criterion | Category | No. of studies | And references |
---|---|---|---|
MI type | Nintendo® game console | 1 | [70] |
CD-ROM | 9 | ||
Web-based | 4 | ||
MI group information formats1
| Multimedia only | 13 | |
Multimedia + written information | 1 | [7] | |
Comparison group | None§* | 7 | |
information formats1
| Written information, e.g. leaflets* | 5 | |
Conventional aids, i.e. dental models, radiographs* | 1 | [9] | |
Not reported | 1 | [68] | |
Intervention setting | Outpatient clinic | 6 | |
During hospitalisation | 1 | [65] | |
At home | 6 | ||
At school (school nurse office) | 1 | [68] | |
Time MI used | < 60 minutes | 2 | |
1–2 hours | 4 | ||
≥ 2 hours | 4 | ||
Unclear | 2 | ||
Not reported | 2 | ||
Intervention length | < 6 months | 7 | |
≥ 6 months | 7 | ||
Follow-up | None | 10 | |
(post-intervention) | < 6 months | 1 | [72] |
≥ 6 months | 3 |
Participant age
Multimedia intervention (MI)
Multimedia intervention (MI) use, study duration and follow-up
Outcome measures
Study outcome | No. of studies | Study | Outcome measures/scale1
| Reliability tested2
| p-value3
| ES (d) |
---|---|---|---|---|---|---|
Communication | 2 | [70] |
No. child-initiated diabetes discussions: Parent recall (one month) | No | 0.0025 | |
[9] | Child Satisfaction Survey: | No | ||||
Felt involved in the consultation
| <0.05 | |||||
Orthodontist understands me
| ns | |||||
Satisfaction | 35
| [70] |
User satisfaction: Instrument not described | No | ns | |
[9] |
Liked the explanation: Satisfaction Survey4
| No | ns | |||
[69] | Satisfaction and Use Questionnaire: | No | ||||
Used assigned intervention ≥ once
| 0.001 | |||||
Used intervention ‘for a long time’
| 0.0006 | |||||
Found intervention ‘easy to use’
| ns | |||||
DNA rate | 3 | [6] |
DNA at least 1 appt
| N/A | ns | |
DNA two consecutive appts
| N/A | N/K6
| ||||
[67] |
Appts kept out of total planned appointments
| N/A | 0.04 | |||
[66] |
Appts kept out of total planned appointments
| N/A | ns | |||
Knowledge acquisition | 12 | [70] | Interview questions, blood glucose logbook, food exchange chart | No | ns | |
[9] | Child Short Answer Knowledge Questionnaire4: | No | ||||
Three major orthodontic problems
| <0.05 | |||||
Two orthodontic appliances/devices used
| ns | |||||
Three risks
| ns | |||||
Two instructions followed
| ns | |||||
Total recall and retention of information presented
| <0.05 | |||||
[69] | Leukemia Event Knowledge Interview [78] | Yes | 0.039 | |||
[74] | Cystic Fibrosis Knowledge Questionnaire (adapted Quittner & Drotar (1997))7
| Yes | <0.001 | |||
[67] | Child Knowledge of Asthma Management Questionnaire | Yes | 0.17 | |||
[66] | Child Knowledge of Asthma Questionnaire | No | <0.001 | |||
[7] | Pediatric Asthma Care Knowledge Survey | No | ns | |||
[68] | Child Knowledge of Asthma Management Questionnaire [67] | Yes | <0.0001 | |||
[8] | Asthma Knowledge Assessment | Yes | 0.001 | |||
[65]8
| Asthma Knowledge Scale (modified [79]) | Yes | ns | |||
How Much Do I Know About Sickle Cell Disease? Questionnaire (shortened [80]) | Yes | ns | ||||
[71] | Encopresis Knowledge Questionnaire | No | ns | |||
Virginia Encopresis/Constipation Apperception Test [81] | Yes | ns | ||||
Changes in self-efficacy | 10 | [70] | Interview questions | No | 0.025 | |
[9] | Child Satisfaction Survey4: | No | ||||
‘Satisfied that I know the causes’
| ns | |||||
‘Satisfied that I know the treatment’
| ns | |||||
‘Satisfied that I know the expected outcome’
| ns | |||||
‘Satisfied that I know the risks’
| ns | |||||
‘Satisfied with the explanation of the problems’
| <0.05 | |||||
‘Confidence in the Orthodontist’
| ns | |||||
‘Not afraid of the treatment’
| ns | |||||
[69] | Leukemia Children's Health Locus of Control [82] | Yes | 0.005 | |||
[74] | Role Play Inventory of Situations and Copy Skills [83] | Yes | <0.001 | |||
[6] | Self-esteem Scale (shortened [84]) | No | 0.02 | |||
[67] | Child Self-efficacy Expectations Questionnaire | Yes | 0.06 | |||
[68] | Child Self-efficacy Expectations Questionnaire [67] | Yes | <0.0001 | |||
[66] | Parent recall: Child attitude toward asthma care
| No | ns | |||
Parent recall: Behaviours related to asthma care
| No | ns | ||||
[8] | Yes | 0.007 | 0.5 | |||
[65]8
| Kidcope [86] | Yes | ns | |||
Kidcope [86] | Yes | ns | ||||
Health outcomes/symptoms | 10 | [70] | Long-term blood glucose control: HbA1c measurements | No | ns | |
[6] |
Time to dry (Length of time to achieve 14 consecutive dry nights): Not described | Not stated | ns | |||
Dry on discharge: Not described | Not stated | ns | ||||
Dry 6 months post-discharge: Questionnaire not described | Not stated | ns | ||||
[72] |
Headache activity: Headache Index Composite calculated from Headache Diary [87] | Yes | 0.04 | |||
Headache frequency, duration and severity: Pediatric Migraine Disability Assessment [88] | Yes | ns | ||||
[67] |
Asthma symptoms: Usherwood Symptom Questionnaire [89] | Yes | 0.029
| |||
[66] |
Asthma severity: Parent recall | No | ns | |||
[7] |
Lung function (FEV
1
): Instrument not described | Not stated | ns | |||
Days of asthma symptoms since last visit: | No | <0.01 | ||||
Parent recall | ||||||
[68] |
Asthma symptoms: Usherwood Symptom Questionnaire [89] | Yes | ns | |||
[8] |
Lung function (FEV
1
): Micromedical Super-Spiro spirometer | Not stated | ns | |||
Lung function (PEF): Mini-Wright Peak Flow Meter | Not stated | ns | ||||
[73] |
Lung function (FEV
1
): Instrument not described | Not stated | ns | |||
Lung function (PEF): Instrument not described | Not stated | ns | ||||
[71] | Child Information Form: | No | ||||
Trips to toilet without parental prompt
| 0.109 | |||||
Bowel movements in the toilet
| 0.001 | |||||
Overall encopresis symptom improvement
| 0.018 | |||||
Emergency medical visits | 6 | [70] |
Emergency room/GP visits over past 3 months
10
: Parent recall | No | ns | |
[67] |
Number of visits over past year: Parent recall | No | 0.03 | |||
[66] |
Emergency room visits: Parent recall | No | ns | |||
Acute GP visits: Parent recall | No | ns | ||||
[7] | Asthma Summary Since Last Visit Questionnaire: | No | ||||
Urgent medical visits
| <0.0001 | |||||
Emergency room visits
| 0.0219 | |||||
[8] |
Unscheduled visits to the GP over past month: Parent recall | No | ns | |||
[73] |
Emergency room visits over past 6 months: Parent questionnaire and GP electronic record | Not stated | ns | |||
Hospitalisation | 6 | [70] |
Hospitalisation over past 3 months
10
: Parent recall | No | ns | |
[67] |
Hospitalisation over past year: Parent recall | No | -0.14 | |||
[7] | Asthma Summary Since Last Visit Questionnaire: | No | ||||
Hospitalisation
| 0.0313 | |||||
Days of stay in hospital
| ns | |||||
[68] |
Hospitalisation over past year: Parent recall | No | ns | |||
[8] |
Hospitalisation over past month: Parent recall | No | ns | |||
[73] |
Days of stay in hospital over past 6 months: Parent questionnaire and GP electronic record | Not stated | ns |
Study outcomes
Communication
Satisfaction
Knowledge acquisition
Changes in self-efficacy
Health outcomes
Need for emergency medical treatment or hospitalisation
Limitations
Discussion
Study | Multimedia intervention | MI description | Available/ in use | Comments |
---|---|---|---|---|
[9] |
Interactive Consult 2.0
| Stationary and moveable graphics used to illustrate orthodontic diagnosis and treatment (36 treatment plans) | No | |
[70] |
Packy and Marlon
| One-or two-player game to save the diabetes summer camp from the rats and mice that have scattered the food and diabetes supplies (24 levels) | No | Extract available at http://www.youtube.com/watch?v=oWcPf_n8BgM (accessed 7 February 2013) |
[6] |
All About Nocturnal Enuresis
| Animated, interactive tutorials based on paper-based pamphlet (7 tutorials) | No | |
[69] |
Kidz with Leukemia: A Space Adventure
| A themed MI, providing leukemia information using interactive media, e.g. games and puzzles; and video, e.g. a hospital tour | Yes | |
[67] |
Watch, Discover, Think and Act
| An adventure game to make decisions about managing the game character’s asthma and provide tailored treatment asthma plan. | No | |
[68] | ||||
[66] |
Asthma Control
| Game simulation of daily events, while managing the superhero game character’s asthma, including brief video clips about specific objects, e.g. triggers or medication | No | |
[7] |
Interactive Multimedia Program for Asthma Control: IMPACT Asthma Kids
| Animated interactive tutorials about asthma symptoms and medication use, and real-life scenarios to practice decision-making (44 modules) | Yes, in adapted format | MI content has been converted into a series of interactive educational resources |
[8] |
The Asthma Files
| Animated interactive secret-agent themed modules with games and quizzes and provides tailored self-management asthma plan (8 modules) | No | |
[73] | Not stated | Consists of: | No | |
• Adventure game incorporating asthma-related situations that have to be managed; | ||||
• Asthma quizzes and material from group education sessions; | ||||
• Scheduled chat sessions with asthma experts; | ||||
• Online social networking with peers | ||||
[65] |
STARBRIGHT World
| Intranet for hospitalised children with interactive games, arts and crafts projects, and opportunities to contact children in other hospitals online | Yes | Website is recommended for 13-20 year olds |
[74] |
STARBRIGHT World: Fitting Cystic Fibrosis into your Everyday Life
| Animated interactive tutorials about eating, breathing and cystic fibrosis questions and answers (3 modules) | Yes | |
[71] |
U-Can-Poop-Too
| Interactive tutorials and quizzes with illustrations about aspects of encopresis management (27 modules) | Yes | |
[72] |
Headstrong
| Interactive narrated tutorials and quizzes about headache management, e.g. deep breathing and imagery, and a tailored active pain-coping plan (4 modules) | No | Available only from authors |