Background
Manual review of subject only electronic search | |||
---|---|---|---|
Non-randomised studies (Reference standard) | Other studies (Non-reference standard) | ||
Search filter | Retrieved | A | B |
Not retrieved | C | D |
Methods
Establishment of a reference standard
Identification of the candidate terms for the filters
Development of the filters
Assessing the performance of the filters
Validation of the filters
Results
Description of reference standard
Study design | Total | MEDLINE | EMBASE | |||
---|---|---|---|---|---|---|
N | % | N | % | N | % | |
Comparative – prospective | 19 | (8.7) | 18 | (8.7) | 16 | (8.4) |
Comparative – retrospective | 16 | (7.4) | 14 | (6.8) | 13 | (6.8) |
Case series – prospective | 104 | (47.9) | 99 | (48.1) | 93 | (48.7) |
Case series – retrospective | 70 | (32.3) | 67 | (32.5) | 61 | (31.9) |
Case series – unclear | 8 | (3.7) | 8 | (3.9) | 8 | (4.2) |
TOTAL | 217 | (100.0) | 206 | (100.0) | 191 | (100.0) |
Candidate terms
Search Term | Reference Standard retrieved (N = 206) | Total retrieved (N = 1564) | Sensitivity | Precision | Specificity |
---|---|---|---|---|---|
Controlled Thesaurus Terms | |||||
Case-control studies/ | 2 | 8 | 1.0 | 25.0 | 99.5 |
Cohort studies/ | 5 | 16 | 2.4 | 31.2 | 99.2 |
Comparative studies/ | 106 | 326 | 51.5 | 32.5 | 83.8 |
Follow-up studies/ | 35 | 135 | 17.0 | 25.9 | 92.6 |
Prospective studies/ | 68 | 240 | 33.0 | 28.3 | 87.3 |
Retrospective studies/ | 78 | 282 | 37.9 | 27.7 | 85.0 |
Time factors/ | 15 | 60 | 7.3 | 25.0 | 96.7 |
Treatment outcome/ | 75 | 323 | 36.4 | 23.2 | 81.7 |
Case reports.pt | 5 | 393 | 2.4 | 1.3 | 71.4 |
Clinical trial.pt | 25 | 139 | 12.1 | 18.0 | 91.6 |
Evaluation studies.pt | 12 | 44 | 5.8 | 27.3 | 97.6 |
Textwords (.tw)
| |||||
baseline | 16 | 49 | 7.8 | 32.6 | 97.6 |
case control$ | 3 | 10 | 1.5 | 30.0 | 99.5 |
case series | 28 | 132 | 13.6 | 21.2 | 92.3 |
cases | 40 | 223 | 19.4 | 17.9 | 86.5 |
chang$ | 56 | 310 | 27.2 | 18.1 | 81.3 |
cohort | 10 | 24 | 4.8 | 41.7 | 99.0 |
compare$ or compara$ | 98 | 312 | 47.6 | 31.4 | 84.2 |
consecutive$ | 56 | 163 | 27.2 | 34.4 | 92.1 |
evaluat$ | 100 | 499 | 48.5 | 20.0 | 70.6 |
follow$ | 59 | 272 | 28.6 | 21.7 | 84.3 |
non compara$ or noncompara$ | 14 | 83 | 6.8 | 16.9 | 94.9 |
non random$ or nonrandom$ | 19 | 51 | 9.2 | 37.2 | 97.6 |
observational | 3 | 22 | 1.5 | 13.6 | 98.6 |
post operat$ or postoperat$ | 105 | 538 | 51.0 | 19.5 | 68.1 |
pre operat$ or preoperat$ | 110 | 454 | 53.4 | 24.2 | 74.7 |
prospective$ | 60 | 216 | 29.1 | 27.8 | 88.5 |
retrospective$ | 66 | 242 | 32.0 | 27.3 | 87.0 |
reviewed | 19 | 67 | 9.2 | 28.4 | 96.5 |
MeSH and/or Textword (.mp)
| |||||
case control | 4 | 12 | 1.9 | 33.3 | 99.4 |
cohort | 11 | 29 | 5.3 | 37.9 | 98.7 |
compare$ or compara$ | 135 | 464 | 65.5 | 29.1 | 75.8 |
follow$ | 68 | 312 | 33.0 | 21.8 | 82.0 |
prospective$ | 69 | 260 | 33.5 | 26.5 | 85.9 |
retrospective$ | 79 | 296 | 38.3 | 26.7 | 84.0 |
postoperat$ or post operat$ | 130 | 752 | 63.1 | 17.3 | 54.2 |
preoperat$ or pre operat$ | 112 | 466 | 54.4 | 24.0 | 73.9 |
Search Term | Reference Standard retrieved (N = 191) | Total retrieved (N = 1521) | Sensitivity | Precision | Specificity |
---|---|---|---|---|---|
Controlled Thesaurus Terms | |||||
Case report/ | 1 | 348 | 0.5 | 0.3 | 73.9 |
Clinical trial/ | 23 | 131 | 12.0 | 17.6 | 91.9 |
Cohort analysis/ | 3 | 9 | 1.6 | 33.3 | 99.5 |
Comparative study/ | 13 | 39 | 6.8 | 33.3 | 98.0 |
Controlled study/ | 79 | 309 | 41.4 | 25.6 | 82.7 |
Follow-up study/ | 45 | 212 | 23.6 | 21.2 | 87.4 |
Major clinical study/ | 106 | 308 | 55.5 | 34.4 | 84.8 |
Prospective study/ | 22 | 74 | 11.5 | 29.7 | 96.1 |
Retrospective study/ | 29 | 108 | 15.2 | 26.8 | 94.1 |
Treatment outcome/ | 88 | 447 | 46.1 | 19.7 | 73.0 |
Textwords (.tw)
| |||||
baseline | 16 | 47 | 8.4 | 34.0 | 97.7 |
case control$ | 3 | 9 | 1.6 | 33.3 | 99.5 |
case series | 27 | 122 | 14.1 | 22.1 | 92.9 |
cases | 38 | 201 | 19.9 | 18.9 | 87.7 |
chang$ | 51 | 297 | 26.7 | 17.2 | 81.5 |
cohort | 8 | 19 | 4.2 | 42.1 | 99.2 |
compar$ or compara$ | 90 | 287 | 47.1 | 31.4 | 85.2 |
consecutive$ | 51 | 142 | 26.7 | 35.9 | 93.2 |
evaluat$ | 96 | 425 | 50.3 | 22.6 | 75.3 |
follow$ | 50 | 259 | 26.2 | 19.3 | 84.3 |
non compara$ or noncompara$ | 13 | 78 | 6.8 | 16.7 | 95.1 |
non random$ or nonrandom$ | 19 | 46 | 9.9 | 41.3 | 98.0 |
observational | 3 | 20 | 1.6 | 15.0 | 98.7 |
postoperat$ or post operat$ | 91 | 494 | 47.6 | 18.4 | 69.7 |
preoperat$ or pre operat$ | 101 | 418 | 52.9 | 24.2 | 76.2 |
prospective$ | 56 | 195 | 29.3 | 28.7 | 89.5 |
retrospective$ | 61 | 223 | 31.9 | 27.3 | 87.8 |
reviewed | 20 | 66 | 10.5 | 30.3 | 96.5 |
EMTREE and/or Textword (.mp)
| |||||
cohort$ | 8 | 21 | 4.2 | 38.1 | 99.0 |
compare$ or compara$ | 90 | 297 | 47.1 | 30.3 | 84.4 |
follow$ | 61 | 325 | 31.9 | 18.8 | 80.1 |
prospective$ | 57 | 200 | 29.8 | 28.5 | 89.2 |
retrospective$ | 64 | 233 | 33.5 | 27.5 | 87.3 |
postoperat$ or post operat$ | 123 | 827 | 64.4 | 14.9 | 47.1 |
preoperat$ or pre operat$ | 106 | 491 | 55.5 | 21.6 | 71.1 |
MEDLINE | EMBASE | ||
---|---|---|---|
Precision | Specificity | Precision | Specificity |
Comparative studies/ Follow-up studies/ | Comparative studies/ Follow-up studies/ Time factors/ | Controlled study/ Treatment outcome/ Major clinical study/ | Controlled study/ Treatment outcome/ Major clinical study/ Clinical trial/ |
(preoperat$ or pre operat$).mp | (preoperat$ or pre operat$).mp | (preoperat$ or pre operat$).mp | |
chang$.tw | chang$.tw | chang$.tw | chang$.tw |
evaluat$.tw | evaluat$.tw | evaluat$.tw | evaluat$.tw |
reviewed.tw | reviewed.tw | reviewed.tw | reviewed.tw |
prospective$.tw | prospective$.tw | ||
retrospective$.tw | retrospective$.tw | ||
baseline.tw | baseline.tw | baseline.tw | |
cohort.tw | cohort.tw | ||
consecutive$.tw | |||
(compare$ or compara$).tw | (compare$ or compara$).tw | (compare$ or compara$).tw | |
case series.tw |
Filter | Retrieved | Sensitivity % (95% CI) | Precision % (95%CI) | Specificity % (95% CI) | ||
---|---|---|---|---|---|---|
Reference Standard | Total | % Reduction | ||||
MEDLINE
| ||||||
No filter | 206 | 1564 | - | 100.0 | 13.2 (11.5–14.9) | |
Precision | 205 | 979 | 37.4 | 99.5 (98.5–100.) | 20.9 (18.4–23.4) | 42.9 (40.3–45.5) |
Specificity | 205 | 972 | 37.9 | 99.5 (98.5–100.) | 21.1 (18.5–23.7) | 43.5 (40.4–46.6) |
EMBASE
| ||||||
No filter | 191 | 1521 | - | 100.0 | 12.6 (10.9–14.3) | |
Precision | 191 | 1065 | 30.0 | 100.0 | 17.9 (15.6–20.2) | 35.3 (32.7–37.9) |
Specificity | 191 | 1016 | 33.2 | 100.0 | 18.8 (16.4–21.2) | 38.0 (35.1–39.8) |
MEDLINE/EMBASE
| ||||||
No filter | 217 | 1959 | - | 100.0 | 11.1 (9.7–12.5) | |
Precision | 217 | 1298 | 33.8 | 100.0 | 16.7 (14.7–18.7) | 37.9 (35.3–40.5) |
Specificity | 217 | 1266 | 35.4 | 100.0 | 17.1 (15.0–19.2) | 39.8 (37.1–42.5) |
Validation of filters
MEDLINE | EMBASE | MEDLINE/EMBASE Deduplicated | ||||
---|---|---|---|---|---|---|
No filter | Filter | No filter | Filter | No filter | Filter | |
PRK
| ||||||
Reference Standard | 39 | 39 | 33 | 32 | 39 | 39 |
Total retrieved | 682 | 452 | 503 | 393 | 792 | 567 |
Reference standard retrieved (%) | 100.0 | 97.0 | 100.0 | |||
Reduction in retrievals (%) | 33.7 | 21.9 | 28.4 | |||
Tonsillectomy
| ||||||
Reference Standard | 27 | 23 | 27 | 26 | 30 | 30 |
Total retrieved | 1466 | 886 | 1213 | 852 | 1712 | 1196 |
Reference standard retrieved (%) | 85.2 | 96.3 | 100.0 | |||
Reduction in retrievals (%) | 39.6 | 29.8 | 30.1 |