Clinical Decision Support Tools for Selecting Interventions for Patients with Disabling Musculoskeletal Disorders: A Scoping Review
verfasst von:
Douglas P. Gross, Susan Armijo-Olivo, William S. Shaw, Kelly Williams-Whitt, Nicola T. Shaw, Jan Hartvigsen, Ziling Qin, Christine Ha, Linda J. Woodhouse, Ivan A. Steenstra
Purpose We aimed to identify and inventory clinical decision support (CDS) tools for helping front-line staff select interventions for patients with musculoskeletal (MSK) disorders. Methods We used Arksey and O’Malley’s scoping review framework which progresses through five stages: (1) identifying the research question; (2) identifying relevant studies; (3) selecting studies for analysis; (4) charting the data; and (5) collating, summarizing and reporting results. We considered computer-based, and other available tools, such as algorithms, care pathways, rules and models. Since this research crosses multiple disciplines, we searched health care, computing science and business databases. Results Our search resulted in 4605 manuscripts. Titles and abstracts were screened for relevance. The reliability of the screening process was high with an average percentage of agreement of 92.3 %. Of the located articles, 123 were considered relevant. Within this literature, there were 43 CDS tools located. These were classified into 3 main areas: computer-based tools/questionnaires (n = 8, 19 %), treatment algorithms/models (n = 14, 33 %), and clinical prediction rules/classification systems (n = 21, 49 %). Each of these areas and the associated evidence are described. The state of evidentiary support for CDS tools is still preliminary and lacks external validation, head-to-head comparisons, or evidence of generalizability across different populations and settings. Conclusions CDS tools, especially those employing rapidly advancing computer technologies, are under development and of potential interest to health care providers, case management organizations and funders of care. Based on the results of this scoping review, we conclude that these tools, models and systems should be subjected to further validation before they can be recommended for large-scale implementation for managing patients with MSK disorders.
Introduction
Regional musculoskeletal (MSK) disorders, such as back, neck and shoulder pain, are some of the most common and disabling health conditions internationally, leading to substantial personal, social and economic burden [1, 2]. The high costs of disability and lost productive work time associated with these conditions demand significant improvements in health care strategies, especially in those aimed at helping patients return to work. Systematic reviews of health care interventions, such as physical conditioning or pain management programs, targeted to regional MSK disorders have indicated modest effectiveness [3‐6]. Furthermore, the response of individual patients to these interventions is highly variable. Some patients benefit greatly, while others do not improve, or even experience a worsening of problems [7]. Improved methods for selecting the optimal interventions for individual patients (i.e. personalized rehabilitation) would be invaluable.
Clinical decision support (CDS) is a term that has been used to define the myriad of ways in which knowledge is represented in health information and/or management systems to assist health care providers and other stakeholders in patient management decisions [8]. CDS tools are devices, instruments, questionnaires or other diverse resources (including algorithms, continuums of care, and treatment models) that present knowledge to health care decision-makers, and are often designed as point-of-care resources that support decisions regarding optimal treatment choices. Research and development of CDS tools is a rapidly growing field. These tools are attractive options, given the widespread adoption of computer tablets and smart phones. Also, CDS tools can be an efficient and time-saving strategy for busy clinicians if treatment algorithms are evidence-based and present minimal risks. This technology has the potential to augment complex decisions such as those performed for regional MSK disorders. Computerized CDS has the potential to significantly improve human decisions by expediting information retrieval, identifying unique patient needs, triaging care, and matching patients to the most appropriate resources and treatments.
Anzeige
Some promising CDS tools have been developed specifically for use with patients that have regional pain disorders [9‐11]. However, the effectiveness, utility and feasibility of CDS resources in the treatment of regional MSK disorders has been under investigated [12]. Previous systematic reviews of CDS tools have focused on the evaluation of medical management and included only randomized controlled trials from the health care literature [12‐17]. However, CDS for the treatment of patients with regional MSK disorders is an emerging area that covers multiple disciplines (including health care, computing science, occupational health services and human resource management). The current literature is therefore diverse and fragmented [11, 18, 19] using inconsistent terminologies and methods. However, to date, no thorough synthesis and summary of these methods is available. In addition, the state of the science in terms of effectiveness, utility, and feasibility of CDS resources in the treatment of MSK disorders has not been summarized as a whole. Given the diversity of the literature and emerging nature of the field, a comprehensive scoping review is needed to map the scientific and grey literature on this topic [20].
The purpose of this project was therefore to conduct a scoping review of CDS tools designed to help decision-makers select interventions that are specifically intended to improve function and return to work in patients with pain-related MSK disorders. This review was also open to other patient related outcomes such as pain, and disability. Our study aims were to identify and inventory CDS tools for helping front-line staff select interventions. We considered both computer-based CDS and other available tools such as treatment algorithms, care pathways, prediction rules, and models. In addition, we aimed to summarize key concepts and terminology to provide criteria for future reporting, evaluate and synthesize evidence of the effectiveness and utility of the available tools, and recommend directions for future research and development in this area.
Methods
Design
This study was a scoping review, which is a methodology for rigorously collecting, synthesizing, appraising and presenting findings from existing research on a topic [20‐22]. This approach is especially relevant when an area is emerging or diverse because it examines the extent, range and nature of the research activity [23]. Generally scoping reviews are referred to as ‘a mapping process’ since they summarize a range of evidence in order to convey the breadth and depth of a field [24]. Unlike systematic reviews, scoping reviews do not require appraisal of the quality of the included studies. However, the scoping process requires an analytical interpretation and inventory of the available literature. A scoping review is also useful for determining whether enough literature is available on a topic to conduct a formal systematic review or a meta-analysis or to identify gaps in the literature. In addition, scoping reviews can include a range of study designs and address complex and diverse questions that cannot typically be addressed with a systematic review. Our research area is both emerging and diverse. For these reasons, we chose to conduct a scoping review.
We adopted the scoping review framework proposed by Arksey and O’Malley [23]. This framework progresses through five stages: (1) identifying the research question; (2) identifying relevant studies; (3) selecting studies for analysis; (4) charting the data; and (5) collating, summarizing and reporting results. Each stage will be discussed in detail below.
Anzeige
Identifying the Research Question
An iterative process was used in which we reflexively adapted our question, search terms, and strategy to ensure comprehensive coverage of the literature [23]. An initial question provided the scope for the review and contained several key concepts that guided the search terms used. However, the question was refined based on the broad spectrum of articles we obtained in the initial search. Initially we had included CDS tools for selecting interventions as well as making diagnoses and prognoses. However, due to the extensive breadth of the literature obtained and impracticality of reviewing all 3 research domains, we decided to focus on intervention tools only. This decision was made after consultation with all the researchers and knowledge users involved.
Our final research question was the following: “Do validated decision support tools (especially computer-based tools) exist for selecting appropriate interventions for improving function and return to work in patients with pain-related MSK disorders?”
Identifying Relevant Studies
Relevant studies were identified through online searches of health care, computing science and management databases. These searches were performed with the assistance of two experienced research librarians at the University of Alberta who had access to, and a thorough knowledge of all the necessary databases and search engines. Databases searched included Ovid MEDLINE, Ovid EMBASE, Scopus, CINAHL, Business Source Complete, ABI/INFORM Global, Social Science Research Network (SSRN), Web of Science, ACM Digital Library, IEEE Xplore, ACM Computing Reviews, Computing Research Repository (CoRR), NECI ResearchIndex (formerly CiteSeer) and Google Scholar. Our search strategies were adapted to the various databases as required with the assistance of the librarians. The search included all articles in all languages since the inception of the databases.
Keywords included musculoskeletal diseases; musculoskeletal disorders; back pain; neck pain; shoulder pain; disability evaluation; vocational rehabilitation; return to work; decision support techniques; decision support tools; decision making; clinical protocols; computer-assisted. An example of a search strategy performed in Medline is presented in “Appendix 1”.
Grey literature (unpublished documents from outside the peer-reviewed scientific literature) were also searched. We applied the Canadian Agency for Drugs and Technologies in Health’s Grey Matters search tool to search for relevant information and websites [25]. In addition, Google was searched to identify possible unpublished studies. Relevant articles from the study teams’ own research or libraries were also included.
Each CDS tool located was tracked in the Scopus database and Google Scholar to determine whether additional studies investigating the tool had been published.
Selecting Studies for Analysis
The following were the final set of inclusion/exclusion criteria for the review:
Topic of the article A CDS tool for selecting interventions.
Population Patients with any painful MSK disorder (e.g., regional pain disorders of the back, neck, knee, shoulder, etc.). Our review included all MSK conditions available in the literature and all terms referring to MSK conditions were included in the searches. We excluded articles on non-MSK disorders including metabolic/endocrine disorders (i.e. osteoporosis, diabetic ulcers), rheumatic disorders (i.e. ankylosing spondylitis, rheumatoid arthritis, fibromyalgia) and other general medical conditions.
Outcome Functional and work-related outcomes, including return to work, disability, performance, and absenteeism. Functional recovery is a crucial outcome in regional pain disorders. From the perspective of the various stakeholders involved (i.e. workers, insurers, employers and health care providers), recovery from pain is important; however, functional recovery—such that the patient can return to work and participate in normal daily living—is equally important and has important career and quality-of-life implications [26, 27]. Functional recovery is also often easier to measure. For these reasons, we focused primarily on interventions aimed at improving function or facilitating return to work and other activities of daily living.
Study type Any design describing or evaluating a CDS tool. Systematic reviews were excluded but references within those located were searched for further articles.
The titles and abstracts of articles obtained from the online databases were reviewed and appraised for relevance. Two independent researchers from the team read each title/abstract and judged whether they were relevant to the research question. When there were disagreements between reviewers, the principal researcher (DPG) offered additional consultation until a decision could be reached. If the relevance of a study was still unclear, then the full article was obtained. After selecting the relevant abstracts and titles, two independent researchers assessed the corresponding full versions of the studies to determine which articles should be included in the full review. If discipline-specific questions arose, the reviewers consulted with the team member with relevant expertise (i.e. computers, health care, human resource management, etc.) who could answer the question. We used a Microsoft Access (Redmond, Washington) database stored on an internal server at the University of Alberta that was securely accessible by team members for all stages of the review.
Consultation with Knowledge Users
The consultation process for this study incorporated the development of an advisory committee that included knowledge users who were representatives of local rehabilitation clinics in the Edmonton area, national networks of health care clinics that provide rehabilitation to injured workers, and experienced compensation case managers. We held meetings with knowledge users at two key stages of the review: selecting studies for analysis, and summarizing and reporting results. Knowledge users were asked whether they knew of any CDS tools currently in use or relevant articles. Feedback from knowledge users during these consultative meetings highlighted the importance of: (1) including functional and return-to-work outcomes as search terms; (2) considering not only papers describing specific CDS tools, but also theoretical or conceptual papers dealing with models or algorithms describing treatment selection approaches for patients with MSK disorders; (3) having reviewers consider workplace-based interventions (i.e. accommodations, modifications, etc.) and work-related outcomes (i.e. productivity, absenteeism, etc.) during abstract and title screening; and lastly, (4) considering the importance of feasibility, time of tool administration, cost, and ease of interpretation in addition to scientific validation when considering the utility of any CDS tools located. Before charting the data, the knowledge users were consulted to determine whether the number of articles selected was appropriate and whether the search terms should be altered.
Data Analysis
Charting the Data
Reviewers extracted relevant information from the articles and entered it into an electronic data chart created with the Microsoft Access program. This form included data for authors, year of publication, article title, discipline of the lead authors, geographic location of the study, type and brief description of the CDS tool (including a list of factors included in the tool’s algorithm such as age, sex, pain level, etc.), cost of the tool, study population, study design and goals, methods used, outcome measures used, important results and any economic data recorded. For computer-based tools, we extracted additional information using categories taken from a previously published CDS taxonomy [28]. These charting methods provided a standard and systematic approach to summarize the papers and extract all relevant information.
Collating, Summarizing and Reporting Results
During this stage, we created an overview of all research located. Initially, we presented a basic numerical summary of the studies, including the extent, nature and distribution of the articles. Then, we summarized articles according to the types of tools described or evaluated, research methods used, populations studied, and study results/outcomes.
As mentioned earlier, the scoping review methodology was intended to summarize both the breadth and depth of the literature. We reported the number of articles for each CDS tool as well as some descriptive information about the articles. Since this was a scoping review, we did not undertake a critical appraisal of quality. However, we attempted to map the diversity observed and inventory the various study designs and methods used. This procedure allowed us to draw conclusions about the nature of research in this area and provide recommendations for future studies.
Several clinical prediction rules were designed to identify those individuals likely to respond positively to a particular treatment or intervention. These types of tools have been summarized in other reviews [29, 30], but we created an updated table to establish the range of tools in this category and to examine the strengths and limitations of these rules.
The various CDS tools identified in the articles were also categorized, and key concepts and terminology used in the articles were summarized in tables.
Guidelines developed by Terwee et al. [31] were used to define quality of measurement properties of the CDS tools. Briefly, quality of measurement included internal (internal consistency, relevance of items and representativeness of items of the scale-content validity) as well as external components of validity (the relationship with other tests in a manner that is consistent with theoretically derived hypotheses-construct validity). Intra and inter-rater reliability (i.e. repeatability of measurements taken by the same tester at different times and repeatability of measurements taken by different testers, respectively) were also considered. Definitions of psychometric properties for this review are provided in “Appendix 2”.
Results
The initial search considering all online databases identified 4605 potentially relevant articles. From these, 189 unique studies were included for the second stage; screening full texts. After screening full texts, 133 articles were selected. From these, 34 articles were removed since they were systematic reviews or considered irrelevant for the purposes of the study. However, their references were searched. From the reference search of these studies and stakeholder meetings, we obtained 24 additional articles. Thus, 123 studies were included for data extraction. The reliability of the screening process of titles and abstracts was high with an average agreement percentage of 92.3 % between reviewers. Figure 1 shows the flow chart of our article search and relevance selection process. A search of the grey literature obtained no new documents or websites specific to MSK disorders.
Fig. 1
Flow chart of article search and relevance selection process
×
General Description of Articles
Of the 123 relevant articles located, most originated in North America (n = 70, 57 %), were published between 2006 and 2014 (n = 101, 82 %), and discussed a clinical prediction rule or a classification system (n = 79, 64 %). Twenty-one articles (17 %) discussed treatment algorithms or models, 15 (12 %) discussed questionnaires, while only 8 (7 %) discussed computer-based tools. Most of the articles pertained to low back pain (n = 69, 56 %), followed by neck, shoulder or arm pain (n = 21, 17 %), and general MSK disorders (n = 17, 14 %). When the article described an original study (n = 75), designs of these studies varied greatly from randomized controlled trials (RCTs) to case series and reports. The majority of the original studies were observational in nature, most commonly cohort studies (n = 31, 41 %). Table 1 displays more details about the characteristics of located studies.
Table 1
Descriptive characteristics of included articles (n = 123)
Number (%)
Source of evidence
Peer-review journal article
75 (61)
Commentary/editorial/article summary
19 (15)
Conference proceeding
9 (7)
Review
9 (7)
Study protocol
6 (5)
Thesis
5 (4)
Discipline of lead authors
Health care
121 (98)
Computing science
2 (2)
Geographic location of lead authors
North America
70 (57)
Europe
21 (17)
Australasia
9 (7)
Asia
4 (3)
Multiple locations
19 (15)
Year of publication
2006–2014
101 (82)
2000–2005
18 (15)
Before 2000
4 (3)
Type of tool discussed in the article
Clinical prediction rule/classification system
79 (64)
Questionnaire
15 (12)
Treatment algorithm
15 (12)
Theoretical/empirical model
6 (5)
Computer-based tool
8 (7)
Condition aimed at by tool
Low back pain
69 (56)
Neck/shoulder/arm pain
21 (17)
General MSK disorders
17 (14)
Knee/ankle pain
6 (5)
Upper extremity pain
3 (2)
Serious pathology (fractures, etc.)
5 (4)
Thoracolumbar injury
2 (2)
Reasoning method
Rule-based
109 (89)
Other (e.g., neural network, decision tree)
8 (7)
Unclear
6 (5)
Study design of peer-review studies located (n = 75)
Experimental
Randomized controlled trial
12 (16)
Quasi-experimental
4 (5)
Observational
Cohort study
31 (41)
Case control/case report/case series
15 (20)
Cross-sectional study
6 (8)
Secondary analysis
5 (7)
Methodological study
2 (3)
Overall, there were 43 CDS tools located. After reviewing the tools and identified articles, these were classified into three main areas: (1) specific computer-based tools or questionnaires (n = 8, 19 %); (2) clinical prediction rules/classification systems aimed at categorizing patients into various treatment groups (n = 21, 49 %); and (3) theoretical or algorithmic approaches to selecting treatments (treatment algorithms/models) (n = 14, 33 %). Each of these areas and the tools located will be described.
Computer-Based Tools/Questionnaires
Table 2 provides an inventory of the 8 computer-based devices or questionnaires located for selecting interventions for patients with pain-related MSK disorders. Table 3 provides a summary of the original studies evaluating these tools. Twenty-two manuscripts including three theses [32‐53] looked at these 8 tools. Three questionnaire-based tools were included: Keele STarT Back Screening Tool (SBST), the Pain Recovery Inventory of Concerns and Expectations (PRICE) questionnaire, and the Orebro Musculoskeletal Pain Questionnaire (OMPQ). We also located 5 tools incorporating computer technology: Repetitive Strain Injury (RSI) QuickScan intervention program, the Pain Management Advisor (PMA), the Decision Support System (DSS) for helping ergonomists better match workers with the work environment, the Soft Tissue Injury Continuum of Care Model with computerized prompts for case managers, and the Work Assessment Triage Tool (WATT). Three of these tools were aimed at workers with low back pain (SBST, PRICE and OMPQ), 2 were aimed at work-related upper extremity disorders (RSI QuickScan and DSS), 2 were aimed at general work-related MSK injuries (WATT and Soft Tissue Continuum of Care), and 1 aimed at assisting physicians in managing patients with chronic pain (PMA).
Table 2
Inventory of computer-based tools and questionnaires located
The SBST allocates low back pain patients into three risk groups and is intended to assist clinicians in their decisions about choice of treatment in primary care settings
Questionnaire consisting of nine items covering aspects of fear avoidance beliefs, depression, disability and presence of leg pain and neck/shoulder pain. Patients are allocated into one of three subgroups (low, medium or high risk of chronicity) based on the obtained score. Treatments are targeted based on score
The developers have conducted one RCT to compare treatment informed by the SBST to usual care. Patients managed using the SBST had better functional outcomes at 1-year, but this effect was mainly seen in the medium and high risk groups. Acceptable concurrent validity has been demonstrated with the OMPQ [162‐164] The presence of high depression, fear avoidance beliefs, or catastrophizing scores increase significantly from the SBST low risk group, over the medium group to the high-risk group [165]
Fair agreement between SBST tool (K = 0.22) and clinicians classification of patients into risk groups [33]
StarT Back Tool has been translated and cross culturally validated into Danish [166], Spanish [167],French [168], German [155], Swedish [163], Chinese [156], and Finnish [169]
The test–retest reliability of the SBST total score was excellent (intraclass correlation coefficient = 0.78; [169] 0.93 [156]; and 0.90 [164]) and good for the psychosocial subscale (0.68) [169]
The StarT Back Tool demonstrated acceptable to outstanding discrimination to determine individuals with different levels of disability as indicated by widely accepted questionnaires such as the Roland Morris Disability Questionnaire, Tampa Scale of Kinesiophobia among others (AUC ranged from 0.79 to 0.91 [155], and 0.75–0.89 [156]
Not needed
9 questions are answered with a Likert-scale regarding pain and activities of daily living. The tool has been translated into several languages
Treatments recommendations based on risk categories: low, medium or high risk. The authors suggest that the low risk group only needs a ‘light’ intervention with e.g., analgesics and advice, the medium group requires treatments involving elements such as exercises or manual therapy, and that a combination of physical and cognitive-behavioral approaches should be considered for the high risk groups
Primary care providers
The tool has not been validated via clinical trial outside the United Kingdom
There is also a need for a large RCT designed to test whether treatment effects differ across the SBST subgroups
Repetitive Strain Injury (RSI) Quick Scan, Now named ‘Compufit Quick Scan’ [40, 52]
To assess the presence or absence of potential risk factors for the establishment of risk profiles related to neck, shoulder and arm symptoms in computer workers and potentially determine targeted treatment
Computer-based survey aimed at identifying workers’ at risk of arm, shoulder and neck symptoms. Based on score results, recommendations are made to the worker to reduce risk of symptoms. In total, the questionnaire consists of 81 items, divided over two categories and 11 subcategories. A description of the actual questions can be found at: www.compufitquickscan.com/ne/quickscan/
The tool has been tested in a cluster randomized control trial and associated cost-effectiveness evaluation. Use of the tool did not reduce work disability and the tool was not found to be cost-effective
The tool does have acceptable internal consistency, reliability and concurrent validity. Cronbach’s alpha was mostly between 0.40 and 0.85. Six scales scored 0.70 or higher. Concurrent validity of the RSI with original questionnaires was acceptable [170]
The concurrent validity of the questionnaire symptom items with the observations of 2 physicians was defined as poor to moderate with kappa values between 0.16 and 0.53 [171]
Predictive Validity of the RSI QuickScan questionnaire was tested. High scores of the RSI QuickScan on 9 out of 13 scales, including previous symptoms, were significantly related to arm, shoulder and neck symptoms at follow-up [172]
Interventions can be targeted at each of the factors in the RSI QuickScan, with a total of 16 interventions aimed at reducing the associated risk [36, 52]. A score of 30 % or less of the maximum on a scale was classified as a low risk, colour-coded “green”. A score of 31 % to 60 % of the maximum on a scale was classified as a medium risk, colour-coded “amber”. A score of 61 % or more of the maximum on a scale was classified as a high risk, colour-coded “red”.
Primary care providers and ergonomists
The RSI QuickScan appears to have a modest effect and was not cost-effective. However, this might have been due to problems with implementation of expensive ergonomic interventions, which were sold at regular commercial prices during the trial. This was despite commitment from all participating organizations prior to starting the study that they were prepared to invest in the necessary preventive measures
Pain Recovery Inventory of Concerns and Expectations (PRICE) [36]
Brief screening questionnaire to triage return-to-work strategies among patients with low back pain
Questionnaire consisting of 46 items measuring, depressive symptoms (12 items), pain catastrophizing (2 items), lack of organizational support (7 items), activity limitation (15 items), fear of movement (4 items), perceiving grave life impacts (3 items) poor expectations for recovery (2 items), and pain intensity (1 item) [36]
A confirmatory cluster analysis replicated previous findings of three risk subgroups: distressed, avoidant, and lacking employer support
Validity of the PRICE screening was supported by its prospective association with the 3-month disability outcome measures (return to work, functional limitation, and clinical case rating) [36]
Not needed
Subjects are asked to respond to each of the 46 items on different Likert-type scales scale (i.e. “strongly disagree” to “strongly agree.”; “not at all” to “all the time”)
PRICE can be used to identify early intervention needs among working adults with low back pain based on the group classifications
It provides an indication of whether attention should be focused on workplace coordination, physical activation, or psychological coping, and this may improve the ability to provide more patient-centered strategies for early disability prevention
Primary care providers
This questionnaire is at an early stage of development. Future trials should be conducted to validate the classification and targeted management approach
Screening tool aimed at identifying high-risk patients with MSK pain in need of early intervention
Questionnaire consisting of 24-items that allocates patients into three different risk categories related to work absenteeism and guides potential interventions for those with low (reassurance and advice), moderate (physical therapy) or high risk (psychologically-informed care)
The OMPQ was initially developed as a screening tool and has been evaluated in several settings and translated into several languages for this purpose. However, it has recently been evaluated as a potential CDS tool for selecting interventions for patients with MSK pain. One study is underway in Germany that evaluates the OMPQ as a CDS tool [44]
Not needed
24 items with various response options for different sections of the tool
After OMPQ administration and scoring, the questionnaire categorized patients into one of three risk level categories: low, medium and high risk. Various cut-points have been recommended for the categorization, with the developers stating the cut-off scores are related to the population studied
Primary care providers
Has only been evaluated as a CDS tool in one student thesis, with negative results. The OMPQ was not explicitly developed as a CDS tool, although early risk stratification implies different approaches for different categories
To enhance primary care providers’ management of chronic pain
Computer-based tool that relies on rule-based algorithms derived from expert knowledge of pain specialists
User asked a series of questions to refine the diagnosis and determine appropriate therapy
Interactive capability (e.g., for explanations, therapeutic rationales, therapy guidelines)
Working version developed: some field testing conducted
Computer program
PMA written in
MicroSoft Visual Basic, v. 5.0, run as an expert application in XpertRule
Algorithms stored in MicroSoft Access database
MicroSoft Help Utility used for explanations and queries
Patient demographics
Diagnosis
Pain characteristics
Laboratory tests and imaging studies
Current medications
Prior therapies
Concurrent disease conditions
Allergies
Psychological status
A prioritized list of recommendations: (1) medical management (pharmacologic and nonpharmacological management, physical, psychosocial modalities); (2) invasive procedures; (3) referrals
Primary care providers.
This software was only tested qualitatively in one study. No further testing has been published
To determine whether the use of software as a decision support system can help with evaluation and control of physical job stresses and prevent re-injury of workers who have experienced or are concerned about work-related musculoskeletal disorders
The ergonomists used the database as a decision support tool in the control of work-related MSK disorders (WMSDs)
Computer-based tool consisting of decision support software is a spreadsheet-based database program written in Microsoft Excel. It has a graphical user interface (GUI) in the WindowsTM environment, and contains video clips of representative cycles of the selected job and in some cases, multiple videos showing multiple views
It was designed specifically for the site, but is adaptable to other manufacturing plants with relatively stable work patterns. The software program is a database that stores detailed job information such as standardized work data, videos, and upper-extremity physical stress ratings for over 400 jobs in the plant. Additionally, the database users were able to record comments about the jobs and related control issues
Testing usability and effectiveness to prevent worker injuries
No further testing
The database seems to be useful to facilitate the quality of job evaluation. This improvement in quality can lead to better intervention and control of MSK problems [38]
Pentium-based PCs
Ideally a portable computer Windows 95
Excel Program
Visual interface
For video import, mpg images are needed
Upper extremity exposure ratings (evaluated by the research team) for repetition, posture, contact stress, and force
Standard data: work elements and times for selected job, obtained from the company standard data system
-Text box that allows users to store and retrieve comments about selected job
-Menu to search for a job by department, section, line position, and by date
Videos of the work environment
Information from database was used to make recommendations for injury prevention and management strategies by the ergonomists
Ergonomists
This software was only tested qualitatively in one study. No further testing has been published [38]
The model was designed as a high-level, decision-making tool or “roadmap” to promote a consistent, evidence-based approach to manage soft tissue injuries
The model with computer-based tool that involves 3 main components: (1) Staged application of rehabilitation services; (2) Case management protocols and case planning checkpoints; and (3) Contracted services with providers
A population-based, quasi-experimental, before-and-after design with concurrent control groups was used to evaluate the model’s impact and effectiveness
Computer-based prompts were given to workers’ compensation case managers via a custom-built program
Data on type of injury and time since injury is used from within the workers’ compensation administrative database to generate prompts for case managers
Based on type of injury and time of recovery, claimants are referred to different assessment and treatment programs
Workers’ compensation case managers
Further validation of this model is recommended through the implementation of experimental design such as RCT
The classification algorithm and accompanying computer-based CDS tool help categorize injured workers toward optimal rehabilitation interventions based on unique worker characteristics
Computer-based tool comprised of 18 variables related to: injury duration, occupation, job attachment and working status at time of RTW assessment, availability of modified work, National Occupational
Classification Code, ICD9 diagnostic group, calendar days injury to assessment, the ‘Occupation’ item from the PDI
Pain VAS out of 10, and 9 items from the SF36 (items 2, 4, 5, 7, 12, 14, 18, 21, 25)
The algorithm used by the WATT was developed using machine learning techniques and demonstrated high accuracy for correct classifications during internal validation [32, 41] Concurrent validity of WATT with clinician’s recommendations was tested. Percent agreement between clinician and WATT recommendations was low to moderate. The WATT did not improve upon clinician recommendations, but was more likely to recommend evidence-based interventions [42]
HTML-based computer program that can run on any computer system with access to the Internet
Data entered into WATT involves 18 items related to injury duration, occupation, job attachment and working status at time of RTW assessment, availability of modified work, National Occupational
Classification Code, ICD9 diagnostic group, calendar days
injury to assessment, the ‘Occupation’ item from the PDI, Pain VAS out of 10, and9 items from the SF36 (items 2, 4, 5, 7, 12, 14, 18, 21, 25)
The rehabilitation options available to clinicians were: physical therapy, interdisciplinary functional restoration, workplace-based rehabilitation, ‘hybrid’ functional restoration/workplace-based rehabilitation; complex interdisciplinary bio-psychosocial rehabilitation and no further rehabilitation
Primary care providers and case managers
This tool is at the early stages of validation. Findings do not provide evidence of concurrent validity of the WATT against clinician recommendations. WATT appeared more likely than clinicians to recommend treatments supported by current evidence such as workplace-based interventions. Further validation is needed
Table 3
Summary table of original studies evaluating computer-based tools or questionnaires for selecting interventions for patients with musculoskeletal disorders
851 adults aged ≥18 years with low back pain with or without radiculopathy
Low Back
Ten general practice clinics in England
Questionnaire: Keele STarT Back Screening Tool that stratifies patients into low, medium or high risk, requiring different interventions
Validity of a stratified/classification approach to primary care
Sensitivity/specificity for identifying treatments
Eligible patients were randomly assigned to intervention (use of SBST to inform management) or control group (usual care). Disability, cost and quality of life were evaluated
Results indicate a classification approach using the tool significantly improves patient outcomes and is associated with substantial economic benefits
12 consecutively consulting patients with primary care back pain
Low Back
8 General Practices in the United Kingdom
Questionnaire: Keele STarT Back Screening Tool that stratifies patients into low, medium or high risk, requiring different interventions
Agreement between clinicians and STarT Back tool
12 patients underwent a video-recorded clinical assessment. The SBST was completed on the same day. Clinical experts reviewed the videos and categorized subjects to low, medium or high-risk
Clinicians make inconsistent risk estimations for primary care patients with back pain when using intuition alone, with little agreement with the STarT Back tool
741 computer workers from 7 Dutch organisations in various work branches (e.g., health care, local government, nature conservation, engineering, education and regulatory affairs), located throughout the Netherlands
The population consisted of office staff, local government officials, engineers, consultants, teachers, health care personnel, nature conservation professionals, researchers and managers
Arm, shoulder and neck pain
Employees of a large occupational health service in the Netherlands
Questionnaire: RSI QuickScan intervention program
Effectiveness of the intervention program for reducing symptoms and sick leave
The participants were assigned to either an intervention or usual care group by means of cluster randomization. At baseline and after 12 months of follow-up, participants completed the RSI QuickScan questionnaire to determine exposure to the risk factors and prevalence of arm, shoulder and neck symptoms. A tailor-made intervention program was proposed to participants with high-risk profiles at baseline. Examples of implemented interventions are an individual workstation check, a visit to the occupational health physician and an education program on the prevention of arm, shoulder and neck symptoms
There were no significant differences in changes in the prevalence of arm, shoulder and neck symptoms or sick leave between the intervention and usual care group
638 computer users with and without shoulder, arm and neck symptoms
Arm, shoulder and neck
Workers from seven Dutch companies
Questionnaire: RSI QuickScan intervention program
Cost–benefit of the RSI QuickScan program
Workers were randomized to either the intervention or usual care group. The intervention consisted of a tailor-made program based on the RSI-QuickScan program. Usual care group did not receive elaborate advice. The participants completed the questionnaire at baseline and 12-month follow-up. Effectiveness and cost were compared
The RSI QuickScan intervention program did not prove to be cost-effective. However, with a relatively small investment, the program increased the number of workers who received information on healthy computer use and improved their work posture and movement
496 workers with acute (fewer than 14 days) work-related low back pain
Low Back
A private network of occupational health clinics in the USA with eight participating clinics located in various states
Questionnaire: The Pain Recovery Inventory of Concerns and Expectations (PRICE) measure. Designed to subgroup patients within the first 2 weeks of an episode of back pain to determine needed treatment depending on whether disability is related to pain beliefs, emotional distress, or workplace concerns
Sensitivity analysis conducted to reduce the number of items while maintaining scale reliability, then classification accuracy was tested using a confirmatory cluster analysis
Patients were recruited from the consecutive caseload of patients reporting low back pain, and volunteer patients completed a brief demographic questionnaire and a 10-page psychosocial test battery. Participants were then followed-up at 3-months to determine pain, function, and work status
The reduced PRICE measure is a 46-item screening measure that can be used to identify early intervention needs of working adults with low back pain
2046 workers compensation claimants with back disorders
Low Back
Rehabilitation facilities in Alberta, Canada with contracts to treat workers’ compensation claimants
Questionnaire: OMPQ. Screening tool aimed at identifying high-risk patients with MSK pain in need of early intervention
Tested level of agreement between clinician recommendations and OMPQ categories. Also examined whether a match between OMPQ categories and actual programs were associated with better RTW outcomes
Secondary analysis of a dataset used for developing a CDS tool. Examined whether a match between OMPQ categories, clinician recommendations and actual rehab program undertaken was related to a better return to work outcome
The OMPQ had limited agreement with clinician recommendations suggesting other measures or factors are considered when making treatment recommendations. Finally, concordance of OMPQ categorization and actual rehabilitation undertaken did not appear to favorably impact outcomes
100 patients with chronic pain referred for treatment at a chronic pain clinic
All
VA San Diego Healthcare
System Pain Clinic in the United States
Computerized: Pain management advisor (PMA)
Validity and acceptability of recommendations made based on a computerized tool
A pain specialist used a decision support system to determine appropriate pain therapy and sent letters to the referring physicians outlining these recommendations. Separately, five board-certified PCPs used a CBDS system to “treat” the 50 cases. Patients were followed up 1-year later
The use of a Computer-Based Decision-Support system may improve the ability of primary care physicians to manage chronic pain and may facilitate screening of consults to optimize specialist utilization
Workers in an automobile assembly plant conducting over 400 jobs in the plant
Upper extremity
Worksite-based study. The plant built small trucks in a 2.1 million square foot facility. There were over 500 on- and offline assembly jobs and a workforce of ~2580 union employees
Computerized: Decision support system (DSS) for helping ergonomists better match workers with the work environment
Utility of the tool over a 20-month period
Evaluation of qualitative comments regarding utility of the tool as well as 1-on-1 semi-structured interviews with users
Of 197 comments entered by users, 25 % pertained to primary prevention, 75 % pertained to secondary prevention, and 94 comments (47.7 %) described ergonomic interventions. Use of the software tool improved the quality and efficiency of the ergonomic job analysis process
171,736 workers’ compensation claimants with any type of MSK injury aged 18–65 years
All
Rehabilitation facilities in Alberta, Canada with contracts to treat workers’ compensation claimants
Soft Tissue Injury Continuum of Care Model with computerized prompts for case managers
Effectiveness of the tool compared to usual care
A population-based, quasi-experimental, before-and-after design with concurrent control groups was used to evaluate the model’s impact. Data were extracted from the main WCB-Alberta administrative database from 2 years before model implementation to 5 years after
Implementation of a soft tissue injury continuum of care involving staged application of various types of rehabilitation services appears to have resulted in more rapid and sustained recovery
434 injured Canadian workers’ compensation claimants with any type of MSK injury between 18 and 65 years old
All
Workers’ compensation rehabilitation facility in Alberta, Canada
Computerized: Work Assessment Triage Tool (WATT). Designed to categorize injured workers to various programs including functional restoration, workplace-based intervention, or chronic pain programs
Concurrent validity of the tool’s recommendations
Level of agreement was examined between the WATT and clinical recommendations by therapists participating in a clinical trial
Percent agreement between clinician and WATT recommendations was low to moderate. The WATT did not improve upon clinician recommendations
Unclear
Most of these tools had some psychometric testing in the way of validation of items, concurrent validity, acceptability of the tool, accuracy of the classification as well as testing the effectiveness of the tool compared to standard treatment. Nevertheless, this testing has been preliminary, and a more exhaustive validation process involving randomized controlled trials at multiple sites and settings is needed for all of the tools. Four of the tools [34, 35, 37, 38] showed positive preliminary results regarding the use of the tool to determine appropriate treatments for managing some MSK conditions. However, one tool (RSI QuickScan) did not prove to be effective for reducing work disability or cost-effective [40, 52], and two studies did not have clear positive or negative results regarding the tools evaluated (SBST and WATT) [33, 42]. One student thesis evaluated the utility of the OMPQ as a clinical decision support tool for workers’ compensation claimants, with negative results [39]. However, the OMPQ was initially developed as a screening or prognostic tool, not explicitly as a CDS tool. In addition, one protocol of a cluster RCT that attempts to use the OMPQ as a CDS tool for selecting interventions for patients with LBP was found [44]. The results of this RCT are still unpublished, so it is unknown how well the OMPQ functions as a CDS tool. Three other studies [32, 36, 41] only looked at the development phase of the tools (WATT and PRICE). Thus, evidence is limited regarding validity evidence of these CDS tools. For details of the measurement properties of the CDS tools found, see Table 4.
Table 4
Summary of the quality of measurement properties of the computer-based tools or questionnaires located
Tool
Internal consistency
Face validity
Content validity
Criterion validity*
Construct validity
Reproducibility (agreement/reliability)
StarT Back
+
+
+
+*
+
+
RSI Quick Scan
+
+
+
–
+
+
PRICE
+
+
+
–
+
–
PMA
–
+
+
+
+
–
DSS
–
+
+
–
–
–
Soft Tissue Model
–
+
+
–
+
–
WATT
–
+
+
+
+
–
+Quality of measurements properties were based on guidelines established by Terwee et al. [31]
(+) Criterion accomplished
(−) Criterion not accomplished
* Comparison was performed with reference standards
Treatment Algorithms/Decision-Models
Of the 22 articles [54‐75] discussing treatment algorithms/models, there were 15 original studies evaluating 14 different algorithms or decision-models (theoretical or empirical) for selecting interventions for patients with MSK disorders. Details of these algorithms/models and the studies can be found in Table 5. Nine of the studies [54‐61, 76] looked at low back pain, 2 discussed knee disorders [62, 63], 2 discussed shoulder disorders [64, 65] and 2 examined other body regions (wrist and neck) [66, 67]. Research designs used in these studies varied greatly, with the observational cohort study being the most common among them. Methodologies and types of algorithms were also wide-ranging, making the analysis of these studies challenging. Most of the algorithms or decision models were developed to determine possible treatment paths. Nevertheless, most testing of these algorithms/decision models was preliminary or exploratory (e.g., small sample size, secondary analyses of previous collected data, lack of replication or validation samples, use of research designs that are prone to bias including case series, cross sectional or cohort studies rather than randomized controlled trials). Nine of these algorithms [54, 58, 62‐67, 76] seemed to lead to positive results when deciding on intervention strategies. Nevertheless, one study [56] found that the use of the algorithm would not result in better outcomes for patients with low back pain. Four studies [55, 57, 59, 61] only looked at the development of an algorithm/model without associated testing of it.
Table 5
Summary table of original studies describing or evaluating algorithms or decision-models (theoretical or empirical) for selecting interventions for patients with musculoskeletal disorders
Algorithm for managing subacute anterior ligament (ACL) injuries was created using clinical information on: concomitant injury, unresolved impairments, and results of a screening examination
345 highly active adults (216 men, 129 women) with subacute anterior cruciate ligament injury aged 18–65 years presenting to an orthopedic surgeon
Prospective follow-up study. Patients presenting within 7 months of their injury were treated using a decision-making algorithm. Algorithm was used as criteria to guide management and classify individuals as ‘noncopers’ (poor potential) or potential ‘copers’ (good potential) for non-operative care. Patients were followed up for the duration of care (up to 10 PT sessions over 5 weeks)
199 subjects classified as ‘noncopers’ and 146 as potential ‘copers’. 63 of 88 potential ‘copers’ successfully returned to pre-injury activities without surgery, with 25 of these not undergoing ACL reconstruction at follow-up. The algorithm should be considered as an alternative to management based on anterior knee laxity, age, and preinjury activity levels
Scoring system for selecting treatment for distal radius fractures. Includes a variety of clinical factors related to the fracture, as well as dominant hand, high occupational or recreational activity, age, and supplemental factors (Table 2 in paper)
164 patients with distal radius fracture who were 50 years or older presenting to a surgeon.
Development of the decision-making guide was described, and then a retrospective study was used to evaluate the guide in patients. Comparison was made on clinical outcomes (DASH questionnaire scores) between patients where recommendations of the guide were followed and not followed
164 patients were divided into 4 groups using the tool: conservative care, relative conservative care, relative surgical care, and surgical care. Clinical outcomes of those that followed the recommendation were better than those not following the recommendation. The present scoring system is an easy-to-use decision-making tool for choosing conservative or surgical treatment for distal radius fractures
The approach is based on 3 questions: (1) Are the symptoms reflective of a visceral disorder or a serious/potentially life-threatening disease? (2) From where is the patient’s pain arising? (3) What has gone wrong with this person as a whole that would cause the pain experience to develop and persist?
264 patients with moderate to severe low back pain over 18 years old presenting to a private practice physical therapy clinic
Cross-sectional feasibility study. Demographic, diagnostic and baseline outcome measure data were gathered on a cohort of low back pain patients examined by one of three examiners trained in the application of a diagnosis-based clinical decision rule that guided subsequent treatment
The guide can be applied in a private practice setting
It appears that patients with low back pain can be distinguished on the basis of this approach, and treatment plans can be formulated utilizing this strategy
Treatment algorithm was based on presence of fracture location, weeks in a sling, presence of pain and weakness, and arthrogram or ultrasound results
53 patients with primary traumatic anterior shoulder dislocation older than 40 years of age presenting to an orthopedic surgeon
Patients were classified into 3 groups according to an algorithm based on signs and symptoms. This algorithm was used to determine treatment. Clinical outcomes in the different groups were described after the treatment
The algorithm is suggested as an approach to treatment of primary traumatic dislocation
Treatment algorithm for acute osseous Bankart lesions consisting of a conservative strategy for small defect sizes and a surgical approach for medium-sized and large defects
25 patients who sustained acute traumatic osseous Bankart lesions after a first time shoulder dislocation from a ski or snowboard accident without rotator cuff tears
Retrospective case series to describe outcomes. Operative therapy was performed in patients with osseous defects of 5 % or more, otherwise conservative therapy was initiated
Applying the treatment algorithm appears to lead to encouraging mid-term results and a low rate of recurrent instability in active patients
Cross sectional study and test–retest reliability for a subset
Low back
Treatment-Based Classification Algorithm based on clinical examination findings for selecting treatments for patients with low back pain. This algorithm was summarized into a decision-making flowchart
250 patients with acute or sub-acute low back pain recruited from teaching hospitals (Sydney, Australia) and private physical therapy clinics (Australia and United States)
Observational study to determine the prevalence of patients meeting the criteria for each subgroup (i.e. responders to the various treatments in the system). Trained physical therapists performed standardized assessments on all participants. These findings were used to classify participants into subgroups. 31 participants were reassessed to determine inter-rater reliability of the algorithm decision
Reliability of the algorithm is sufficient for clinical use. But 25 % of participants met the criteria for more than 1 subgroup and 25 % did not meet the criteria for any subgroup. This has important implications for validity and potential revisions to the algorithm’s section that guides unclear classification
Cross-sectional secondary analysis from 3 previous studies
Low back
Treatment-Based Classification Algorithm (see above)
529 patients with low back pain treated at private physical therapy clinics in USA, Australia and the Netherlands, and public hospital physical therapy outpatient departments in Australia
To guide improvements in the algorithm, this study aimed to determine whether people with unclear classifications are different from those with clear classifications. Univariate logistic regression was used to determine which participant variables were related to having an unclear classification
People with unclear classifications appeared to be less affected by low back pain (less disability and fewer fear avoidance beliefs), despite typically having a longer duration of low back pain. Recommendations to the algorithm are suggested, this study provides no evidence that any changes will result in better outcomes
The Integrated Psychosocial Assessment Model (IPAM), a multidimensional assessment for use with patients with chronic low back pain
70 consecutive patients with chronic low back pain presenting at the Auckland Regional Pain Service or private practice pain facility in Auckland, New Zealand
Subjects were assessed on pain intensity, disability, coping strategies, depression and illness behavior. Cluster analysis was used to identify homogenous groups of patients. Clusters were named “In Control”, “Depressed and Disabled”, and “High Denial”. The clustered obtained by this study were used to propose management
The IPAM model may be valuable for identifying low back pain subgroups. Treatments corresponding to each subgroup were proposed
Clinical reasoning algorithm for treating patients with neck pain. This algorithm was developed before the study by one of the authors. The algorithm consists of 4 categories: (1) radicular arm pain or neck pain; (2) referred arm pain or neck pain; (3) cervicogenic headaches; and (4) neck pain only. There are subcategories formed by different clinical patterns that are used to guide treatment
57 adults referred from general practitioners for physical therapy treatment of neck pain. All patients had current neck pain with or without radiating pain and no other serious pathology
A quasi-experimental, nonequivalent, pretest-post-test control group design was used to investigate the effects of algorithm-based clinical decision making. Outcomes in a treatment group of 30 patients with neck pain treated based on the algorithm were compared to a control group of convenience formed of 27 subjects who also had neck pain but did not receive treatment for various reasons
After ~4 weeks of physical therapy intervention, patients in the treatment group demonstrated statistically significant increases of cervical range of motion, decreased pain, increases of physical performance measures, and decreases in level of disability. The control group showed no differences in all five outcome variables. Authors conclude that organized and specific physical therapy program was effective in improving the status of patients with neck pain, and the algorithm can help clinicians classify patients with cervical pain into clinical patterns
Clinical ‘pain modulating’ treatment classification for patients with low back pain that was formed empirically. It is considered for patients with moderate to high irritability and high pain and/or disability scores, and where judgments on spinal mobility were inconclusive and no segmental level could be determined
16 consecutive adults patients with low back pain, regardless of duration, with or without radiating pain to the lower extremities. Patients were from the waiting list of a primary care physiotherapy clinic in Sweden. All patients but one had chronic low back pain (>3 months)
The first part of the paper was descriptive, resulting in an individualized clinical decision-making algorithm
As an illustration of the utility of the presented algorithm, a multiple subject case study was then conducted, using a pretest–posttest design. The 16 patients were classified based on the algorithm, and treated based on the algorithm, then evaluated at discharge from physiotherapy
Two patients were excluded from the study (1 pregnancy and 1 with progressive symptoms). All but 1 of the remaining 14 patients showed improvements in pain intensity scores. The authors interpret study findings to suggest that the presented model may be used when clinical decisions on selecting interventions for patients with chronic low back pain are made
Decision-making scheme for returning patients to high-level activity with non-operative treatment after anterior cruciate ligament rupture. The screening exam consists of four 1- legged hop tests, the incidence of knee giving-way, a self-report functional survey, and a self-report global knee function rating
93 consecutive patients with acute unilateral anterior cruciate ligament rupture
Patients were classified as either candidates (n = 39, 42 %) or non-candidates (n = 54, 58 %) for non-operative management based on the decision-making scheme. Patients were returned to full activity an average of 4 weeks after the screening examination. Successful treatment was defined as the ability to return to preinjury levels of activity without experiencing an episode of giving-way at the knee. Failure was defined as either having at least one episode of givingway at the knee or a reduction in functional status
Of the 39 rehabilitation candidates, 28 chose non-operative management and returned to preinjury activity levels, 22 of whom (79 %) returned to preinjury activity levels without further episodes of instability or a reduction in functional status. The decision-making scheme described in this study shows promise in identifying patients who can safely postpone surgical reconstruction and temporarily return to physically demanding activities
Management of acute and chronic low back pain using the World Health Organization’s International Classification of Functioning. This model provides a method that considers biological, individual, and social contributions that can be used to classify patients
Two patients, 1 with acute and 1 with chronic pain were treated pragmatically using models of clinical reasoning
Manual therapy, exercise, and education interventions were directed toward relevant body structure and function impairments, activity limitations, and contextual factors based on their hypothesized contribution to functioning and disability. Patients were evaluated after a period of 3 and 10 weeks of intervention, respectively
Both patients demonstrated clinically important improvements in pain, disability, and psychosocial factors after intervention. The WHO-ICF model appears to provide an effective framework for physical therapists to better identify each person’s experience with his or her disablements and assists in prioritizing treatment selection
A model is developed for discriminating patients with acute back pain into subgroups depending on whether disability is related to pain beliefs, emotional distress, or workplace concerns
528 patients with work-related back pain seeking treatment for acute back pain at one of 8 community-based occupational health clinics in the New England region of the USA
Patients with back pain completed a 16-item questionnaire of potential disability risk factors before their initial medical evaluation. Outcomes of pain, functional limitation, and work disability were assessed 1 and 3 months later
A K-Means cluster analysis of 5 disability risk factors (pain, depressed mood, fear avoidant beliefs, work inflexibility, and poor expectations for recovery) resulted in 4 sub-groups: low risk (n = 182); emotional distress (n = 103); severe pain/fear avoidant (n = 102); and concerns about job accommodation (n = 141). Pain and disability outcomes at follow-up were superior in the low-risk group and poorest in the severe pain/fear avoidant group
Evaluation of the Risk Factor-Based Intervention Strategy Model proposed previously by Shaw et al. The model was developed based on a literature review and classifies patients into 1 of 4 groups that require different forms of intervention
442 workers with a new, accepted or pending, work related injury lost-time claim for low back pain who were absent from work for at least 5 days within the first 14 calendar days post-injury, and were at least 15 years of age
Claimants (n = 259) who had already returned to work, were categorized as low risk. A latent class analysis was performed on 183 workers absent from work. Groups were classified based on: pain, disability, fear avoidance beliefs, physical demands, people-oriented culture and disability management practice at the workplace, and depressive symptoms
Three classes were identified; (1) workers with ‘workplace issues’, (2) workers with a ‘no workplace issues, but back pain’, and (3) workers having ‘multiple issues’ (the most negative values on every scale, notably depressive symptoms). This study confirms an earlier model theorizing that subgroups of patients can be identified who might benefit from different interventions
Development of a sub-classification of workers with acute back pain. Patterns of early disability risk factors from this study suggest patients have differential needs with respect to overcoming emotional distress, resuming normal activity, and obtaining workplace support
496 workers seeking treatment for work-related, acute back pain at private occupational medicine clinics in the states of Massachusetts, Rhode Island, or Texas, USA
Workers completed self-report measures comprising 11 possible risk factors for chronicity of pain and disability. Outcomes of pain, function, and return-to-work were assessed at 3-month follow-up. A K-means cluster analysis was used to derive patient subgroups based on risk factor patterns, and then these subgroups were compared with respect to 3-month outcomes
A 4-cluster solution met criteria for cluster separation and interpretability, and the four clusters were labeled: minimal risk (29 %), workplace concerns (26 %); activity limitations (27 %); and emotional distress (19 %). Classifying patients in this manner may improve the cost–benefit of early intervention strategies to prevent long-term sickness absence and disability due to back pain
Development article
Clinical Prediction Rules/Classification Systems
The remaining 79 articles [76‐154] looked at 21 unique clinical prediction rules or classification systems. Four articles described the clinical prediction rules in general. Most of these studies targeted rules for identifying responders to interventions for low back pain (8 rules) followed by neck pain (6 rules), patellofemoral pain (3 rules), lateral epicondylagia (2 rules), ankle sprain (1 rule) and thoracolumbar injury (1 rule). For details on the clinical prediction rules and classification systems found in this scoping review, see Table 6. The rules were developed to determine response to specific treatments that included spinal manipulation, stabilization exercises, McKenzie approach, mechanical traction, Pilates-based exercise, foot orthoses, patellar taping, or general classification models.
Table 6
Summary of clinical prediction rules and classification systems for painful musculoskeletal conditions
Condition
Purpose of rule/system
Evaluation status of the rule/system
Low back pain
Identifying responders to spinal manipulation [77‐97, 119, 120]
Rule developed empirically
Confirmatory testing in additional samples, including workers, has shown mixed results
Unsuccessful evaluation via clinical trial
Patients positive for the main factors in the rule (symptom duration <16 days and no symptoms distal to the knee) respond to other interventions such as McKenzie therapy
Low back pain
Treatment-based classification system [55, 56, 97‐111]
Rule developed theoretically
Empirical testing has had mixed results
Mixed evaluations via clinical trial
Reliability of mobilization and stabilization subgroups has been unacceptable in some studies
Questionable utility of the system as 25 % of patients fall into multiple subgroups and 25 % remain unclassified
Low back pain
Identifying responders to stabilization exercise [92, 97, 110, 112]
Rule developed empirically
Confirmatory testing in additional samples has had mixed results
Stabilization and manipulation rules do not represent mutually exclusive subgroups
Low back pain
Identifying responders to McKenzie approach [95, 97, 113]
Rule developed empirically
No confirmatory testing
Prevalence testing of McKenzie classifications shows overlap with other prediction rules
Low back pain
Identifying non-responders to spinal manipulation [114]
Rule developed empirically
No confirmatory testing
Low back pain
Identifying responders to mechanical traction [115, 116]
Identifying responders to manual therapy and exercise [147]
Rule developed empirically
No confirmatory testing
Thoracolumbar injury
Classification system for Thoracolumbar spine injury [144, 145]
System developed theoretically
Successful reliability testing
No confirmatory testing
From the rules looking at back pain (8 rules in total involving 47 articles [77‐121, 150, 152]), three rules (rules for manipulation and stabilization exercise, and the treatment-based classification system) have been the most commonly studied. Confirmatory evaluation of these rules has shown mixed or unsuccessful results. The remaining 5 rules (rules for the McKenzie approach, mechanical traction, Pilates, and the CBI Health classification system) have been developed empirically or theoretically but no confirmatory testing has been conducted. Thus, it is unknown if the results from these studies would provide clarification regarding management of patients with back pain.
Anzeige
Six rules discussed in 18 articles targeted neck pain [122‐139]. From these rules, only one (treatment-based classification system) showed positive results when tested in case series, pilot and cohort studies. However, this rule has not been tested in a randomized controlled trial. The remaining 5 rules for neck pain were either unsuccessful (rule for thoracic manipulation) or had no confirmatory testing evidence. From the rules developed for patellofemoral pain, 2 rules discussed in 5 articles [140‐143, 146] (1 rule for patellar taping and 1 for foot orthoses) were not tested further and 1 rule for lumbopelvic manipulation obtained unsuccessful results when tested in a separate sample. The remaining rules developed for lateral epicondylalgia (2 rules in 2 articles [147, 149]), ankle sprain (1 rule in 1 article [148]) and thoracolumbar injury (1 rule in 2 articles [144, 145]) did not have additional testing. Of note, there were 3 interventions where two separate rules were generated for the same condition (traction for low back pain, manipulation for neck pain, and foot orthoses for patellofemoral pain), but results indicated the rules were not consistent and the rules were formed of different variables.
Discussion
The number of CDS tools relevant to MSK disorders is small but it appears that this field is rapidly expanding. Results of this scoping review identify that although there are several publications around CDS tools, with the majority (82 %) published since 2006, few correspond to formal and validated tools to help with the management of MSK conditions. Furthermore, the tools, models and classification systems we identified are intended for use by health care providers. One tool, the RSI Quickscan, is intended for use by ergonomists for identifying appropriate management strategies for workers with upper extremity disorders, including job or equipment modifications where appropriate. However, we were unable to locate any decision support systems for human resource managers or other employer agents who develop return-to-work processes and identify appropriate job modifications.
There was a wide range of literature including treatment algorithms/decision-models and several publications related to clinical prediction rules applied in the context of MSK disorders, most commonly low back pain. The included articles were rather diverse and most of this information was exploratory or developmental in nature, particularly with regard to use of research designs that are prone to bias including case series, cross sectional or cohort studies rather than randomized controlled trials, secondary analyses of previous collected data, and lack of replication or testing in validation samples. It appears that research in this area is starting to develop and would benefit from an internationally coordinated effort. Consequently, more studies regarding feasibility, usability, and effectiveness of these tools as well as psychometric testing would benefit the area of CDS tools applied to health care specifically to the area of MSK disorders.
Computer-Based Tools or Questionnaires
Our review located 3 questionnaires and 5 computer-based tools that were used to select interventions for patients with MSK disorders. Most of these tools were at initial stages of development or validation. However, we were not able to locate or get further information from the authors of 2 tools (DSS and PMA) indicating the developers likely did not pursue further development. The majority of the studies we reviewed were non-experimental in design, focusing on early stages of questionnaire development and testing or focused mainly on process measures, such as clinician ratings of system acceptability and usability. Of the located tools, six had some validity evidence (WATT, SBST, OMPQ, RSI QuickScan, PMA). The tool that appears to have been most evaluated has been the SBST. This tool has been translated into several languages and has demonstrated good discriminative validity when compared with widely accepted questionnaires such as the Roland Morris Disability Questionnaire and Tampa Scale of Kinesiophobia, among others (AUC ranged from 0.79 to 0.91 [155], and 0.75–0.89 [156]). Although this information is promising, this tool has not been examined through a clinical trial outside the United Kingdom. Thus, the validation studies for these tools overall have not provided strong evidence for use of these tools in clinical or workplace settings. Of note, the OMPQ was not explicitly developed as a CDS tool but as a screening/prognostic tool, which may explain the negative results in a validation study [39]. Thus, none of them are ready for widespread implementation in clinical practice since more testing is necessary.
Anzeige
Since the research obtained regarding CDS tools in MSK disorders is at the early stages, information about user preferences regarding the presentation of computer output, including content, formatting (e.g., color, graphics), and length, have not been conducted to date. Similarly, there are no published data concerning technical difficulties (e.g., type and number of system crashes or touch-screen calibration problems) encountered by computer-based CDS tool users. Both issues have important implications for future system refinements and implementation strategies. In addition, there is a lack of information regarding contextual circumstances or the processes used to integrate the CDS into the existing clinical workflow, as well as testing in different populations and settings. Most of the studies found have tested the CDS tools in one single group of patients. In addition, some limitations of the existing CDS tools for treating MSK conditions were lack of integration with computer and/or mobile devices, the reduced use of web-based interfaces, and infrequent use of data directly entered by patients. Some of the tools were even questionnaires administered by paper and pencil, which was also highlighted by the recent review performed by Pombo et al. [157].
Research of the effectiveness of CDS tools to improve patient outcomes is still fairly sparse. Only 3 of these tools (SBST, RSI QuickScan, Continuum of Care) have tested patient outcomes such as patients’ recovery, disability, cost, and quality of life. Results from these studies are inconsistent, and more replication with variable settings and population sampling strategies is needed. Other major patient outcomes of interest for policy makers have not been examined, such as health care utilization, health care costs, and communication with health care providers. Similar results have been obtained in early systematic reviews of computerized decision-support systems for chronic pain management in primary care and CDS tools targeted to healthcare professionals, especially for medical conditions [158, 159].
Further validation of these tools with larger samples and with stronger designs are needed. It is necessary that larger randomized controlled trials testing the effectiveness of CDS tools against standard care be performed to determine clearly if these systems are worth being implemented in clinical practice.
Clinical Prediction Rules/Classification Systems
Clinical Prediction Rules and classification systems that aim to identify which patients would benefit from a specific treatment have attracted the attention of many researchers regarding their effectiveness and validity. Several narrative and two systematic reviews have been conducted [29, 30]. Our scoping review adds to this literature by attempting to inventory all clinical prediction rules developed for a wide variety of MSK conditions and comment on the status of the research in this area. We located 21 clinical prediction rules that have been developed for MSK disorders, however studies evaluating effectiveness of these rules have been inconsistent. Most of the rules lack external validation in different samples using strong methods such as RCTs, but validation studies that have been conducted by separate research groups have largely been unsuccessful. We also found that rules developed for the same treatment for the same condition by different research groups were inconsistent in terms of the clinical variables in the final rules. These results are not surprising based on the results obtained from different systematic reviews focusing on rules in low back pain and the physical therapy area [29, 30, 160]. According to Beneciuk et al. [29] there are several clinical prediction rules in physical therapy that have not been validated in external samples. In addition, recently Patel et al. [161] examined the quality of the validation studies for clinical prediction rules in subjects with back pain. They found that the evidence from randomized trials validating rules for non-specific back pain is weak. These results were also in agreement with those of May et al. [30] Haskin et al. [160] and Patel et al. [161] Thus, based on the current evidence, more widespread use of clinical prediction rules for identifying responders to various interventions in clinical practice is not recommended at this point.
Anzeige
If clinical prediction rules are well designed and validated in appropriate populations, they could have the potential to identify patients most likely to benefit from a particular treatment. This in turn would help improve clinical decision-making and practice. However, the current evidence, especially the lack of cross-validation and replication, does not support large-scale implementation of clinical prediction rules to improve disability outcomes [160]. At present, it is unknown if the unsatisfactory performance of rules in clinical trials is because inappropriate rules have been tested, the trials have been poorly designed, underpowered, or simply that it is impossible to develop rules that are fit for all conditions, subjects and settings [29]. Thus more research is needed to elucidate all of these questions.
Treatment Algorithms/Decision-Models
The literature around treatment algorithms and models was diverse, which made the analysis of these studies challenging. Most of these algorithms or decision models have been developed for determining an appropriate treatment path without formal and rigorous testing. Sample sizes have been relatively small in most cases. The results from these studies also are inconsistent. Thus, no clear conclusions extracted from these algorithms or models can be made at this point.
Strengths and Limitations
This study represents the first attempt to inventory available CDS tools for MSK disorders, and comment on the status of the research literature. Strengths of our project include the involvement of a large international group or researchers and stakeholders with diverse backgrounds who provided input on the project. Additionally, we conducted a very comprehensive literature search (all languages and years since inception of databases) across health, computer science, and management databases with the assistance of research librarians as well as a search of grey literature using validated methods. The methodology used in this project was that of a scoping review, which summarizes the state of the science in a given area, but does not synthesize evidence on specific outcomes (e.g., patient outcomes, cost-effectiveness) across studies. This represents a limitation of the scoping review methodology, but it was appropriate in this case due to the diversity of methods and literature encompassed by the review. Also, scoping review methods do not require detailed critical appraisal and, therefore, study quality likely varied in the articles we identified. Additionally, while we sought to be as comprehensive as possible in our literature search, it is possible that there are other CDS tools under development that we failed to identify. As the various CDS tools are tested in different settings and using consistent methodology, more definitive conclusions about the impact of these tools on clinicians’ performance or patients outcomes may be drawn.
Conclusions
The potential for CDS tools, especially those employing rapidly advancing computer technologies, has sparked great interest among health care providers, case management organizations and funders of care. Our literature review identified 5 computer-based tools, 3 questionnaires, 14 algorithms or decision-models, as well as 21 clinical prediction rules or classification systems. However, currently none of these tools, models or systems appears ready for widespread use in clinical practice to select interventions for patients with MSK disorders. More research is needed examining more advanced levels of validity of existing tools, including impact on patient outcome, or developing new evidence-based CDS tools to help guide clinical and workplace practice for managing patients with MSK disorders.
Acknowledgments
The Workers’ Compensation Board of Manitoba provided funding for this research.
Compliance with Ethical Standards
Conflict of interest
The authors declare no conflict of interest.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
exp arm injuries/or exp back injuries/or contusions/or exp dislocations/or exp fractures, bone/or fractures, cartilage/or exp hand injuries/or exp hip injuries/or exp leg injuries/or exp neck injuries/or occupational injuries/or soft tissue injuries/or exp spinal injuries/or exp “sprains and strains”/or exp tendon injuries/
237,957
((Pain* or tear or tears or injur* or sprain* or strain* or dislocation*) adj (musc* or joint or back or spine or spinal or neck or cervical or pelvic or hip or rotator cuff or knee or ankle or elbow or shoulder)).mp.
8305
(carpal tunnel or frozen shoulder or shoulder impingement or chronic pain or myofascial pain or patellofemoral pain or regional pain disorder* or whiplash).mp.
39,549
1 or 2 or 3 or 4 or 5
356,444
(osteoporosis or (diabet* and ulcer*) or fibromyalgia or ankylosing spondilytis or RA or arthritis or osteomyelitis).ti.
113,335
exp *Osteoporosis/
32,044
exp *Diabetic Foot/
4942
exp *Fibromyalgia/
5462
exp *Arthritis/
165,770
exp *Osteomyelitis/
13,996
or/7–12
230,601
6 not 13
330,638
Decision Support Systems, Clinical/
5200
decision making, computer-assisted/or decision support techniques/
14,671
decision making/and (model or models or classification or subgroup* or sub-group* or algorithm*).mp.
12,813
decision support.mp.
22,109
clinical prediction rule*.mp.
710
decision tree*.mp.
11,491
decision system*.tw.
157
treatment based classification.tw.
35
knowledge-base*.tw.
9101
treatment rule*.tw.
72
treatment selection.tw.
1635
targeted treatment*.tw.
2353
(treatment algorithm* or management algorithm*).tw.
4400
(orebro adj4 (musculoskeletal or questionnaire* or pain*)).tw.
35
STarT Back.tw.
23
Acute Low Back Pain Screening.tw.
9
((support* or guide or aid* or rule* or tool*) adj4 decision).tw.
20,310
active knowledge system*.tw.
3
inference engine*.tw.
148
rule based system*.tw.
244
artificial intelligence/or expert systems/or “neural networks (computer)”/or support vector machines/or knowledge bases/or medical informatics computing/or exp pattern recognition, automated/
49,273
(machine learning or artificial intelligence).tw.
7145
connectionist expert system*.tw.
7
careflow system*.tw.
4
or/15–37
119,832
14 and 39
1894
limit 40 to animals
38
40 not 41
1856
limit 42 to “all child (0–18 years)”
376
limit 43 to “all adult (19 plus years)”
263
42 not (43 not 44)
1743
Ovid MEDLINE(R) In-Process & Other Non-Indexed Citations, Ovid MEDLINE(R) Daily and Ovid MEDLINE(R) 1946 to Dec 10, 2013
Criteria for scoring the psychometric properties as accomplished (adapted from Terwee et al. [31])
Internal consistency
The extent to which items in a (sub)scale are intercorrelated, thus measuring the same construct
Factor analyses performed on adequate sample size AND Cronbach’s alpha(s) calculated per dimension AND Cronbach’s alpha(s) between 0.70 and 0.95;
Content validity
The extent to which the domain of interest is comprehensively sampled by the items in the questionnaire
A clear description is provided of the measurement aim, the target population, the concepts that are being measured, and the item selection AND target population and (investigators OR experts) were involved in item selection
Criterion validity
The extent to which scores on a particular questionnaire relate to a gold standard
Convincing arguments that gold standard is ‘‘gold’’ AND correlation with gold standard >0.70;
Construct validity
The extent to which scores on a particular questionnaire relate to other measures in a manner that is consistent with theoretically derived hypotheses concerning the concepts that are being measured
Specific hypotheses were formulated AND at least 75 % of the results are in accordance with these hypotheses
Reproducibility
a. Agreement
The extent to which the scores on repeated measures are close to each other (absolute measurement error)
Convincing arguments that agreement is acceptable;
b. Reliability
Test–retest reliability
The extent of agreement across two administrations of a test, assuming nothing happened between testings (like treatment or other change-producing event)
ICC or Kappa >0.70
Inter-rater reliability
The extent of agreement among two or more raters at a single testing session. Introduces an additional source of unreliability (the rater) to the test unreliability found in other domains
Clinical Decision Support Tools for Selecting Interventions for Patients with Disabling Musculoskeletal Disorders: A Scoping Review
verfasst von
Douglas P. Gross Susan Armijo-Olivo William S. Shaw Kelly Williams-Whitt Nicola T. Shaw Jan Hartvigsen Ziling Qin Christine Ha Linda J. Woodhouse Ivan A. Steenstra
