Review
Computer-based execution of clinical guidelines: A review

https://doi.org/10.1016/j.ijmedinf.2008.05.010Get rights and content

Abstract

Purpose

Clinical guidelines are useful tools to standardize and improve health care. The automation of the guideline execution process is a basic step towards its widespread use in medical centres. This paper presents an analysis and a comparison of eight systems that allow the enactment of clinical guidelines in a (semi) automatic fashion.

Methods

This paper presents a review of the literature (2000–2007) collected from medical databases as well as international conferences in the medical informatics area.

Results

Eight systems containing a guideline execution engine were selected. The language used to represent the guidelines as well as the architecture of these systems were compared. Different aspects have been assessed for each system, such as the integration with external elements or the coordination mechanisms used in the execution of clinical guidelines. Security and terminology issues complement the above study.

Conclusions

Although these systems could be beneficial for clinicians and patients, it is an ongoing research area, and they are not yet fully implemented and integrated into existing careflow management systems and hence used in daily practice in health care institutions.

Introduction

Nowadays, the execution of clinical guidelines (CGs) is one of the most interesting topics of study within clinical informatics. CGs contain a set of directions or principles to assist the health care practitioner with patient care decisions about appropriate diagnostic, therapeutic, or other clinical procedures for specific clinical circumstances [1]. They are intended to ensure consistent high quality clinical practice and provide some benefits to both patients and health care managers [2], [3], [4], [5], [6], [7], [8], such as:

  • For health care professionals, the use of CGs can improve the quality of clinical decisions and activities and, in consequence, the patient outcomes are also improved (e.g., a clinician will not forget an important aspect to be checked before ordering a certain treatment).

  • CGs facilitate reuse of knowledge, because a guideline can be adapted, tailored and applied to different clinical situations.

  • Guidelines support rapid dissemination of updates and changes. CGs promote interventions of proved benefits and discourage those that are ineffective.

  • CGs help doctors to use the clinical knowledge about the patient at the appropriate point of his care.

  • Guideline authors are encouraged to employ rigorous formal techniques, which help to ensure syntactic, logical and medical validity of CGs.

Although several international organisations create and maintain repositories1 with guidelines in different domains (e.g., oncology, cardiology, paediatrics), they are not being widely used in daily practice. Several factors limiting or restricting complete physicians adherence to clinical guidelines were identified in [9]. Such factors include lack of awareness with the guideline’s existence, lack of agreement, lack of physician self-efficacy, lack of outcome expectancy, or the inherent difficulty to change habits in daily behaviour. These factors could be tackled (in most cases) with an automation and computerisation of the daily management of both clinical guidelines and patient data [10].

Several steps must be considered in the management of clinical guidelines: representation, acquisition, verification and execution. The first three tasks concern the authors of the guideline, whereas the later is related to practitioners. Briefly, these steps can be described as follows:

  • (a)

    Choice of a representation language. A CG contains several elements to be modelled, such as actions, required patient data, decisions to be made, constraints between tasks, temporal constraints in a global plan, etc. Different researchers have defined formal languages to model computer-interpretable clinical guidelines, such as PROforma, EON, GLIF, GUIDE or Asbru [11], [12], [13], [14].

  • (b)

    Acquisition of CGs. Medical guidelines are based on the evidence collected from clinical trials and existing literature [15], [16]. Some authors are also currently working in the semi-automatic construction of guidelines, by applying Machine Learning techniques from a corpus of clinical data collected in a medical centre [17] or directly from textual documents [18].

  • (c)

    Verification of CGs. Verification includes two aspects: is a medical guideline well formed?, and, which of these two available medical guidelines is the best? The first question seeks to verify the formal correctness of the guideline [7]. The second question is more difficult to answer since it is necessary to quantify how appropriate is a medical guideline. To tackle this problem, some authors proposed an evaluation procedure called AGREE which calculates a set of parameters for a given medical guideline to evaluate its quality [19]. In addition a methodology to facilitate the whole development and evaluation of clinical guidelines can be found in [20].

  • (d)

    Execution aspects. As mentioned above, a medical guideline contains a great amount of information to be considered (decisions to be made, constraints between tasks, temporal restrictions). All these data have to be collected and monitored when enacting the guideline.

Concretely, while representation, acquisition and verification stages are currently active research areas [21], [22], [23], the execution of guidelines is a less developed field. This paper is focused on the analysis of systems that allow the automatic (or semi-automatic) execution of guidelines. Several systems are currently being developed for this purpose. In the next section we describe the basic characteristics to be analysed in a guideline execution engine (e.g., coordination issues, security techniques, use of standard medical vocabularies). Section 3 provides a table that summarizes the main information of each system and comments the results obtained for each of the analysed attributes. Section 4 states some comments derived from the comparison of the systems. Finally, the last section briefly summarises a list of concluding remarks.

Section snippets

Guideline execution engines

A guideline execution engine should ideally fulfil the following requirements:

  • To keep a repository of guidelines.

  • To facilitate the creation of guidelines through a graphical editor, or even define a methodology to create or reuse guidelines.

  • To provide a formal language for encoding medical guidelines.

  • To provide mechanisms to coordinate the services required in the use/management of guidelines.

  • To allow the user to analyse the behaviour of the guideline (e.g., by providing a run-time engine or a

Comparison

In the previous section several computer-based systems that manage clinical guidelines have been briefly described. All of them have different scopes, representations and architectures, according to the research interests of each developing group. This section provides a high level comparison of these tools, focused on the items in Table 1. These items are the following:

  • (a)

    the existence of a repository of guidelines,

  • (b)

    the presence or absence of a tool offering a (graphical) editor to create and

Discussion

This survey has described the basic aspects of several applications oriented towards the automation of clinical guidelines. As a result of this survey, several limitations were identified and should be tackled in the future. One of them is the representation of computer-interpretable guidelines. The representation language is the basis of these tools, and it could be desirable to adopt one formalism as standard and promote the interoperability between different tools and systems. This

Conclusions

This paper analysed and compared different guideline-based execution systems. A brief list of conclusions of this review is the following:

  • It is widely accepted that the adoption of guideline execution engines in daily practice would improve the patient care, by standardising the care procedures.

  • A guideline stores medical knowledge (declarative) about medical procedures. It is important to use a common vocabulary and adopt one of the available terminologies to permit reuse, learn and share this

Acknowledgements

We would like to thank the referees for their valuable comments which helped to improve this paper. The work has been supported by a URV grant, and partially supported by the EU-funded project K4CARE (IST-2004-026968) and the Spanish-funded project HYGIA (TIN2006-15453-C04-01).

Authorscontributions. The first author selected the eight approaches that were analysed in this review and wrote most of the paper. The second author critically revised several drafts of the paper. Both authors have

References (94)

  • L. Anselma et al.

    Towards a comprehensive treatment of repetitions, periodicity and temporal constraints in clinical guidelines

    Artificial Intelligence in Medicine

    (2006)
  • P. Terenziani et al.

    A modular approach for representing and executing clinical guidelines

    Artificial Intelligence in Medicine

    (2001)
  • D. Wang et al.

    Design and implementation of the GLIF3 guideline execution engine

    Journal of Biomedical Informatics

    (2004)
  • J. Choi et al.

    Encoding a clinical practice guideline using guideline interchange format: a case study of a depression screening and management guideline

    International Journal of Medical Informatics

    (2007)
  • A.A. Boxwala et al.

    GLIF3: a representation format for sharable computer-interpretable clinical practice guidelines

    Journal of Biomedical Informatics

    (2004)
  • P. Ciccarese et al.

    Architectures and tools for innovative health information systems: the guide project

    International Journal of Medical Informatics

    (2005)
  • S. Quaglini et al.

    Guideline-based careflow systems

    Artificial Intelligence in Medicine

    (2000)
  • S. Quaglini et al.

    Flexible guideline-based patient careflow systems

    Artificial Intelligence in Medicine

    (2001)
  • S.W. Tu et al.

    The SAGE guideline model: achievements and overview

    Journal of the American Medical Informatics Association

    (2007)
  • J.H. Gennari et al.

    The evolution of Protégé: an environment for knowledge-based systems development

    International Journal of Human-Computer Studies

    (2003)
  • D.W. Bates et al.

    Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality

    Journal of the American Medical Informatics Association

    (2003)
  • A.A. Boxwala et al.

    Toward a representation format for sharable clinical guidelines

    Journal of Biomedical Informatics

    (2001)
  • M. Peleg et al.

    The InterMed approach to sharable computer-interpretable guidelines: motivations and lessons

    Journal of the American Medical Informatics Association

    (2004)
  • A. Holbrook et al.

    Applying methodology to electronic medical record selection

    International Journal of Medical Informatics

    (2003)
  • M. Peleg et al.

    Mapping computerized clinical guidelines to electronic medical records: knowledge-data ontological mapper (KDOM)

    Journal of Biomedical Informatics

    (2008)
  • M.L. Müller et al.

    Towards integration of clinical decision support in commercial hospital information systems using distributed, reusable software and knowledge components

    International Journal of Medical Informatics

    (2001)
  • G. Schadow et al.

    Conceptual alignment of electronic health record data with guideline and workflow knowledge

    International Journal of Medical Informatics

    (2001)
  • A. Veselý et al.

    Medical guidelines presentation and comparing with electronic health record

    International Journal of Medical Informatics

    (2006)
  • P.L. Elkin et al.

    Toward standardization of electronic guideline representation

    MD Computing

    (2001)
  • D. Hart

    Risk management, clinical guidelines, clinical pathways and health law

    European Journal of Health Law

    (2003)
  • F. Rutten et al.

    Practice guidelines based on clinical and economic evidence. Indispensable tools in future market oriented health care

    European Journal of Health Economics

    (2005)
  • A. ten Teije et al.

    Improving medical protocols by formal methods

    Artificial Intelligence in Medicine

    (2006)
  • S.H. Woolf et al.

    Potential benefits, limitations, and harms of clinical guidelines

    British Medical Journal

    (1999)
  • M.D. Cabana et al.

    Why don’t physicians follow clinical practice guidelines? A framework for improvement

    Journal of the American Medical Informatics Association

    (1999)
  • J. Fox et al.

    Safe and Sound

    (2000)
  • M. Peleg et al.

    Comparing computer-interpretable guideline models: a case-study approach

    Journal of the American Medical Informatics Association

    (2003)
  • D.A. Wang et al.

    Representation of clinical practice guidelines

  • D. Davis et al.

    Handbook on Clinical Practice Guidelines

    (2007)
  • S.G. Priori et al.

    Medical practice guidelines: separating science from economics

    European Heart Journal

    (2003)
  • D. Riaño

    Ordered time-independent CIG learning

  • K.M. Hrabak et al.

    Creating interoperable guidelines: requirements of vocabulary standards in immunization decision support

  • The AGREE Collaboration

    Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project

    Quality and Safety in Health Care

    (2003)
  • S. Ricci et al.

    Development of clinical guidelines: methodological and practical issues

    Neurological Sciences

    (2006)
  • F. Chesani et al.

    A framework for defining and verifying clinical guidelines: a case study on cancer screening

  • T.-Y. Leong et al.

    Free and open source enabling technologies for patient-centric, guideline-based clinical decision support: a survey, IMIA yearbook of medical informatics

    Methods of Information in Medicine

    (2007)
  • A. Seyfang et al.

    Bridging the gap between informal and formal guideline representations

  • Cited by (167)

    • Guidelines and workflow models

      2023, Clinical Decision Support and beyond: Progress and Opportunities in Knowledge-Enhanced Health and Healthcare
    • Comprehensive analysis of rule formalisms to represent clinical guidelines: Selection criteria and case study on antibiotic clinical guidelines

      2020, Artificial Intelligence in Medicine
      Citation Excerpt :

      8. Compliance with well-established medical standards, e.g. regarding HIS data representation, so that a given knowledge system can be easily adopted by any institution, as a single source of truth that is sharable within the clinical community [5,8,9,11,17,102,125]. Of this initial list of requirements, which is based on both antibiotic CGs and the most common pitfalls in CDSSs, we have identified 3 main categories of analysis for the selection and assessment of rule technologies:

    View all citing articles on Scopus
    View full text