skip to main content
article
Free Access

A comparative study of think-aloud and critical decision knowledge elicitation methods

Published:01 April 1989Publication History
Skip Abstract Section

Abstract

The knowledge elicitation phase of expert system development continues to be identified as a major hurdle in construction of comprehensive, functional expert systems (Berry, 1987; Hoffman, 1987). One of the major difficulties is that expert knowledge is multifaceted. The expert has both explicit, objective knowledge and knowledge that is more implicitly understood. Such tacit knowledge is among the most difficult for experts to articulate on their own. Reliance on standard interview methods or unstructured think-aloud protocols may inadvertently bias the knowledge engineer into focusing on those aspects of the task that can be reasonable well represented within if/then, rule-based systems. The systems that result may lack critical components of expert knowledge. It is therefore essential that knowledge elicitation methods be sensitive to the contributions made by tacit knowledge and perceptual learning (Berry, 1987; Collins, Green, & Draper, 1985; Klein, Calderwood, & MacGregor, in press).

References

  1. Berry, D. C., (1987). The problem of implicit knowledge. Expert Systems, 4, 144-151.Google ScholarGoogle ScholarCross RefCross Ref
  2. Calderwood, R., Crandall, B., & Klein, G. A., (1987). Expert and novice fire ground command decisions (KATR-858(D)-87-02F). Yellow Springs, OH: Klein Associates, Inc. Prepared under contract MDA903-85-C-0327 for U.S. Army Research Institute, Alexandria, VA.Google ScholarGoogle Scholar
  3. Collins, H. M., Green, R.H., & Draper, R.C., (1985). Where's the expertise?: Expert systems as a medium of knowledge transfer. In M. Merry (Ed.), Expert systems '85. NY, NY: Cambridge University Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Crandall, B., & Klein, G. A., (1987). Key components of MIS performance. Yellow Springs, OH: Klein Associates, Inc. Report prepared for Standard Register, Dayton, OH.Google ScholarGoogle Scholar
  5. Hoffman, R. R., (1987). The problem of extracting the knowledge of experts from the perspective of experimental psychology. AI Magazine, 8, 53-67. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Klein, G. A., (1988). The development of knowledge elicitation methods for capturing military expertise (KATR-863-88-08F). Yellow Springs, OH: Klein Associates, Inc. Prepared under contract MDA903-86-C-0170 for the U.S. Army Research Institute for the Behavioral and Social Sciences, Alexandria, VA.Google ScholarGoogle Scholar
  7. Klein, G. A., Calderwood, R., & Clinton-Cirocco, A., (1986). Rapid decision making on the fire ground. Proceedings of the Human Factors Society 30th Annual Meeting, 1, 576-580. Dayton, OH: Human Factors Society.Google ScholarGoogle ScholarCross RefCross Ref
  8. Klein, G. A., Calderwood, R., & MacGregor, D., (In press). Critical decision methods for eliciting knowledge. IEEE Transactions on Systems, Man, and Cybernetics, Special Issue.Google ScholarGoogle Scholar
  9. Taynor, J., Klein, G. A., & Thordsen, M., (1987). Distributed decision making in wildland firefighting (KATR-858(A)-04F). Yellow Springs, OH: Klein Associates, Inc. Prepared under contract MDA903-85-C-0327 for U.S. Army Research Institute, Alexandria, VA.Google ScholarGoogle Scholar

Index Terms

  1. A comparative study of think-aloud and critical decision knowledge elicitation methods

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM SIGART Bulletin
      ACM SIGART Bulletin Just Accepted
      Special issue on knowledge acquisition
      April 1989
      205 pages
      ISSN:0163-5719
      DOI:10.1145/63266
      Issue’s Table of Contents

      Copyright © 1989 Author

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 1 April 1989

      Check for updates

      Qualifiers

      • article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader