Use of Critical Analysis Method to Conduct a Cognitive Task Analysis of Intelligence Analysts
Abstract
Intelligence analysts (IAs) engage in information seeking, evaluation, prediction, and reporting
behavior in an information-intensive work environment. A Cognitive Task Analysis (CTA) was
conducted to capture data that will provide input to support development of a model of the IAs
processes, biases, and analytic strategies. A hybrid method was used to conduct the CTA,
including a modified version of the critical decision method -the critical analysis method. The
essential distinction was that participants were asked to describe an example of a strategic
analysis problem. Procedures used to conduct the critical analysis method are described in this
paper. Several factors contribute to making the IA’s task challenging: (i) time pressure to produce
reports in a shorter timeframe, (ii) a high cognitive workload, and (iii) difficult human judgments
that are required regarding uncertain validity and reliability of the data. Human judgments are
involved in considering the plausibility of information, deciding what information to trust, and
determining how much weight to place on specific pieces of data. Intelligence analysis involves a
complex process of assessing the reliability of information from a wide variety of sources and
combining seemingly unrelated events. This problem is challenging because it involves aspects of
data mining, data correlation and human judgment.
Description
In Proceedings of the 47th Human Factors and Ergonomics Society Meeting, October 13-17, 2003, Denver, CO.
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.Collections
Related items
Showing items related by title, author, creator and subject.
-
Section 1, What Makes Intelligence Analysis Difficult? A Cognitive Task Analysis of Intelligence Analysts
Hutchins, Susan G.; Pirolli, Peter L.; Card, Stuart K. (2007);Intelligence analysts engage in information seeking, evaluation, prediction, and reporting behavior in an extremely information-intensive work environment. A Cognitive Task Analysis (CTA) was conducted on intelligence ... -
A New Perspective on Use of the Critical Decision Method with Intelligence Analysts
Hutchins, Susan G.; Pirolli, Peter L.; Card, Stuart K. (2004-06);Intelligence analysts engage in information seeking, evaluation, prediction, and reporting behavior in an extremely information-intensive work environment. A Cognitive Task Analysis (CTA) was conducted on intelligence analysts ... -
EXPLORING THE USE OF HUMAN RELIABILITY AND ACCIDENT INVESTIGATION METHODS TO INFLUENCE DESIGN REQUIREMENTS FOR NAVAL SYSTEMS
Whitehead, Cindy R. (Monterey, CA; Naval Postgraduate School, 2020-09);This thesis explores whether established methods from human reliability analysis and accident investigation can be applied early in system development to identify the design vulnerabilities that increase risk of system ...