Shamsi T. Iqbal
ABSTRACT
To contribute to systems that reason about human attention, our work empirically demonstrates how a user's mental workload changes during task execution. We conducted a study where users performed interactive, hierarchical tasks while mental workload was measured through the use of pupil size. Results show that (i) different types of subtasks impose different mental workload, (ii) workload decreases at subtask boundaries, (iii) workload decreases more at boundaries higher in a task model and less at boundaries lower in the model, (iv) workload changes among subtask boundaries within the same level of a task model, and (v) effective understanding of why changes in workload occur requires that the measure be tightly coupled to a validated task model. From the results, we show how to map mental workload onto a computational Index of Opportunity that systems can use to better reason about human attention.
- Adamczyk, P.D. and B.P. Bailey. If Not Now When? The Effects of Interruptions at Various Moments within Task Execution. CHI, 2004, 271--278. Google Scholar
Digital Library
- Bailey, B.P., J.A. Konstan and J.V. Carlis. The Effects of Interruptions on Task Performance, Annoyance, and Anxiety in the User Interface. INTERACT, 2001, 593--601.Google Scholar
- Beatty, J. Task-Evoked Pupillary Responses, Processing Load, and the Structure of Processing Resources. Psychological Bulletin, 91 (2), 276--292, 1982.Google ScholarCross Ref
- Bradshaw, J.L. Pupil Size as a Measure of Arousal During Information Processing. Nature, 216, 515--516, 1967.Google ScholarCross Ref
- Card, S., T. Moran and A. Newell. The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates, 1983. Google ScholarDigital Library
- Cutrell, E., M. Czerwinski and E. Horvitz. Notification, Disruption and Memory: Effects of Messaging Interruptions on Memory and Performance. INTERACT, 2001, 263--269.Google Scholar
- Czerwinski, M., E. Cutrell and E. Horvitz. Instant Messaging and Interruption: Influence of Task Type on Performance. Proc. OZCHI, 2000, 356--361.Google Scholar
- Czerwinski, M., E. Cutrell and E. Horvitz. Instant Messaging: Effects of Relevance and Timing. In People and Computers XIV: Proceedings of HCI, 2000, 71--76.Google Scholar
- Gillie, T. and D. Broadbent. What Makes Interruptions Disruptive? A Study of Length, Similarity, and Complexity. Psychological Research, 50, 243--250, 1989.Google ScholarCross Ref
- Hess, E.H. and J.M. Polt. Pupil Size in Relation to Mental Activity During Simple Problem Solving. Science, 132, 1190--1192, 1964.Google ScholarCross Ref
- Hoecks, B. and W. Levelt. Pupillary Dilation as a Measure of Attention: A Quantitative System Analysis. Behavior Research Methods, Instruments, & Computers, 25, 16--26, 1993.Google Scholar
- Horvitz, E. and J. Apacible. Learning and Reasoning About Interruption. In Proceedings of the Fifth ACM International Conference on Multimodal Interfaces, 2003, 20--27. Google ScholarDigital Library
- Horvitz, E., J. Breese, D. Heckerman, D. Hovel and K. Rommelse. The Lumiere Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users. Proc. Uncertainty in Artificial Intelligence, 1998, 256--265. Google ScholarDigital Library
- Horvitz, E., A. Jacobs and D. Hovel. Attention-Sensitive Alerting. Proc. Uncertainty in Artificial Intelligence, 1999, 305--313. Google ScholarDigital Library
- Hudson, S.E., J. Fogarty, C.G. Atkeson, D. Avrahami, J. Forlizzi, S. Kiesler, J.C. Lee and J. Yang. Predicting Human Interruptibility with Sensors: A Wizard of Oz Feasibility Study. CHI, 2003, 257--264. Google ScholarDigital Library
- Hytintk, J., J. Tommola and A. Alaja. Pupil Dilation as a Measure of Processing Load in Simultaneous Interpretation and Other Language Tasks. The Quarterly Journal of Experimental Psychology, 48A (3), 598--612, 1995.Google Scholar
- Iqbal, S.T., X.S. Zheng and B.P. Bailey. Task-Evoked Pupillary Response to Mental Workload in Human-Computer Interaction. CHI, 2004, 1477--1480. Google ScholarDigital Library
- Jackson, T.W., R.J. Dawson and D. Wilson. The Cost of Email Interruption. Journal of Systems and Information Technology, 5 (1), 81--92, 2001.Google ScholarCross Ref
- John, B., A. Vera, M. Matessa, M. Freed and R. Remington. Automating CPM-Goms. CHI, 2002, 147--154. Google ScholarDigital Library
- Juris, M. and M. Velden. The Pupillary Response to Mental Overload. Physiological Psychology, 5 (4), 421--424, 1977.Google ScholarCross Ref
- Kahneman, D. Pupillary Responses in a Pitch-Discrimination Task. Perception & Psychophysics, 2, 101--105, 1967.Google ScholarCross Ref
- Kramer, A.F. Physiological Metrics of Mental Workload: A Review of Recent Progress. In Damos, D.L. ed. Multiple-Task Performance, Taylor and Francis, London, 1991, 279--328.Google Scholar
- Kreifeldt, J.G. and M.E. McCarthy. Interruption as a Test of the User-Computer Interface. In Proceedings of the 17th Annual Conference on Manual Control, Jet Propulsion Laboratory, California Institute of Technology, JPL Publication 81-95, 1981, 655--667.Google Scholar
- Maes, P. Agents That Reduce Work and Information Overload. Communications of the ACM, 37 (7), 30--40, 1994. Google ScholarDigital Library
- Marshall, S.P. New Techniques for Evaluating Innovative Interfaces with Eye Tracking. UIST, 2003, Keynote Talk. Google ScholarDigital Library
- McFarlane, D.C. Coordinating the Interruption of People in Human-Computer Interaction. INTERACT, 1999, 295--303.Google Scholar
- Miyata, Y. and D.A. Norman. The Control of Multiple Activities. In Norman, D.A. and Draper, S.W. (eds.) User Centered System Design: New Perspectives on Human-Computer Interaction, Lawrence Erlbaum Associates, Hillsdale, NJ, 1986.Google Scholar
- Nakayama, M. and K. Takahashi. The Act of Task Difficulty and Eye-Movement Frequency for the Ocul-Motor Indices. In Proceedings of Eye Tracking Research and Application, 2002, 37--42. Google ScholarDigital Library
- Picard, R.W. Affective Computing. MIT Press, 1997. Google ScholarDigital Library
- Rowe, D.W., J. Sibert and D. Irwin. Heart Rate Variability: Indicator of User State as an Aid to Human-Computer Interaction. CHI, 1998, 480--487. Google ScholarDigital Library
- Shell, J.S., T. Selker and R. Vertegaal. Interacting with Groups of Computers. CACM, 46 (3), 40--46, 2003. Google ScholarDigital Library
- Speier, C., J.S. Valacich and I. Vessey. The Influence of Task Interruption on Individual Decision Making: An Information Overload Perspective. Decision Sciences, 30 (2), 337--360, 1999.Google ScholarCross Ref
- Takahashi, K., M. Nakayama and Y. Shimizu. The Response of Eye-Movement and Pupil Size to Audio Instruction While Viewing a Moving Target. Proc. Eye Tracking Research & Applications, 2000. Google ScholarDigital Library
- Tobii-Systems. http://www.tobii.se/Google Scholar
- Wilson, G.M. and M.A. Sasse. The Head or the Heart?: Measuring the Impact of Media Quality. CHI, 2000, 117--118. Google ScholarDigital Library
- Zijlstra, F.R.H., R.A. Roe, A.B. Leonora and I. Krediet. Temporal Factors in Mental Work: Effects of Interrupted Activities. Journal of Occupational and Organizational Psychology, 72, 163--185, 1999.Google ScholarCross Ref
Index Terms
- Towards an index of opportunity: understanding changes in mental workload during task execution
Recommendations
Understanding changes in mental workload during execution of goal-directed tasks and its application for interruption management
Notifications can have reduced interruption cost if delivered at moments of lower mental workload during task execution. Cognitive theorists have speculated that these moments occur at subtask boundaries. In this article, we empirically test this ...
Investigating the effectiveness of mental workload as a predictor of opportune moments for interruption
CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing SystemsThis work investigates the use of workload-aligned task models for predicting opportune moments for interruption. From models for several tasks, we selected boundaries with the lowest (Best) and highest (Worst) mental workload. We compared effects of ...
Task-evoked pupillary response to mental workload in human-computer interaction
CHI EA '04: CHI '04 Extended Abstracts on Human Factors in Computing SystemsAccurate assessment of a user's mental workload will be critical for developing systems that manage user attention (interruptions) in the user interface. Empirical evidence suggests that an interruption is much less disruptive when it occurs during a ...
Comments