Sunny Consolvo
ABSTRACT
We present our experiences with evaluating an ambient display for the home using two different evaluation techniques: the recently proposed 'Heuristic Evaluation of Ambient Displays' and an in situ, 3-week long, Wizard of Oz evaluation. We compare the list of usability violations found in the heuristic evaluation to the set of problems that were discovered in the in situ evaluation. Overall, the 'Heuristic Evaluation of Ambient Displays' was effective - 75% of known usability problems were found by eight evaluators (39-55% were found by 3-5 evaluators). However, the most severe usability problem found in the in situ evaluation was not identified in the heuristic evaluation. Because the problem directly violated one of the heuristics, we believe that the problem is not with the heuristics, but rather that evaluators have minimal experience with ambient displays for the home.
- Consolvo, S., Roessler, P., Shelton, B.E., "The CareNet Display: Lessons Learned from an In Home Evaluation of an Ambient Display," Proceedings of the 6th Int'l Conference on Ubiquitous Computing: UbiComp '04, (Sep 2004), pp.1--17.Google Scholar
- Mankoff, J., Dey, A.K., Hsieh, G., Kientz, J., Lederer, S., Ames, M., "Heuristic Evaluation of Ambient Displays," Proceedings of the Conference on Human Factors in Computing Systems: CHI '03, (Apr 2003), pp.169--76. Google ScholarDigital Library
- Mynatt, E.D., Rowan, J., Jacobs, A., Craighill, S. "Digital Family Portraits: Supporting Peace of Mind for Extended Family Members," Proceedings of Conference on Human Factors in Computing Systems: CHI '01, (Apr 2001) pp.333--40. Google ScholarDigital Library
- Nielsen, J. "Heuristic evaluation," In Nielsen, J., and Mack, R.L. (Eds.), Usability Inspection Methods, John Wiley & Sons, New York, NY (1994), pp. 47--9 Google ScholarDigital Library
- Nielsen, J., Molich, R., "Heuristic evaluation of user interfaces," Proceedings of Conference on Human Factors in Computing Systems: CHI 90, (1990), pp.249--56. Google ScholarDigital Library
Index Terms
- Evaluating an ambient display for the home
Recommendations
Heuristic evaluation of ambient displays
CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe present a technique for evaluating the usability and effectiveness of ambient displays. Ambient displays are abstract and aesthetic peripheral displays portraying non-critical information on the periphery of a user's attention. Although many ...
Evaluating ambient displays in the wild: highlighting social aspects of use in public settings
DIS '12: Proceedings of the Designing Interactive Systems ConferenceA prominent issue for evaluating ambient displays has been the conflict between the relative intrusiveness of evaluation methods and the intention to keep the display at the periphery of the user's attention. There is a general lack of research ...
Ambient agoras: InfoRiver, SIAM, Hello.Wall
CHI EA '04: CHI '04 Extended Abstracts on Human Factors in Computing SystemsThis demonstration reports results from the EU-funded project Ambient Agoras, investigating future applications of ubiquitous and ambient computing in workspaces. Instead of presenting underlying system technologies or evaluation findings, this ...
Comments