skip to main content
10.1145/958432.958478acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
Article

The role of spoken feedback in experiencing multimodal interfaces as human-like

Published:05 November 2003Publication History

ABSTRACT

If user interfaces should be made human-like vs. tool-like has been debated in the HCI field, and this debate affects the development of multimodal interfaces. However, little empirical study has been done to support either view so far. Even if there is evidence that humans interpret media as other humans, this does not mean that humans experience the interfaces as human-like. We studied how people experience a multimodal timetable system with varying degree of human-like spoken feedback in a Wizard-of-Oz study. The results showed that users' views and preferences lean significantly towards anthropomorphism after actually experiencing the multimodal timetable system. The more human-like the spoken feedback is the more participants preferred the system to be human-like. The results also showed that the users experience matched their preferences. This shows that in order to appreciate a human-like interface, the users have to experience it.

References

  1. Brennan, S. E., and Ohaeri, J. O. Effects of message style on users' attribution toward agents. In Proceedings of the Conference on Human Factors in Computing Systems: CHI'94 (1994), ACM Press, pp. 281--282. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Burgoon, J. K., Bonito, J. A., Bengtsson, B., Cederberg, C., Lundberg, M., and Allspach, L. Interactivity in human-computer interaction: A study of credibility, understanding, and influence. Computers in Human Behaviour 16 (2000), 553--574.Google ScholarGoogle ScholarCross RefCross Ref
  3. Cassell, J. Emboded conversational agents, representation and intelligence in user interfaces. AI Magazine Winter (2001), 67--83. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjalmsson, H., and Yan, H. Embodiment in conversational interfaces: Rea. In Proceeding of the Conference on Human Factors in Computing Systems: CHI'99 (Pittsburgh, 1999), pp. 520--527. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Clark, H. C., and Schaeffer, E. F. Contributing to discourse. Cognitive Science 13 (1989), 259--294.Google ScholarGoogle ScholarCross RefCross Ref
  6. Cohen, P. R. The role of natural language in a multimodal interface. In Proceedings of the Symposium on User Interface Software and Technology: UIST'92 (1992), ACM, pp. 143--149. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Dahlbäck, N., Jönsson, A., and Ahrenberg, L. Wizard of oz studies - why and how. Knowledge-Based Systems 6, 4 (December 1993), 258--266.Google ScholarGoogle ScholarCross RefCross Ref
  8. Dehn, D. M., and van Mulken, S. The impact of animated interface agents: a review of empirical research. International Journal of Human-Computer Studies 52 (2000), 1--22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Frohlich, D. M. The design space of interface. In Multimedia: Systems, interaction and Application, L. Kjelldahl, Ed. Springer-Verlag, Berlin, 1991, pp. 53--69.Google ScholarGoogle Scholar
  10. Heckman, C. E., and Wobbrock, J. O. Put your best face forward: Anthropomorphic agents, e-commerce consumers, and the law. In Proceedings of the International Conference on Autonomous Agents (2000), pp. 435--442. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Horvitz, E. Principles for mixed-initiative user interfaces. In Proceedings of the Conference on Human Factors in Computing Systems: CHI'99 (Pittsburgh, 1999), pp. 159--166. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Isbister, K., and Nass, C. Consistency of personality in interactive characters: Verbal cues, non-verbal cues, and user characteristics. International Journal of Human-Computer Studies 53 (2000), 251--267. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Jönsson, A., and Dahlbäck, N. Talking to a computer is not like talking to your best friend. In Proceedings of the First Scandinavian Conference on Artificial Intelligence (Tromso, Norway, March 9-11, 1988).Google ScholarGoogle Scholar
  14. Laurel, B. Interface as mimesis. In User Centered Systems Design: New Perspectives on Human Computer Interface Design, D. A. Norman and S. W. Draper, Eds. Lawrence Erlbaum Associates, Hilldale, NJ, 1986, pp. 87--124.Google ScholarGoogle Scholar
  15. Lester, J. C., Converse, S. A., Kahler, S. E., Barlow, S. T., Stone, B. A., and Bhogal, R. S. The persona effect: Affective impact of animated pedagogical agents. In Proceedings of the Conference on Human Factors in Computing Systems, CHI '97, (1997), 359--366. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Maybury, M. T. Intelligent user interfaces for all. In User Interfaces for All, Concepts, Methods, and Tools, C. Stephanidis, Ed. Lawrence Erlbaum Associates, Publishers, Mahwah, NJ, 2001, pp. 65--80.Google ScholarGoogle Scholar
  17. Oviatt, S. Multimodal interfaces for dynamic interactive maps. In Proceedings of the Conference on Human-Factors in Computing Systems: CHI'96 (1996), New York, ACM Press, pp. 95--102. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Oviatt, S., Cohen, P., Wu, L., Vergo, J., Duncan, L., Suhm, B., Bers, J., Holzman, T., Winograd, T., Landay, J., Larson, J., and Ferro, D. Designing the user interface for multimodal speech and pen-based gesture application: State-of-the-art systems and future research direction. Human-Computer Interaction 15 (2000), 263--322. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Reeves, B., and Nass, C. The Media Equation - How People Treat Computers, Television, and New Media Like Real People and Places. CSLI Publications and Cambridge University Press, Cambridge, New York, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Rickenberg, R., and Reeves, B. The effect of animated characters on anxiety, task performance, and evaluation of user interfaces. In Proceedings of the Conference on Human Factors in Computing Systems (CHI'2000) (2000), pp. 49--56. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Schaumburg, H. Computers as tools or as social actors? - The users' perspective on anthropomorphic agent. International Journal of Cooperative Information Systems 10, 1, 2 (2001), 217--234.Google ScholarGoogle ScholarCross RefCross Ref
  22. Shechtman, N., and Horowitz, L. M. Media inequality in conversation: How people behave differently when interacting with computers and people. In Proceedings of the Conference on Human Factors in Computing Systems, (CHI'03) (2003), pp. 281--288. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Suhm, B., Myers, B., and Waibel, A. Multimodal error correction for speech user interfaces. ACM Transactions on Computer-Human Interaction 8, 1 (March 2001), 60--98. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Takeuchi, A., and Nagao, K. Communicative facial displays as new conversational modality. In Proceedings of the Conference on Human Factors in Computing Systems (INTERCHI'93) (1993), pp. 187--193. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Walker, J. H., Sproull, L., and Subramani, R. Using a human in an interface. In Proceeding of the Conference on Human Factors in Computing Systems: CHI'94 (1994), pp. 85--91. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Weizenbaum, J. ELIZA-a computer program for the study of natural language communication between man and machine. Communication of the ACM 9, 1 (1966), 36--45. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. The role of spoken feedback in experiencing multimodal interfaces as human-like

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Conferences
              ICMI '03: Proceedings of the 5th international conference on Multimodal interfaces
              November 2003
              318 pages
              ISBN:1581136218
              DOI:10.1145/958432

              Copyright © 2003 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 5 November 2003

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • Article

              Acceptance Rates

              ICMI '03 Paper Acceptance Rate45of130submissions,35%Overall Acceptance Rate453of1,080submissions,42%

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader