Roel Vertegaal
ABSTRACT
We present an experiment examining effects of gaze on speech during three-person conversations. Understanding such effects is crucial for the design of teleconferencing systems and Collaborative Virtual Environments (CVEs). Previous findings suggest subjects take more turns when they experience more gaze. We evaluated whether this is because more gaze allowed them to better observe whether they were being addressed. We compared speaking behavior between two conditions: (1) in which subjects experienced gaze synchronized with conversational attention, and (2) in which subjects experienced random gaze. The amount of gaze experienced by subjects was a covariate. Results show subjects were 22% more likely to speak when gaze behavior was synchronized with conversational attention. However, covariance analysis showed these results were due to differences in amount of gaze rather than synchronization of gaze, with correlations of .62 between amount of gaze and amount of subject speech. Task performance was 46% higher when gaze was synchronized. We conclude it is commendable to use synchronized gaze models when designing CVEs, but depending on task situation, random models generating sufficient amounts of gaze may suffice.
- Argyle, M. and Cook, M. Gaze and Mutual Gaze. London: Cambridge University Press, 1976.Google Scholar
- Argyle, M. and Dean, J. Eye-contact, Distance and Affiliation. Sociometry 28(3), 1965, pp. 289--304.Google ScholarCross Ref
- Argyle, M. and Ingham, R. Gaze, Mutual Gaze and Proximity. Semiotica 6(1), 1972, pp. 32--49.Google ScholarCross Ref
- Bennet, G.K., Seashore, H.G., and Wesman, A.G. Manual for the Differential Aptitude Tests. New York: The Psych. Corporation, 1959.Google Scholar
- Cassell, J., Bickmore, T., et al. Embodiment in Conversational Interfaces: Rea. In Proceedings of CHI'99. Pittsburgh, PA: ACM, 1999, pp. 520--527. Google ScholarDigital Library
- Colburn, A., Cohen, M.F., and Drucker, S.M. The Role of Eye Gaze in Avatar Mediated Conversational Interfaces. Report MSR-TR-2000-81. Microsoft Research, 2000.Google Scholar
- Enheduanna. Nin-me-sàr-ra. Sumerian cuneiform tablets, Mesopotamia: +- 2500 B.C. Republished in Hallo, W.W. and van Dijk, J.J.A. (Ed.), The Exaltation of Inanna. New Haven: Yale University Press, 1968, pp. 101.Google Scholar
- Exline, R.V. Explorations in the Process of Person Perception: Visual Interaction in Relation to Competition, Sex and Need for Affiliation. Journal of Personality 31(1), 1963, pp. 1--20.Google ScholarCross Ref
- Garau, M., Slater, M., Bee, S., and Sasse, M.A. The Impact of Eye Gaze on Communication using Humanoid Avatars. In Proceedings of CHI'01. Seattle, WA: ACM, 2001, pp. 309--316. Google ScholarDigital Library
- Kalma, A. Gazing in Triads: A Powerful Signal in Floor Apportionment. British Journal of Social Psychology 31(1), 1992, pp. 21--39.Google Scholar
- Kendon, A. Some Functions of Gaze-Direction in Social Interaction. Acta Psychologica 26(1), 1967, pp. 22--63.Google ScholarCross Ref
- Nielsen, G. Studies in Self Confrontation. Copenhagen: Monksgaard, 1962.Google Scholar
- Rutter, D.R., Morley, I.E., and Graham, J.C. Visual Interaction in a Group of Introverts and Extraverts. European Journal on Social Psychology 2(4), 1972, pp. 371--184.Google ScholarCross Ref
- Vertegaal, R. The GAZE Groupware System: Mediating Joint Attention in Multiparty Communication and Collaboration. In Proceedings of CHI'99. Pittsburg, PA: ACM, 1999, pp. 294--301. Google ScholarDigital Library
- Vertegaal, R., Slagter, R., Van der Veer, G.C., and Nijholt, A. Why Conversational Agents Should Catch the Eye. In Extended Abstracts of CHI'00. The Hague, Netherlands: ACM, 2000, pp. 257--258. Google ScholarDigital Library
- Vertegaal, R., Slagter, R., Van der Veer, G.C., and Nijholt, A. Eye Gaze Patterns in Conversations: There is More to Conversational Agents Than Meets the Eyes. In Proceedings of CHI'01. Seattle, WA: ACM, 2001, pp. 301--308. Google ScholarDigital Library
- Vertegaal, R., Van der Veer, G.C., and Vons, H. Effects of Gaze on Multiparty Mediated Communication. In Proceedings of Graphics Interface 2000. Montreal, Canada: Morgan Kaufmann Publishers, 2000, pp. 95--102.Google Scholar
Index Terms
- Explaining effects of eye gaze on mediated group conversations:: amount or synchronization?
Recommendations
Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes
CHI '01: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsIn multi-agent, multi-user environments, users as well as agents should have a means of establishing who is talking to whom. In this paper, we present an experiment aimed at evaluating whether gaze directional cues of users could be used for this ...
The impact of eye gaze on communication using humanoid avatars
CHI '01: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsIn this paper we describe an experiment designed to investigate the importance of eye gaze in humanoid avatar's representing people engaged in conversation. We compare responses to dyadic conversations in four mediated conditions: video, audio-only, and ...
The Eye in Extended Reality: A Survey on Gaze Interaction and Eye Tracking in Head-worn Extended Reality
With innovations in the field of gaze and eye tracking, a new concentration of research in the area of gaze-tracked systems and user interfaces has formed in the field of Extended Reality (XR). Eye trackers are being used to explore novel forms of spatial ...
Comments