Pejman Mirza-Babaei
Lennart E. Nacke
John Gregory
ABSTRACT
Improving game design is a hard task. Few methods are available in games user research (GUR) to test formally how game designs work for players. In particular, the usefulness of user tests (UTs) for game designers has not been fully studied in the CHI community. We propose a novel GUR method called Biometric Storyboards (BioSt) and present a study demonstrating how a Classic UT and a BioSt UT both help designers create a better gameplay experience. In addition, we show that BioSt can help designers deliver significantly better visuals, more fun, and higher gameplay quality than designing without UTs and that classic UTs do not provide this significant advantage. Our interviews support the idea that BioSt provides more nuanced game design improvement. The design implication is that a game designed with the BioSt method will result in high gameplay quality.
Supplemental Material
- Ambinder, M. Biofeedback in Gameplay: How Valve Measures Physiology to Enhance Gaming Experience. Presentation at GDC 2011, (2011).Google Scholar
- Bernhaupt, R., ed. Evaluating User Experience in Games. Springer, Berlin, 2010. Google ScholarDigital Library
- Bradley, M. M. and Lang, P. J. Measuring emotion: The self-assessment manikin and the semantic differential. J Behav Ther Exp Psy 25, 1 (1994), pp. 49--59.Google ScholarCross Ref
- Brooke, J. SUS-A quick and dirty usability scale. Usability evaluation in industry, 1996.Google Scholar
- Cacioppo, J. T., Tassinary, L. G., and Berntson, G., eds. Handbook of Psychophysiology. Cambridge University Press, 2007.Google ScholarCross Ref
- Church, D. Formal abstract design tools. Game Developer Magazine, August (1999).Google Scholar
- Drachen, A., Nacke, L. E., Yannakakis, G., and Pedersen, A. L. Correlation between heart rate, electrodermal activity and player experience in first-person shooter games. SIGGRAPH Sandbox (2010), pp. 49--54. Google ScholarDigital Library
- Fairclough, S. H. Fundamentals of physiological computing. Interact Comput 21, 1--2 (2009), 133--145. Google ScholarDigital Library
- Hazlett, R. Using Biometric Measurement to Help Develop Emotionally Compelling Games. In K. Isbister and N. Schaffer, eds., Game Usability. Morgan Kaufmann, Burlington, MA, 2008.Google Scholar
- Isbister, K. and Schaffer, N. Game Usability. Morgan Kaufmann, Burlington, MA, 2008.Google ScholarCross Ref
- Kivikangas, J. M., Chanel, G., Cowley, B., et al. A review of the use of psychophysiological methods in game research. JGVW 3, 3 (2011), 181--199.Google ScholarCross Ref
- Law, E. L.-C. The measurability and predictability of user experience. Proc. of EICS'11 (2011), pp. 1--10. Google ScholarDigital Library
- Malone, T. Toward a theory of intrinsically motivating instruction. Cognitive Science 5, 4 (1981), 333--369.Google ScholarCross Ref
- Mandryk, R. L. and Atkins, M. S. A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. Int J Hum-Comput St, (2007), 329--347. Google ScholarDigital Library
- Medler, B., John, M., and Lane, J. Data cracker: developing a visual game analytic tool for analyzing online gameplay. Proc. of CHI'11 (2011), 2365--2374. Google ScholarDigital Library
- Medlock, M. C., Wixon, D., and Terrano, M. Using the RITE method to improve products: A definition and a case study. Proc. of UPA'02, 2002.Google Scholar
- Mirza-Babaei, P., Long, S., Foley, E., and McAllister, G. Understanding the Contribution of Biometrics to Games User Research. Proc. of DiGRA 2011, (2011).Google Scholar
- Mirza-Babaei, P., Nacke, L. E., Fitzpatrick, G., et al. Biometric storyboards: visualising game user research data. Proc. of CHI EA'12 (2012), pp. 2315--2320. Google ScholarDigital Library
- Nacke, L. E. and Lindley, C. Affective Ludology, Flow and Immersion in a First-Person Shooter: Measurement of Player Experience. Loading 3, 5 (2009).Google Scholar
- Pagulayan, R. J., Keeker, K., Wixon, D., and Romero, R. L. User-centered design in games. The Human-Computer Interaction Handbook, 2003, pp. 883--906. Google ScholarDigital Library
- Ravaja, N. Contributions of Psychophysiology to Media Research: Review and Recommendations. Media Psychology 6, 2 (2004), pp. 193--235.Google ScholarCross Ref
- Ravaja, N., Turpeinen, M., Saari, T., Puttonen, S., and Keltikangas-Järvinen, L. The psychophysiology of James Bond: Phasic emotional responses to violent video game events. Emotion 8, 1 (2008), pp. 114--120.Google ScholarCross Ref
- Sweetser, P. and Wyeth, P. GameFlow: a model for evaluating player enjoyment in games. CiE 3, 3 (2005). Google ScholarDigital Library
- Wallner, G. and Kriglstein, S. A spatiotemporal visualization approach for the analysis of gameplay data. Proc. of CHI'12 (2012), pp. 1115--1124. Google ScholarDigital Library
- Watson, D., Clark, L.A., and Tellegen, A. Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology 54, 6 (1988), pp. 1063--1070.Google ScholarCross Ref
- Zammitto, V. The Science of Play Testing: EA's Methods for User Research. Presentation at GDC 2011.Google Scholar
Index Terms
- How does it play better?: exploring user testing and biometric storyboards in games user research
Recommendations
Comparing Game User Research Methodologies for the Improvement of Level Design in a 2-D Platformer
ACE 2013: Proceedings of the 10th International Conference on Advances in Computer Entertainment - Volume 8253In this paper we compare the effects of using three game user research methodologies to assist in shaping levels for a 2-D platformer game, and illustrate how the use of such methodologies can help level designers to make more informed decisions in an ...
Understanding expectations with multiple controllers in an augmented reality videogame
CHI PLAY '14: Proceedings of the first ACM SIGCHI annual symposium on Computer-human interaction in playPlayer experiences and expectations are connected. The presumptions players have about how they control their gameplay interactions may shape the way they play and perceive videogames. A successfully engaging player experience might rest on the way ...
Games User Research Methods
CHI PLAY '18 Extended Abstracts: Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended AbstractsThis hybrid course will allow participants to understand the complexities of games user research methods. For this we have put together 4 sessions (2 hours each, 8 hours total) of content on applications on different user research methods in games ...
Comments