Methods Beyond the Screen: Conducting remote player studies for game design research

In this paper we present a qualitative research methodology for conducting scholarly remote player studies, derived from a comparison of player-testing protocols. Within the game design research field, approaches to studying designs are frequently adapted from standardized player-testing techniques. These often focus on measuring player experience so a design may be evaluated. While such methods provide a useful basis for conducting iterative design studies, these present limitations for researchers seeking to interrogate design approaches outside of conventional assessment models or gameplay paradigms. We discuss these issues through a methodological lens, in the study of WORLD4, a game designed for experiences of ambiguity. Through a two-stage player experience case study we reveal methodological considerations, insights, and highlight disciplinary questions. In doing so we present a contextually aware, time and resource conscious method for conducting remote player studies, useful for game design researchers working outside of labs or investigating alternate design spaces.