skip to main content

Attention:

The NSF Public Access Repository (NSF-PAR) system and access will be unavailable from 11:00 PM ET on Thursday, October 10 until 2:00 AM ET on Friday, October 11 due to maintenance. We apologize for the inconvenience.


Title: Improved Retention Analysis in Freemium Role-Playing games by Jointly Modelling Players’ Motivation, Progression and Churn
Abstract

We consider user retention analytics for online freemium role-playing games (RPGs). RPGs constitute a very popular genre of computer-based games that, along with a player’s gaming actions, focus on the development of the player’s in-game virtual character through a persistent exploration of the gaming environment. Most RPGs follow the freemium business model in which the gamers can play for free but they are charged for premium add-on amenities. As with other freemium products, RPGs suffer from the curse of high dropout rates. This makes retention analysis extremely important for successful operation and survival of their gaming portals. Here, we develop a disciplined statistical framework for retention analysis by modelling multiple in-game player characteristics along with the dropout probabilities. We capture players’ motivations through engagement times, collaboration and achievement score at each level of the game, and jointly model them using a generalized linear mixed model (glmm) framework that further includes a time-to-event variable corresponding to churn. We capture the interdependencies in a player’s level-wise engagement, collaboration, achievement with dropout through a shared parameter model. We illustrate interesting changes in player behaviours as the gaming level progresses. The parameters in our joint model were estimated by a Hamiltonian Monte Carlo algorithm which incorporated a divide-and-recombine approach for increased scalability in glmm estimation that was needed to accommodate our large longitudinal gaming data-set. By incorporating the level-wise changes in a player’s motivations and using them for dropout rate prediction, our method greatly improves on state-of-the-art retention models. Based on data from a popular action based RPG, we demonstrate the competitive optimality of our proposed joint modelling approach by exhibiting its improved predictive performance over competitors. In particular, we outperform aggregate statistics based methods that ignore level-wise progressions as well as progression tracking non-joint model such as the Cox proportional hazards model. We also display improved predictions of popular marketing retention statistics and discuss how they can be used in managerial decision making.

 
more » « less
Award ID(s):
1811866 2015250
NSF-PAR ID:
10400112
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
Oxford University Press
Date Published:
Journal Name:
Journal of the Royal Statistical Society Series A: Statistics in Society
Volume:
185
Issue:
1
ISSN:
0964-1998
Format(s):
Medium: X Size: p. 102-133
Size(s):
p. 102-133
Sponsoring Org:
National Science Foundation
More Like this
  1. In recent years, various mechanisms have been proposed to optimize players’ emotional experience. In this paper, we focus on suspense, one of the key emotions in gameplay. Most previous research on suspense management in games focused on narratives. Instead, we propose a new computational model of Suspense for Non-Narrative Gameplay (SNNG). SNNG is built around a Player Suspense Model (PSM) with three key factors: hope, fear, and uncertainty. These three factors are modeled as three sensors that can be triggered by particular game objects (e.g., NPCs) and game mechanics (e.g., health). A player’s feeling of suspense can be adjusted by altering the level of hope, fear, and uncertainty. Therefore, an SNNG-enhanced game engine could manage a player’s level of suspense by adding or removing game objects, diverting NPCs, adjusting game mechanics, and giving or withholding information. We tested our model by integrating SNNG into a Pacman game. Our preliminary experiment with nine subjects was encouraging. 
    more » « less
  2. Engineering design games model decision-making activities by incorporating human participants in an entertaining platform. This article distinguishes between design decisions at operational and strategic timescales as important features of engineering design games. Operational decisions consider static and short-term dynamic decisions to establish a player’s situation awareness and initial entertainment. Strategic decisions consider longer-term dynamic decisions subject to large uncertainties to retain player engagement. However, constraints on cognitive load limit the ability to simultaneously address both lower-level operational design decisions and higher-level strategic decisions such as collaboration or sustainability. Partial automation can be introduced to reduce cognitive load for operational decisions and focus additional effort on strategic decisions. To illustrate tradeoffs between operational and strategic decisions, this paper discusses example cases for two existing games: Orbital Federates and EcoRacer. Discussion highlights the role of automation and entertainment in engaging human participants in engineering design games and makes recommendations for design of future engineering design games. 
    more » « less
  3. Madkour, Abdelrahman ; Otto, Jasmine ; Ferreira, Lucas N ; Johnson-Bey, Shi (Ed.)
    Player goals in games are often framed in terms of achieving something in the game world, but this framing can fail to capture goals centered on the player’s own mental model, such as seeking the answers to questions about the game world. We use a least-commitment model of interactive narrative to characterize these knowledge goals and the problem of knowledge goal recognition. As a first attempt to solve the knowledge goal recognition problem, we adapt a classical goal recognition paradigm, but in our empirical evaluation the approach suffers from a high rate of incorrectly rejecting a synthetic player’s true goals; we discuss how handling of player goals could be made more robust in practice. 
    more » « less
  4. Osborn, Joseph C. (Ed.)
    Integrated meaningful play is the idea that player’s choices should have a long-term effect on the game. In this paper we present I-score (for integrated), a scoring function for scoring integrative game play as a function of the game’s storylines. The I-scores are in the range [0,1]. In games with I-scores close to one, player’s early choices determine the game’s ending; choices made later in the game do not change the final ending of the game. In contrast, games with I-scores close to zero, players’s choices can change the ending until the very end. Games with scores closer to 0.5 provide a more balanced player choice whereby the game’s ending still can be changed despite early decisions, but not so much that the ending could be changed at any point. 
    more » « less
  5. Participatory narratives are compelling, at least partly because of their ability to help players suspend disbelief in the fictional world in which they engage. Game makers have used the phrase “This is Not a Game” (TINAG) to capture the willingness of players to buy into such narratives in ways that promote productive roleplaying and authentic engagement. Although TINAG has permeated the academic and popular literature on gaming and immersive narratives for decades, there has not been a scientific grounding for the term that provides researchers support for a more rigorous study of the topic. This article makes two primary contributions. First, it provides a definition of the Perception of TINAG based on a systematic literature review of 50 articles that define or describe critical characteristics of TINAG: The Perception of TINAG is a player’s acceptance that they are embedded in and able to influence a fictional story woven into the real world. Second, the paper develops and validates a survey instrument that researchers can use to measure the Perception of TINAG and its three unique components: (1) the player accepts that they are embedded in a fictional story, (2) the player believes their actions influence the narrative, and (3) the player perceives that the story is woven into the real world. We evaluated the instrument using exploratory factor analysis using expert reviewers and game players. We include a table of the articles describing TINAG and our final scale to facilitate future research. 
    more » « less