skip to main content


Title: Improved Retention Analysis in Freemium Role-Playing games by Jointly Modelling Players’ Motivation, Progression and Churn
Abstract

We consider user retention analytics for online freemium role-playing games (RPGs). RPGs constitute a very popular genre of computer-based games that, along with a player’s gaming actions, focus on the development of the player’s in-game virtual character through a persistent exploration of the gaming environment. Most RPGs follow the freemium business model in which the gamers can play for free but they are charged for premium add-on amenities. As with other freemium products, RPGs suffer from the curse of high dropout rates. This makes retention analysis extremely important for successful operation and survival of their gaming portals. Here, we develop a disciplined statistical framework for retention analysis by modelling multiple in-game player characteristics along with the dropout probabilities. We capture players’ motivations through engagement times, collaboration and achievement score at each level of the game, and jointly model them using a generalized linear mixed model (glmm) framework that further includes a time-to-event variable corresponding to churn. We capture the interdependencies in a player’s level-wise engagement, collaboration, achievement with dropout through a shared parameter model. We illustrate interesting changes in player behaviours as the gaming level progresses. The parameters in our joint model were estimated by a Hamiltonian Monte Carlo algorithm which incorporated a divide-and-recombine approach for increased scalability in glmm estimation that was needed to accommodate our large longitudinal gaming data-set. By incorporating the level-wise changes in a player’s motivations and using them for dropout rate prediction, our method greatly improves on state-of-the-art retention models. Based on data from a popular action based RPG, we demonstrate the competitive optimality of our proposed joint modelling approach by exhibiting its improved predictive performance over competitors. In particular, we outperform aggregate statistics based methods that ignore level-wise progressions as well as progression tracking non-joint model such as the Cox proportional hazards model. We also display improved predictions of popular marketing retention statistics and discuss how they can be used in managerial decision making.

 
more » « less
Award ID(s):
1811866 2015250
NSF-PAR ID:
10400112
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
Oxford University Press
Date Published:
Journal Name:
Journal of the Royal Statistical Society Series A: Statistics in Society
Volume:
185
Issue:
1
ISSN:
0964-1998
Page Range / eLocation ID:
p. 102-133
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Engineering design games model decision-making activities by incorporating human participants in an entertaining platform. This article distinguishes between design decisions at operational and strategic timescales as important features of engineering design games. Operational decisions consider static and short-term dynamic decisions to establish a player’s situation awareness and initial entertainment. Strategic decisions consider longer-term dynamic decisions subject to large uncertainties to retain player engagement. However, constraints on cognitive load limit the ability to simultaneously address both lower-level operational design decisions and higher-level strategic decisions such as collaboration or sustainability. Partial automation can be introduced to reduce cognitive load for operational decisions and focus additional effort on strategic decisions. To illustrate tradeoffs between operational and strategic decisions, this paper discusses example cases for two existing games: Orbital Federates and EcoRacer. Discussion highlights the role of automation and entertainment in engaging human participants in engineering design games and makes recommendations for design of future engineering design games. 
    more » « less
  2. In recent years, various mechanisms have been proposed to optimize players’ emotional experience. In this paper, we focus on suspense, one of the key emotions in gameplay. Most previous research on suspense management in games focused on narratives. Instead, we propose a new computational model of Suspense for Non-Narrative Gameplay (SNNG). SNNG is built around a Player Suspense Model (PSM) with three key factors: hope, fear, and uncertainty. These three factors are modeled as three sensors that can be triggered by particular game objects (e.g., NPCs) and game mechanics (e.g., health). A player’s feeling of suspense can be adjusted by altering the level of hope, fear, and uncertainty. Therefore, an SNNG-enhanced game engine could manage a player’s level of suspense by adding or removing game objects, diverting NPCs, adjusting game mechanics, and giving or withholding information. We tested our model by integrating SNNG into a Pacman game. Our preliminary experiment with nine subjects was encouraging. 
    more » « less
  3. Anagram games (i.e., word construction games in which players use letters to form words) have been researched for some 60 years. Games with individual players are the subject of over 20 published investigations. Moreover, there are many popular commercial anagram games such as Scrabble. Recently, cooperative team play of anagram games has been studied experimentally. With all of the experimental work and the popularity of such games, it is somewhat surprising that very little modeling of anagram games has been done to predict player behavior/actions in them. We devise a cooperative group anagram game and develop an agent-based modeling and simulation framework to capture player interactions of sharing letters and forming words. Our primary goals are to understand, quantitatively predict, and explain individual and aggregate group behavior, through simulations, to inform the design of a group anagram game experimental platform. 
    more » « less
  4. Abstract

    Sources that contribute to variation in mathematical achievement include both numerical knowledge and general underlying cognitive processing abilities. The current study tested the benefits of tablet‐based training games that targeted each of these areas for improving the mathematical knowledge of kindergarten‐age children. We hypothesized that playing a number‐based game targeting numerical magnitude knowledge would improve children's broader numerical skills. We also hypothesized that the benefits of playing a working memory (WM) game would transfer to children's numerical knowledge given its important underlying role in mathematics achievement. Kindergarteners from diverse backgrounds (n = 148; 52% girls;Mage = 71.87 months) were randomly assigned to either play a number‐based game, a WM game, or a control game on a tablet for 10 sessions. Structural equation modeling was used to model children's learning gains in mathematics and WM across time. Overall, our results suggest that playing the number game improved kindergarten children's numerical knowledge at the latent level, and these improvements remained stable as assessed 1 month later. However, children in the WM group did not improve their numerical knowledge compared to children in the control condition. Playing both the number game and WM game improved children's WM at the latent level. Importantly, the WM group continued to improve their WM for at least a month after playing the games. The results demonstrate that computerized games that target both domain‐specific and domain‐general skills can benefit a broad range of kindergarten‐aged children.

     
    more » « less
  5. In multiplayer games, players need to coordinate action to succeed. This paper investigates the effect of cognitive styles on performance of dyads engaged in collaborative gaming activities. 24 individuals took part in a mixed methods user-study; they were classified as field dependent (FD) or independent (FI) based on a cognitive style elicitation instrument. Three groups of teams were formed, based on the cognitive style of each team member: FD-FD, FD-FI, FI-FI. We examined performance in terms of game completion time, cognitive load, and player experience. The analysis revealed that FD-FI cognitive style had an effect on the performance and the mental load. We expect the findings to provide useful insight for practitioners and researchers on improving team collaboration in different contexts, such as learning, eSports, and disaster response. 
    more » « less