skip to main content


Title: Scoring Integrated Meaningful Play in Story-Driven Games with Q-Learning
Integrated meaningful play is the idea that player’s choices should have a long-term effect on the game. In this paper we present I-score (for integrated), a scoring function for scoring integrative game play as a function of the game’s storylines. The I-scores are in the range [0,1]. In games with I-scores close to one, player’s early choices determine the game’s ending; choices made later in the game do not change the final ending of the game. In contrast, games with I-scores close to zero, players’s choices can change the ending until the very end. Games with scores closer to 0.5 provide a more balanced player choice whereby the game’s ending still can be changed despite early decisions, but not so much that the ending could be changed at any point.  more » « less
Award ID(s):
1757787
NSF-PAR ID:
10232375
Author(s) / Creator(s):
; ;
Editor(s):
Osborn, Joseph C.
Date Published:
Journal Name:
CEUR workshop proceedings
Volume:
2862
ISSN:
1613-0073
Page Range / eLocation ID:
paper22
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. In 1995, Jesyca Durchin accepted a job as a producer at Mattel Media under Nancie Martin. The then-fledgling game and software studio had fewer than a dozen employees and existed at a distance from Mattel’s more central toy business Barbie Fashion Designer (Mattel Media, 1996) was Durchin’s first major project and is widely credited with catalyzing the girls’ game and software market in the mid-1990s. However, as Durchin discusses throughout this interview, the game’s success was not as immediate or automatic as might be assumed. In the first weekend of its release, Barbie Fashion Designer sold only eleven copies; Mattel CEO Jill Barad’s enthusiasm for the project and willingness to invest in a television commercial salvaged the situation. Most companies attempting to create the games-for-girls market lacked the resources of toy giant Mattel, of course, and the reality that even Mattel nearly failed to break through speaks volumes about the level of inertia that defined the mid-1990s computer and video game market. Over the past two decades, Durchin has worked extensively with Disney Imagineering; founded and sold her own startup, Digital Playspace; and today works as a senior producer at Warner Bros., where she is producing the company’s first AAA game featuring Wonder Woman. Her interests in storytelling, multimedia interface design, and play patterns have driven her professional trajectory and serve as useful examples of her audience-focused approach to media production. She summarizes her creative and design ethos as one of wish fulfillment, enabling players and audience members to experience the magic of making things better than they found them and using technology for creative ends. In this interview, Durchin reflects on her career, offering insights from her experiences creating games that girls love. She shares stories of early production discoveries that led to pivotal games like Barbie Fashion Designer, and she discusses the difficulties the field faced in trying to forge a more inclusive industry. Taken together, Durchin’s insights shed light on an important and often overlooked chapter of games history. 
    more » « less
  2. Abstract

    We consider user retention analytics for online freemium role-playing games (RPGs). RPGs constitute a very popular genre of computer-based games that, along with a player’s gaming actions, focus on the development of the player’s in-game virtual character through a persistent exploration of the gaming environment. Most RPGs follow the freemium business model in which the gamers can play for free but they are charged for premium add-on amenities. As with other freemium products, RPGs suffer from the curse of high dropout rates. This makes retention analysis extremely important for successful operation and survival of their gaming portals. Here, we develop a disciplined statistical framework for retention analysis by modelling multiple in-game player characteristics along with the dropout probabilities. We capture players’ motivations through engagement times, collaboration and achievement score at each level of the game, and jointly model them using a generalized linear mixed model (glmm) framework that further includes a time-to-event variable corresponding to churn. We capture the interdependencies in a player’s level-wise engagement, collaboration, achievement with dropout through a shared parameter model. We illustrate interesting changes in player behaviours as the gaming level progresses. The parameters in our joint model were estimated by a Hamiltonian Monte Carlo algorithm which incorporated a divide-and-recombine approach for increased scalability in glmm estimation that was needed to accommodate our large longitudinal gaming data-set. By incorporating the level-wise changes in a player’s motivations and using them for dropout rate prediction, our method greatly improves on state-of-the-art retention models. Based on data from a popular action based RPG, we demonstrate the competitive optimality of our proposed joint modelling approach by exhibiting its improved predictive performance over competitors. In particular, we outperform aggregate statistics based methods that ignore level-wise progressions as well as progression tracking non-joint model such as the Cox proportional hazards model. We also display improved predictions of popular marketing retention statistics and discuss how they can be used in managerial decision making.

     
    more » « less
  3. null (Ed.)
    Abstract We introduce a new model of repeated games in large populations with random matching, overlapping generations, and limited records of past play. We prove that steady-state equilibria exist under general conditions on records. When the updating of a player’s record can depend on the actions of both players in a match, any strictly individually rational action can be supported in a steady-state equilibrium. When record updates can depend only on a player’s own actions, fewer actions can be supported. Here, we focus on the prisoner’s dilemma and restrict attention to strict equilibria that are coordination-proof, meaning that matched partners never play a Pareto-dominated Nash equilibrium in the one-shot game induced by their records and expected continuation payoffs. Such equilibria can support full cooperation if the stage game is either “strictly supermodular and mild” or “strongly supermodular,” and otherwise permit no cooperation at all. The presence of “supercooperator” records, where a player cooperates against any opponent, is crucial for supporting any cooperation when the stage game is “severe.” 
    more » « less
  4. Strategic interactions between a group of individuals or organisations can be modelled as games played on networks, where a player’s payoff depends not only on their actions but also on those of their neighbours. Inferring the network structure from observed game outcomes (equilibrium actions) is an important problem with numerous potential applications in economics and social sciences. Existing methods mostly require the knowledge of the utility function associated with the game, which is often unrealistic to obtain in real-world scenarios. We adopt a transformer-like architecture which correctly accounts for the symmetries of the problem and learns a mapping from the equilibrium actions to the network structure of the game without explicit knowledge of the utility function. We test our method on three different types of network games using both synthetic and real-world data, and demonstrate its effectiveness in network structure inference and superior performance over existing methods. 
    more » « less
  5. Detection and responding to a player’s affect are important for serious games. A method for this purpose was tested within Chem-o-crypt, a game that teaches chemical equation balancing. The game automatically detects boredom, flow, and frustration using the Affdex SDK from Affectiva. The sensed affective state is then used to adapt the game play in an attempt to engage the player in the game. A randomized controlled experiment incorporating a Dynamic Bayesian Network that compared results from groups with the affect-sensitive states vs those without revealed that measuring affect and adapting the game improved learning for low domain-knowledge participants. 
    more » « less