skip to main content

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Thursday, January 16 until 2:00 AM ET on Friday, January 17 due to maintenance. We apologize for the inconvenience.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Automatic generation of interactive NPC scripts for a mixed-reality integrated learning environment
The Mixed-Reality Integrated Learning Environment (MILE) developed at Florida State University is a virtual reality based, inclusive and immersive e-learning environment that promotes engaging and effective learning interactions for a diversified learner population. MILE uses a large number of interactive Non-Player Characters (NPCs) to represent diverse research-based learner archetypes and groups, and to prompt and provide feedback for in situ teaching practice. The NPC scripts in MILE are written in Linden Scripting Language (LSL), and can be quite complex, creating a significant challenge in the development and maintenance of the system. To address this challenge, we develop NPC_GEN, an automatic NPC script generation tool that takes high-level NPC descriptions as input and automatically produces LSL scripts for NPCs. In this work, we introduce NPCDL, a language that we design for NPC_GEN to give high-level descriptions of NPCs, describe how NPC_GEN translates an NPCDL description into an LSL script, and report a user study of NPC_GEN. The results of our user study indicate that with minimal training, non-technical people are able to write and modify NPCDL descriptions, which can then be used to generate LSL scripts for the NPCs: the development and maintenance of NPCs is greatly simplified with NPC_GEN.  more » « less
Award ID(s):
1632965
PAR ID:
10097029
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
the International Conference Proceedings Series by ACM, 2018 10th International Conference on Education Technology and Computers (ICETC 2018) Proceedings Series by ACM (ISBN: 978-1-4503-6517-8)
Page Range / eLocation ID:
74-79
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; ; ; ; et al ( , Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies)
    null (Ed.)
    This paper presents a holistic system to scale up the teaching and learning of vocabulary words of American Sign Language (ASL). The system leverages the most recent mixed-reality technology to allow the user to perceive her own hands in an immersive learning environment with first- and third-person views for motion demonstration and practice. Precise motion sensing is used to record and evaluate motion, providing real-time feedback tailored to the specific learner. As part of this evaluation, learner motions are matched to features derived from the Hamburg Notation System (HNS) developed by sign-language linguists. We develop a prototype to evaluate the efficacy of mixed-reality-based interactive motion teaching. Results with 60 participants show a statistically significant improvement in learning ASL signs when using our system, in comparison to traditional desktop-based, non-interactive learning. We expect this approach to ultimately allow teaching and guided practice of thousands of signs. 
    more » « less
  2. ; ; ; ( , Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment)

    Creating engaging interactive story-based experiences dynamically responding to individual player choices poses significant challenges for narrative-centered games. Recent advances in pre-trained large language models (LLMs) have the potential to revolutionize procedural content generation for narrative-centered games. Historically, interactive narrative generation has specified pivotal events in the storyline, often utilizing planning-based approaches toward achieving narrative coherence and maintaining the story arc. However, manual authorship is typically used to create detail and variety in non-player character (NPC) interaction to specify and instantiate plot events. This paper proposes SCENECRAFT, a narrative scene generation framework that automates NPC interaction crucial to unfolding plot events. SCENECRAFT interprets natural language instructions about scene objectives, NPC traits, location, and narrative variations. It then employs large language models to generate game scenes aligned with authorial intent. It generates branching conversation paths that adapt to player choices while adhering to the author’s interaction goals. LLMs generate interaction scripts, semantically extract character emotions and gestures to align with the script, and convert dialogues into a game scripting language. The generated script can then be played utilizing an existing narrative-centered game framework. Through empirical evaluation using automated and human assessments, we demonstrate SCENECRAFT’s effectiveness in creating narrative experiences based on creativity, adaptability, and alignment with intended author instructions.

     
    more » « less
  3. ; ; ; ; ( , Advanced Science)
    Abstract

    Neural progenitor cells (NPCs) are a promising cell source to repair damaged nervous tissue. However, expansion of therapeutically relevant numbers of NPCs and their efficient differentiation into desired mature cell types remains a challenge. Material‐based strategies, including culture within 3D hydrogels, have the potential to overcome these current limitations. An ideal material would enable both NPC expansion and subsequent differentiation within a single platform. It has recently been demonstrated that cell‐mediated remodeling of 3D hydrogels is necessary to maintain the stem cell phenotype of NPCs during expansion, but the role of matrix remodeling on NPC differentiation and maturation remains unknown. By culturing NPCs within engineered protein hydrogels susceptible to degradation by NPC‐secreted proteases, it is identified that a critical amount of remodeling is necessary to enable NPC differentiation, even in highly degradable gels. Chemical induction of differentiation after sufficient remodeling time results in differentiation into astrocytes and neurotransmitter‐responsive neurons. Matrix remodeling modulates expression of the transcriptional co‐activator Yes‐associated protein, which drives expression of NPC stemness factors and maintains NPC differentiation capacity, in a cadherin‐dependent manner. Thus, cell‐remodelable hydrogels are an attractive platform to enable expansion of NPCs followed by differentiation of the cells into mature phenotypes for therapeutic use.

     
    more » « less
  4. ; ; ; ; ; ; ; ( , 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC'18))
    A key challenge for generalizing programming-by-demonstration (PBD) scripts is the data description problem - when a user demonstrates performing an action, the system needs to determine features for describing this action and the target object in a way that can reflect the user's intention for the action. However, prior approaches for creating data descriptions in PBD systems have problems with usability, applicability, feasibility, transparency and/or user control. Our APPINITE system introduces a multimodal interface with which users can specify data descriptions verbally using natural language instructions. APPINITE guides users to describe their intentions for the demonstrated actions through mixed-initiative conversations. APPINITE constructs data descriptions for these actions from the natural language instructions. Our evaluation showed that APPINITE is easy-to-use and effective in creating scripts for tasks that would otherwise be difficult to create with prior PBD systems, due to ambiguous data descriptions in demonstrations on GUIs. 
    more » « less
  5. ; ; ; ( , Advanced Healthcare Materials)
    Abstract

    Neural progenitor cells (NPCs) are promising therapeutic candidates for nervous system regeneration. Significant efforts focus on developing hydrogel‐based approaches to facilitate the clinical translation of NPCs, from scalable platforms for stem cell production to injectable carriers for cell transplantation. However, fundamental questions surrounding NPC‐hydrogel interactions remain unanswered. While matrix degradability is known to regulate the stemness and differentiation capacity of NPCs, how degradability impacts NPC epigenetic regulation and secretory phenotype remains unknown. To address this question, NPCs encapsulated in recombinant protein hydrogels with tunable degradability are assayed for changes in chromatin organization and neurotrophin expression. In high degradability gels, NPCs maintain expression of stem cell factors, proliferate, and have large nuclei with elevated levels of the stemness‐associated activating histone mark H3K4me3. In contrast, NPCs in low degradability gels exhibit more compact, rounded nuclei with peripherally localized heterochromatin, are non‐proliferative yet non‐senescent, and maintain expression of neurotrophic factors with potential therapeutic relevance. This work suggests that tuning matrix degradability may be useful to direct NPCs toward either a more‐proliferative, stem‐like phenotype for cell replacement therapies, or a more quiescent‐like, pro‐secretory phenotype for soluble factor‐mediated therapies.

     
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email