Attention:The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Thursday, November 12th until 12:00 AM ET on Friday, November 13th due to maintenance. We apologize for the inconvenience.


Search for: All records

Creators/Authors contains: "Tucker, Conrad"

Note: When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).
What is a DOI Number?

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

  1. Free, publicly-accessible full text available August 23, 2027
  2. Abstract Generative AI is reshaping manufacturing by generating designs, diagnosing bottlenecks, and optimizing complex systems, which includes controlling manufacturing lines. Efficient control of manufacturing lines requires coordinated decisions in routing, worker allocation, and scheduling. Although model-based approaches can yield optimal or near-optimal plans, they struggle to scale more complex systems. With advances in discrete-event simulation and AI-driven decision-making, generative decision models, such as reinforcement learning (RL), have emerged as alternatives for optimizing manufacturing systems. We show that a crucial design choice is the policy control interval. Because parts take time to propagate through stations and buffers in manufacturing systems, choosing this interval without analysis can result in suboptimal behavior and lower throughput. We introduce a layout-aware method for selecting the control interval in policy training. From the line layout, we estimate the distribution of end-to-end unit transit times and derive a control interval based on the distribution. Our results demonstrate that policy performance versus control interval is nonmonotonic with an interior optimum. Aligning the control interval with the dynamics of the manufacturing process yields gains up to 2.7× improvement in return and increased training stability relative to one-tick baselines, without modifying environments or algorithms. These results indicate that the control interval is a crucial factor the agent learning process. By aligning the control interval of policies with the way material flows, our method provides a plug-and-play procedure for a more robust RL in manufacturing control.. 
    more » « less
    Free, publicly-accessible full text available July 1, 2027
  3. Free, publicly-accessible full text available June 21, 2027
  4. Free, publicly-accessible full text available June 21, 2027
  5. null (Ed.)
    Artificial Intelligence (AI) techniques such as Generative Neural Networks (GNNs) have resulted in remarkable breakthroughs such as the generation of hyper-realistic images, 3D geometries, and textual data. This work investigates the ability of STEM learners and educators to decipher AI generated video in order to safeguard the public-availability of high-quality online STEM learning content. The COVID-19 pandemic has increased STEM learners’ reliance on online learning content. Consequently, safeguarding the veracity of STEM learning content is critical to ensuring the safety and trust that both STEM educators and learners have in publicly-available STEM learning content. In this study, state of the art AI algorithms are trained on a specific STEM context (e.g., climate change) using publicly-available data. STEM learners are then presented with AI-generated STEM learning content and asked to determine whether the AI-generated output is visually convincing (i.e., “looks real”) and whether the context being presented is plausible. Knowledge gained from this study will help enhance society’s understanding of AI algorithms, their ability to generate convincing video output, and the threat that those generated output have in potentially deceiving STEM learners who may be exposed to them during online learning activities. 
    more » « less
  6. In this work, a Deep Reinforcement Learning (RL) approach is proposed for Procedural Content Generation (PCG) that seeks to automate the generation of multiple related virtual reality (VR) environments for enhanced personalized learning. This allows for the user to be exposed to multiple virtual scenarios that demonstrate a consistent theme, which is especially valuable in an educational context. RL approaches to PCG offer the advantage of not requiring training data, as opposed to other PCG approaches that employ supervised learning approaches. This work advances the state of the art in RL-based PCG by demonstrating the ability to generate a diversity of contexts in order to teach the same underlying concept. A case study is presented that demonstrates the feasibility of the proposed RL-based PCG method using examples of probability distributions in both manufacturing facility and grocery store virtual environments. The method demonstrated in this paper has the potential to enable the automatic generation of a variety of virtual environments that are connected by a common concept or theme. 
    more » « less
  7. Abstract This work presents a deep reinforcement learning (DRL) approach for procedural content generation (PCG) to automatically generate three-dimensional (3D) virtual environments that users can interact with. The primary objective of PCG methods is to algorithmically generate new content in order to improve user experience. Researchers have started exploring the use of machine learning (ML) methods to generate content. However, these approaches frequently implement supervised ML algorithms that require initial datasets to train their generative models. In contrast, RL algorithms do not require training data to be collected a priori since they take advantage of simulation to train their models. Considering the advantages of RL algorithms, this work presents a method that generates new 3D virtual environments by training an RL agent using a 3D simulation platform. This work extends the authors’ previous work and presents the results of a case study that supports the capability of the proposed method to generate new 3D virtual environments. The ability to automatically generate new content has the potential to maintain users’ engagement in a wide variety of applications such as virtual reality applications for education and training, and engineering conceptual design. 
    more » « less