This content will become publicly available on August 1, 2027

Title: ChronoLLM: customizing language models for physics-based simulation code generation
Abstract This contribution is concerned with the following issue: can pretrained large language models (LLMs) be refined and customized to the point where they become virtual assistants helping users with the effective use of a simulation tool? In this case study, the “simulation tool” considered is PyChrono, an open source multi-physics dynamics engine for multibody systems. We present a framework for refining and customizing both open- and closed-source LLMs to harness the power of AI in generating scripts that perform PyChrono virtual experiments. We refine and customize several classes of LLMs through a process that leads to a quantifiable improvement in the quality of the generated PyChrono simulation scripts. These scripts can range from simple single-pendulum simulations to complex virtual experiments involving full vehicles on deformable terrain. While the generated scripts are rarely perfect, they often serve as strong starting points for the user to modify and improve on. Additionally, the LLM can answer specific API questions about the simulator, or recommend modeling approaches. The framework discussed is general and can be applied to lower the entry barrier for simulation tools associated with other application domains.  more » « less
Award ID(s):
2153855
PAR ID:
10710867
Author(s) / Creator(s):
; ; ; ; ; ; ;
Publisher / Repository:
Springer
Date Published:
Journal Name:
Multibody System Dynamics
Volume:
67
Issue:
4
ISSN:
1384-5640
Page Range / eLocation ID:
895 to 939
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract The soil contact model (SCM) is widely used in practice for off‐road wheeled vehicle mobility studies when simulation speed is important and highly accurate results are not a main concern. In practice, the SCM parameters are obtained via a bevameter test, which requires a complex apparatus and experimental procedure. Here, we advance the idea of running a virtual bevameter test using a high‐fidelity terramechanics simulation. The latter employs the “continuous representation model” (CRM), which regards the deformable terrain as an elasto‐plastic continuum that is spatially discretized using the smoothed particle hydrodynamics method. The approach embraced is as follows: a virtual bevameter test is run in simulation using CRM terrain to generate “ground truth” data; in a Bayesian framework, this data is subsequently used to calibrate the SCM terrain. We show that (i) the resulting SCM terrain, while leading to fast terramechanics simulations, serves as a good proxy for the more complex CRM terrain; and (ii) the SCM‐over‐CRM simulation speedup is roughly one order of magnitude. These conclusions are reached in conjunction with two tests: a single wheel test, and a full rover simulation. The SCM and CRM simulations are run in the open‐source software Chrono. The calibration is performed using PyMC, which is a Python package that interactively communicates with Chrono to calibrate SCM. The models and scripts used in this contribution are available as open source for unfettered use and distribution in a public repository. 
    more » « less
  2. Automating hardware design could obviate a signif-icant amount of human error from the engineering process and lead to fewer errors. Verilog is a popular hardware description language to model and design digital systems, thus generating Verilog code is a critical first step. Emerging large language models (LLMs) are able to write high-quality code in other programming languages. In this paper, we characterize the ability of LLMs to generate useful Verilog. For this, we fine-tune pre-trained LLMs on Verilog datasets collected from GitHub and Verilog textbooks. We construct an evaluation framework comprising test-benches for functional analysis and a flow to test the syntax of Verilog code generated in response to problems of varying difficulty. Our findings show that across our problem scenarios, the fine-tuning results in LLMs more capable of producing syntactically correct code (25.9% overall). Further, when analyzing functional correctness, a fine-tuned open-source CodeGen LLM can outperform the state-of-the-art commercial Codex LLM (6.5% overall). We release our training/evaluation scripts and LLM checkpoints as open source contributions. 
    more » « less
  3. null (Ed.)
    Abstract Computer simulation can be a useful tool when designing robots expected to operate independently in unstructured environments. In this context, one needs to simulate the dynamics of the robot’s mechanical system, the environment in which the robot operates, and the sensors which facilitate the robot’s perception of the environment. Herein, we focus on the sensing simulation task by presenting a virtual sensing framework built alongside an open-source, multi-physics simulation platform called Chrono. This framework supports camera, lidar, GPS, and IMU simulation. We discuss their modeling as well as the noise and distortion implemented to increase the realism of the synthetic sensor data. We close with two examples that show the sensing simulation framework at work: one pertains to a reduced scale autonomous vehicle and the second is related to a vehicle driven in a digital replica of a Madison neighborhood. 
    more » « less
  4. Social biases embedded in Large Language Models (LLMs) raise critical concerns, resulting in representational harms -- unfair or distorted portrayals of demographic groups -- that may be expressed in subtle ways through generated language. Existing evaluation methods often depend on predefined identity-concept associations, limiting their ability to surface new or unexpected forms of bias. In this work, we present the Bias Association Discovery Framework (BADF), a systematic approach for extracting both known and previously unrecognized associations between demographic identities and descriptive concepts from open-ended LLM outputs. Through comprehensive experiments spanning multiple models and diverse real-world contexts, BADF enables robust mapping and analysis of the varied concepts that characterize demographic identities. Our findings advance the understanding of biases in open-ended generation and provide a scalable tool for identifying and analyzing bias associations in LLMs. 
    more » « less
  5. ABSTRACT PurposeImage quality and resolution in MRI are fundamentally constrained by the performance of radiofrequency (RF) coils used to excite the spins and receive the signal. Electromagnetic (EM) simulations are essential for optimizing coil performance. Existing tools are often slow, memory‐intensive, and require expensive licenses. To address these limitations, we introduce a novel, comprehensive, open‐source EM simulation tool for RF coil design in MRI. Theory and MethodsOur toolbox consists of four complementary software components: (1) a full‐wave 3D EM solver based on the wire‐surface‐volume integral equation (WSVIE), where tensor decompositions reduce memory usage and accelerate simulations for fine body model resolutions; (2) a reduced‐order model technique enabling patient‐specific coil simulations in minutes; (3) a fully automatic circuit co‐simulator for coil tuning, matching, decoupling, preamplifier decoupling, and detuning; and (4) a numerical EM basis generator that can be used to compute ultimate performance metrics. We demonstrated the toolbox with a series of simulations for different applications at 7 T MRI. ResultsOur proposed reduced‐order model WSVIE solver was 70 times faster compared to a commercial solver for the simulation of a 31‐channel 7 T head coil. Our co‐simulator tuned, matched, and decoupled the array in 30 min, compared to a few days time of manual interactions needed with the commercial package. The average difference between the signal‐to‐noise ratio maps was less than 15%. ConclusionThe proposed open‐source simulation framework enables fast, memory‐friendly, accurate, and anatomy‐specific RF coil array design, making it a powerful tool for RF coil engineering. 
    more » « less