An official website of the United States government
Abstract Physically based simulation is often combined with geometric mesh animation to add realistic soft‐body dynamics to virtual characters. This is commonly done using constraint‐based simulation whereby a soft‐tissue simulation is constrained to geometric animation of a subpart (or otherwise proxy representation) of the character. We observe that standard constraint‐based simulation suffers from an important flaw that limits the expressiveness of soft‐body dynamics. Namely, under correct physics, the frequency and amplitude of soft‐tissue dynamics arising from constraints (“inertial amplitude”) are coupled, and cannot be adjusted independently merely by adjusting the material properties of the model. This means that the space of physically based simulations is inherently limited and cannot capture all effects typically expected by computer animators. For example, animators need the ability to adjust the frequency, inertial amplitude, gravity sag and damping properties of the virtual character, independently from each other, as these are the primary visual characteristics of the soft‐tissue dynamics. We demonstrate that independence can be achieved by transforming the equations of motion into a non‐inertial reference coordinate frame, then scaling the resulting inertial forces, and then converting the equations of motion back to the inertial frame. Such scaling of inertia makes it possible for the animator to set the character's inertial amplitude independently from frequency. We also provide exact controls for the amount of character's gravity sag, and the damping properties. In our examples, we use linear blend skinning and pose‐space deformation for geometric mesh animation, and the Finite Element Method for soft‐body constrained simulation; but our idea of scaling inertial forces is general and applicable to other animation and simulation methods. We demonstrate our technique on several character examples.
more »
« less
Simulation of Hand Anatomy Using Medical Imaging
Precision modeling of the hand internal musculoskeletal anatomy has been largely limited to individual poses, and has not been connected into continuous volumetric motion of the hand anatomy actuating across the hand's entire range of motion. This is for a good reason, as hand anatomy and its motion are extremely complex and cannot be predicted merely from the anatomy in a single pose. We give a method to simulate the volumetric shape of hand's musculoskeletal organs to any pose in the hand's range of motion, producing external hand shapes and internal organ shapes that match ground truth optical scans and medical images (MRI) in multiple scanned poses. We achieve this by combining MRI images in multiple hand poses with FEM multibody nonlinear elastoplastic simulation. Our system models bones, muscles, tendons, joint ligaments and fat as separate volumetric organs that mechanically interact through contact and attachments, and whose shape matches medical images (MRI) in the MRI-scanned hand poses. The match to MRI is achieved by incorporating pose-space deformation and plastic strains into the simulation. We show how to do this in a non-intrusive manner that still retains all the simulation benefits, namely the ability to prescribe realistic material properties, generalize to arbitrary poses, preserve volume and obey contacts and attachments. We use our method to produce volumetric renders of the internal anatomy of the human hand in motion, and to compute and render highly realistic hand surface shapes. We evaluate our method by comparing it to optical scans, and demonstrate that we qualitatively and quantitatively substantially decrease the error compared to previous work. We test our method on five complex hand sequences, generated either using keyframe animation or performance animation using modern hand tracking techniques.
more »
« less
- Award ID(s):
- 1911224
- PAR ID:
- 10436969
- Date Published:
- Journal Name:
- ACM Transactions on Graphics
- Volume:
- 41
- Issue:
- 6
- ISSN:
- 0730-0301
- Page Range / eLocation ID:
- 1 to 20
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Objectives:Magnetic resonance imaging (MRI) using 1.5T or 3.0T systems is routinely employed for assessing wrist pathology; however, due to off-resonance artifacts and high power deposition, these high-field systems have drawbacks for real-time (RT) imaging of the moving wrist. Recently, high-performance 0.55T MRI systems have become available. In this proof-of-concept study, we tested the hypothesis that RT-MRI during continuous, active, and uninterrupted wrist motion is feasible with a high-performance 0.55T system at temporal resolutions below 100 ms and that the resulting images provide visualization of tissues commonly interrogated for assessing dynamic wrist instability. Methods:Participants were scanned during uninterrupted wrist radial-ulnar deviation and clenched fist maneuvers. Resulting images (nominal temporal resolution of 12.7–164.6 ms per image) were assessed for image quality. Feasibility of static MRI to supplement RT-MRI acquisition was also tested. Results:The RT images with temporal resolutions < 100 ms demonstrated low distortion and image artifacts, and higher reader assessment scores. Static MRI scans showed the ability to assess anatomical structures of interest in the wrist. Conclusion:RT-MRI of the wrist at a high temporal resolution, coupled with static MRI, is feasible with a high-performance 0.55T system, and may enable improved assessment of wrist dynamic dysfunction and instability. Advances in knowledge:Real-time MRI of the moving wrist is feasible with high-performance 0.55T and may improve the evaluation of dynamic dysfunction of the wrist.more » « less
-
Abstract PurposeThe aim of this work is to develop a method to solve the ill‐posed inverse problem of accelerated image reconstruction while correcting forward model imperfections in the context of subject motion during MRI examinations. MethodsThe proposed solution uses a Bayesian framework based on deep generative diffusion models to jointly estimate a motion‐free image and rigid motion estimates from subsampled and motion‐corrupt two‐dimensional (2D) k‐space data. ResultsWe demonstrate the ability to reconstruct motion‐free images from accelerated two‐dimensional (2D) Cartesian and non‐Cartesian scans without any external reference signal. We show that our method improves over existing correction techniques on both simulated and prospectively accelerated data. ConclusionWe propose a flexible framework for retrospective motion correction of accelerated MRI based on deep generative diffusion models, with potential application to other forward model corruptions.more » « less
-
Abstract Volumetric data provide unprecedented structural insight to the reproductive tract and add vital anatomical context to the relationships between organs. The morphology of the female reproductive tract in non-avian reptiles varies between species, corresponding to a broad range of reproductive modes and providing valuable insight to comparative investigations of reproductive anatomy. However, reproductive studies in reptilian models, such as the brown anole studied here, have historically relied on histological methods to understand the anatomy. While these methods are highly effective for characterizing the cell types present in each organ, histological methods lose the 3D relationships between images and leave the architecture of the organ system poorly understood. We present the first comprehensive volumetric analyses of the female brown anole reproductive tract using two non-invasive, non-destructive imaging modalities: micro-computed tomography (microCT) and optical coherence tomography (OCT). Both are specialized imaging technologies that facilitate high-throughput imaging and preserve three-dimensional information. This study represents the first time that microCT has been used to study all reproductive organs in this species and the very first time that OCT has been applied to this species. We show how the non-destructive volumetric imaging provided by each modality reveals anatomical context including orientation and relationships between reproductive organs of the anole lizard. In addition to broad patterns of morphology, both imaging modalities provide the high resolution necessary to capture details and key anatomical features of each organ. We demonstrate that classic histological features can be appreciated within whole-organ architecture in volumetric imaging using microCT and OCT, providing the complementary information necessary to understand the relationships between tissues and organs in the reproductive system. This side-by-side imaging analysis using microCT and OCT allows us to evaluate the specific advantages and limitations of these two methods for the female reptile reproductive system.more » « less
-
Magnetic resonance imaging (MRI) is a routinely used imaging technique in medical diagnostics. To enhance the quality of MR images, contrast agents (CAs) are used, which account for nearly 40% of MRI exams in the clinic globally. The most used CAs are gadolinium-based CAs (GBCAs) but the use of GBCAs has been linked with metal-deposition in vital organs. Gadolinium deposition has been shown to be correlated with nephrogenic systemic fibrosis, a fibrosis of the skin and internal organs. Therefore, there is an unmet need for a new CA alternative to GBCAs for T 1 -weighted Ce-MRI. Herein, we designed paramagnetic ferric iron( iii ) ion-chelated poly(lactic- co -glycolic)acid nanoparticle formulation and routinely examined their application in Ce-MRI using clinical and ultra-high-field MRI scanners. Nanoparticles were monodispersed and highly stable at physiological pH over time with the hydrodynamic size of 130 ± 12 nm and polydispersity index of 0.231 ± 0.026. The T 1 -contrast efficacy of the nanoparticles was compared with commercial agent gadopentetate dimeglumine, called Magnevist®, in aqueous phantoms in vitro and then validated in vivo by visualizing an angiographic map in a clinical MRI scanner. Relaxivities of the nanoparticles in an aqueous environment were r 1 = 10.59 ± 0.32 mmol −1 s −1 and r 1 = 3.02 ± 0.14 mmol −1 s −1 at 3.0 T and 14.1 T measured at room temperature and pH 7.4, respectively. The clinically relevant magnetic field relaxivity is three times higher compared to the Magnevist®, a clinical GBCA, signifying its potential applicability in clinical settings. Moreover, iron is an endogenous metal with known metabolic safety, and the polymer and phospholipids used in the nanoconstruct are biodegradable and biocompatible components. These properties further put the proposed T 1 agent in a promising position in contrast-enhanced MRI of patients with any disease conditions.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1145/3550454.3555486
