skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Role of HCI-based criteria in supporting the training of surgical residents using Mixed Reality environments
This paper focuses on the design of a mixed reality-based (MR) simulation environment to train health care personnel in reverse total shoulder arthroplasty (RTSA) procedure. Information-centric models involving interaction with orthopedic surgeons were created as part of a participatory design approach. These information models provided a structural foundation for the design and development of the environments. This paper concludes with a discussion of the preliminary assessment activities which includes studying the impact of such a MR approach on understanding and knowledge acquisition of the targeted surgical procedure.  more » « less
Award ID(s):
2106901
PAR ID:
10435924
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
2023 International Conference on Human-Computer Interaction
Page Range / eLocation ID:
23-28
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Abstract The data-driven approach is emerging as a promising method for the topological design of multiscale structures with greater efficiency. However, existing data-driven methods mostly focus on a single class of microstructures without considering multiple classes to accommodate spatially varying desired properties. The key challenge is the lack of an inherent ordering or “distance” measure between different classes of microstructures in meeting a range of properties. To overcome this hurdle, we extend the newly developed latent-variable Gaussian process (LVGP) models to create multi-response LVGP (MR-LVGP) models for the microstructure libraries of metamaterials, taking both qualitative microstructure concepts and quantitative microstructure design variables as mixed-variable inputs. The MR-LVGP model embeds the mixed variables into a continuous design space based on their collective effects on the responses, providing substantial insights into the interplay between different geometrical classes and material parameters of microstructures. With this model, we can easily obtain a continuous and differentiable transition between different microstructure concepts that can render gradient information for multiscale topology optimization. We demonstrate its benefits through multiscale topology optimization with aperiodic microstructures. Design examples reveal that considering multiclass microstructures can lead to improved performance due to the consistent load-transfer paths for micro- and macro-structures. 
    more » « less
  2. We present the design of a mixed reality (MR) telehealth training system that aims to close the gap between in-person and distance training and re-training for medical procedures. Our system uses real-time volumetric capture as a means for communicating and relating spatial information between the non-colocated trainee and instructor. The system's design is based on a requirements elicitation study performed in situ, at a medical school simulation training center. The focus is on the lightweight real-time transmission of volumetric data - meaning the use of consumer hardware, easy and quick deployment, and low-demand computations. We evaluate the MR system design by analyzing the workload for the users during medical training. We compare in-person, video, and MR training workloads. The results indicate that the overall workload for central line placement training with MR does not increase significantly compared to video communication. Our work shows that, when designed strategically together with domain experts, an MR communication system can be used effectively for complex medical procedural training without increasing the overall workload for users significantly. Moreover, MR systems offer new opportunities for teaching due to spatial information, hand tracking, and augmented communication. 
    more » « less
  3. Abstract We present the design of a mixed reality (MR) telehealth training system that aims to close the gap between in-person and distance training and re-training for medical procedures. Our system uses real-time volumetric capture as a means for communicating and relating spatial information between the non-colocated trainee and instructor. The system's design is based on a requirements elicitation study performed in situ, at a medical school simulation training center. The focus is on the lightweight real-time transmission of volumetric data - meaning the use of consumer hardware, easy and quick deployment, and low-demand computations. We evaluate the MR system design by analyzing the workload for the users during medical training. We compare in-person, video, and MR training workloads. The results indicate that the overall workload for central line placement training with MR does not increase significantly compared to video communication. Our work shows that, when designed strategically together with domain experts, an MR communication system can be used effectively for complex medical procedural training without increasing the overall workload for users significantly. Moreover, MR systems offer new opportunities for teaching due to spatial information, hand tracking, and augmented communication. 
    more » « less
  4. This study explores the application of deep learning to the segmentation of DENSE cardiovascular magnetic resonance (CMR) images, which is an important step in the analysis of cardiac deformation and may help in the diagnosis of heart conditions. A self-adapting method based on the nnU-Net framework is introduced to enhance the accuracy of DENSE-MR image segmentation, with a particular focus on the left ventricle myocardium (LVM) and left ventricle cavity (LVC), by leveraging the phase information in the cine DENSE-MR images. Two models are built and compared: 1) ModelM, which uses only the magnitude of the DENSE-MR images; and 2) ModelMP, which incorporates magnitude and phase images. DENSE-MR images from 10 human volunteers processed using the DENSE-Analysis MATLAB toolbox were included in this study. The two models were trained using a 2D UNet-based architecture with a loss function combining the Dice similarity coefficient (DSC) and cross-entropy. The findings show the effectiveness of leveraging the phase information with ModelMP resulting in a higher DSC and improved image segmentation, especially in challenging cases, e.g., at early systole and with basal and apical slices. 
    more » « less
  5. Seasonal variations and climatic events cause fluctuations of water content and temperature in shallow unsaturated soils. Such fluctuations can alter the resilient modulus (MR) of subgrade, which is an important parameter in the design and evaluation of pavements. This paper presents a new model to determine MR of unsaturated subgrade soils under concurrent changes in water content and temperature. The proposed analytical model offers the following two new features distinguishing it from alternative models: (1) the model separately accounts for two different soil water retention mechanisms, namely capillary and adsorption, which enables it to predict MR over a wide range of suctions, and (2) it explicitly incorporates the effect of temperature in the calculation of MR through employing temperature-dependent expressions for matric suction and the soil water retention curve (SWRC). The proposed model showed high accuracy when validated against experimentally measured MR values for several different soils reported in the literature. The presented model is simple and can readily be employed in practice to determine MR of subgrade soils under concurrent variations of water content and temperature. 
    more » « less