More Like this

1. Text-to-Model Transformation: Natural Language-Based Model Generation Framework

   https://doi.org/10.3390/systems12090369  

   Akundi, Aditya; Ontiveros, Joshua; Luna, Sergio (September 2024, Systems)

   System modeling language (SysML) diagrams generated manually by system modelers can sometimes be prone to errors, which are time-consuming and introduce subjectivity. Natural language processing (NLP) techniques and tools to create SysML diagrams can aid in improving software and systems design processes. Though NLP effectively extracts and analyzes raw text data, such as text-based requirement documents, to assist in design specification, natural language, inherent complexity, and variability pose challenges in accurately interpreting the data. In this paper, we explore the integration of NLP with SysML to automate the generation of system models from input textual requirements. We propose a model generation framework leveraging Python and the spaCy NLP library to process text input and generate class/block definition diagrams using PlantUML for visual representation. The intent of this framework is to aid in reducing the manual effort in creating SysML v1.6 diagrams—class/block definition diagrams in this case. We evaluate the effectiveness of the framework using precision and recall measures. The contribution of this paper to the systems modeling domain is two-fold. First, a review and analysis of natural language processing techniques for the automated generation of SysML diagrams are provided. Second, a framework to automatically extract textual relationships tailored for generating a class diagram/block diagram that contains the classes/blocks, their relationships, methods, and attributes is presented. 

   more » « less
2. Multidisciplinary Authoring – A Critical Foundation for Augmented Reality Systems in Training and Education

   Aoki, E.; Tran, B.; Uhunsere, N.E.; Tripathy, S.T.; Thompson, C.; Sastry, S.; Chandra, K. (June 2023, Proceedings of the 2023 ASEE Annual Conference & Exposition)

   Recent advances in Augmented Reality (AR) devices and their maturity as a technology offers new modalities for interaction between learners and their learning environments. Such capabilities are particularly important for learning that involves hands-on activities where there is a compelling need to: (a) make connections between knowledge-elements that have been taught at different times, (b) apply principles and theoretical knowledge in a concrete experimental setting, (c) understand the limitations of what can be studied via models and via experiments, (d) cope with increasing shortages in teaching-support staff and instructional material at the intersection of disciplines, and (e) improve student engagement in their learning. AR devices that are integrated into training and education systems can be effectively used to deliver just-in-time informatics to augment physical workspaces and learning environments with virtual artifacts. We present a system that demonstrates a solution to a critical registration problem and enables a multi-disciplinary team to develop the pedagogical content without the need for extensive coding. The most popular approach for developing AR applications is to develop a game using a standard game engine such as UNITY or UNREAL. These engines offer a powerful environment for developing a large variety of games and an exhaustive library of digital assets. In contrast, the framework we offer supports a limited range of human environment interactions that are suitable and effective for training and education. Our system offers four important capabilities – annotation, navigation, guidance, and operator safety. These capabilities are presented and described in detail. The above framework motivates a change of focus – from game development to AR content development. While game development is an intensive activity that involves extensive programming, AR content development is a multi-disciplinary activity that requires contributions from a large team of graphics designers, content creators, domain experts, pedagogy experts, and learning evaluators. We have demonstrated that such a multi-disciplinary team of experts working with our framework can use popular content creation tools to design and develop the virtual artifacts required for the AR system. These artifacts can be archived in a standard relational database and hosted on robust cloud-based backend systems for scale up. The AR content creators can own their content and Non-fungible Tokens to sequence the presentations either to improve pedagogical novelty or to personalize the learning. 

   more » « less
3. Multidisciplinary Authoring – A Critical Foundation for Augmented Reality Systems in Training and Education

   Aoki, E.; Tran, B.; Uhunsere, N.; Tripathy, S.T.; Thompson, C.; Sastry, S. (April 2023, ASEE annual conference exposition)

   Recent advances in Augmented Reality (AR) devices and their maturity as a technology offers new modalities for interaction between learners and their learning environments. Such capabilities are particularly important for learning that involves hands-on activities where there is a compelling need to: (a) make connections between knowledge-elements that have been taught at different times, (b) apply principles and theoretical knowledge in a concrete experimental setting, (c) understand the limitations of what can be studied via models and via experiments, (d) cope with increasing shortages in teaching-support staff and instructional material at the intersection of disciplines, and (e) improve student engagement in their learning. AR devices that are integrated into training and education systems can be effectively used to deliver just-in-time informatics to augment physical workspaces and learning environments with virtual artifacts. We present a system that demonstrates a solution to a critical registration problem and enables a multi-disciplinary team to develop the pedagogical content without the need for extensive coding. The most popular approach for developing AR applications is to develop a game using a standard game engine such as UNITY or UNREAL. These engines offer a powerful environment for developing a large variety of games and an exhaustive library of digital assets. In contrast, the framework we offer supports a limited range of human environment interactions that are suitable and effective for training and education. Our system offers four important capabilities – annotation, navigation, guidance, and operator safety. These capabilities are presented and described in detail. The above framework motivates a change of focus – from game development to AR content development. While game development is an intensive activity that involves extensive programming, AR content development is a multi-disciplinary activity that requires contributions from a large team of graphics designers, content creators, domain experts, pedagogy experts, and learning evaluators. We have demonstrated that such a multi-disciplinary team of experts working with our framework can use popular content creation tools to design and develop the virtual artifacts required for the AR system. These artifacts can be archived in a standard relational database and hosted on robust cloud-based backend systems for scale up. The AR content creators can own their content and Non-fungible Tokens to sequence the presentations either to improve pedagogical novelty or to personalize the learning. 

   more » « less
4. Modeling A UAV Surveillance Scenario- An Applied MBSE Approach

   https://doi.org/10.1109/SysCon53073.2023.10131074  

   Lopez, Viviana; Akundi, Aditya (April 2023, IEEE International Systems Conference (SysCon))

   As the complexity of both products and systems increases across a wide range of industry sectors, there has been an influx in demand for methods of system organization and optimization. MBSE enhances the ability to obtain, analyze, communicate, and manage data on a comprehensive architecture of a system. In this study, a military combat surveillance scenario is modeled using SysML generating state machine diagrams and activity diagrams using the Magic Model Analyst execution framework plugin. This study seeks to prove the feasibility of an MBSE-enabled framework using SysML to create and simulate a surveillance system that monitors and reports on the health status and performance of an armored fighting vehicle (combat tank) through an Unmanned Ariel Vehicle (UAV). The Magic System of Systems Architect, which actively promotes system development architectural frameworks, was used to construct SysML-compliant models, allowing the creation of intricate model diagrams. The construction of the UAV surveillance scenario emphasized the capability of modifying a diagram feature and ensuring that the alteration is communicated to all linked model diagrams. This study builds on a previously published MBSE-enabled conceptual framework for creating digital twins. The purpose of this research is to test and validate the framework's procedures. Keywords—MBSE, SysML, MBSE framework, UAV, Surveillance 

   more » « less
5. Integrating Software and Systems Engineering: A Framework for Human-Centric Design of Augmented Reality Applications

   Aoki, E; Tran, B; Norceide, F; Tran, V; Sastry, S; Thompson, C; Chandra, K (April 2024, Annual IEEE Systems Conference)

   Modeling from the perspectives of software engineering and systems engineering have co-evolved over the last two decades as orthogonal approaches. Given the central role of software in modern cyber-physical systems and the increasing adoption of digital engineering practices in complex systems design, there is now significant opportunity for collaborative design among system users, software developers, and systems engineers. Model-based systems engineering (MBSE) and systems modeling languages can support seamless cross-domain connectivity for design, simulation, and analysis of emerging technologies such as Augmented Reality (AR). This paper presents a co-design process for extending the capability of an existing AR application referred to as a No-Code AR Systems (NCARS) framework. NCARS enables content developed by multi-domain authors to be deployed on AR devices through a software layer that bridges the content to the game engine that drives the AR system. Utilizing a software dependency diagram of the AR Annotation function, an existing MBSE model of the AR system is extended to include the structure and behavior of relevant software components. This allows a modular design of the system to address needs in integrating new requirements into the existing application. New user requirements for tracking items in motion in the user’s physical environment with virtual annotations in the augmented space are collaboratively designed and visualized through use case, block definition, internal block, and sequence diagrams. They capture the required structure and behavior of the proposed to-be system. 

   more » « less