skip to main content

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


This content will become publicly available on April 15, 2025

Title: Integrating Software and Systems Engineering: A Framework for Human-Centric Design of Augmented Reality Applications
Modeling from the perspectives of software engineering and systems engineering have co-evolved over the last two decades as orthogonal approaches. Given the central role of software in modern cyber-physical systems and the increasing adoption of digital engineering practices in complex systems design, there is now significant opportunity for collaborative design among system users, software developers, and systems engineers. Model-based systems engineering (MBSE) and systems modeling languages can support seamless cross-domain connectivity for design, simulation, and analysis of emerging technologies such as Augmented Reality (AR). This paper presents a co-design process for extending the capability of an existing AR application referred to as a No-Code AR Systems (NCARS) framework. NCARS enables content developed by multi-domain authors to be deployed on AR devices through a software layer that bridges the content to the game engine that drives the AR system. Utilizing a software dependency diagram of the AR Annotation function, an existing MBSE model of the AR system is extended to include the structure and behavior of relevant software components. This allows a modular design of the system to address needs in integrating new requirements into the existing application. New user requirements for tracking items in motion in the user’s physical environment with virtual annotations in the augmented space are collaboratively designed and visualized through use case, block definition, internal block, and sequence diagrams. They capture the required structure and behavior of the proposed to-be system.  more » « less
Award ID(s):
2105701
PAR ID:
10525099
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
IEEE
Date Published:
Journal Name:
Annual IEEE Systems Conference
ISSN:
2472-9647
ISBN:
979-8-3503-5880-3
Subject(s) / Keyword(s):
Augmented Reality Model-Based Systems Engineering SysML Annotation Navigation Systems Framework
Format(s):
Medium: X
Location:
Montreal, CN
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ( , 2021 IEEE International Systems Conference (SysCon))
    null (Ed.)
    Model-Based Systems Engineering (MBSE) is the formalized application of modeling to support various system evolving stages starting from the conceptual design phase to all the life cycle phases that follow. To facilitate in an efficient system behavior design process, in this paper, a Design Structure Matrix (DSM) based approach is developed and illustrated for determining the operational sequence of activities relevant to requirements of the system and in identifying the concurrent activities as well. A triangularization algorithm method is extended especially for application on activity diagrams to determine knowledge activities in an interaction graph to identify groups of activities and arrange them concurrently. The findings through the DSM based approach are validated by a system engineering expert and are implemented to construct the MBSE activity diagram to facilitate an enhanced behavior design of the system. This paper illustrates the use of Design Structure Matrix to facilitate modeling interdependencies between activities and the approach to aggregate the resulted sequential and concurrent activities with the activity diagram, applied to a case study of Execute Hohmann Transfer based on DellSat-77 Satellite System. In addition, the potentials benefits of using a Design Structure Matrix methodology for assisting Model Based Systems Engineering activities for enhanced systems behavior design is portrayed. 
    more » « less
  2. ; ; ( , 2021 IEEE International Systems Conference (SysCon))
    null (Ed.)
    Manufacturing and production systems have become increasingly complex in the past decade to meet the competitive demand in a growing industry. As these systems grow in complexity and flexibility, there is a need for efficient management and analysis of these systems. Model-based systems engineering (MBSE) addresses the complexity inherent with systems development with a model-centric approach that supported tailored modeling languages, methods and tools. This paper identifies the thematic evolution and trends and relationships found in the use and application of MBSE specifically in the manufacturing and production engineering domain. A collection of 471 published article from Institute of Electrical and Electronics Engineers (IEEE) and Science Direct over the past decade were used for the analysis using text mining techniques. Due to the limitation on the access to full text information of all the articles identified, only abstracts were considered for analysis. This effort helps the researchers across the domain to explore the reason behind and understand the change of the thematic perspectives of MBSE application over the last decade. In addition, the finding of the growing interest in addressing the aspects of complexity and systems requirements, and on the aspects of the use of MBSE for identifying and addressing the challenges related to Cyber Physical Systems help in paving a path for future research. 
    more » « less
  3. ; ; ; ; ; ( , 2023 IEEE International Systems Conference (SysCon))
    Augmented Reality (AR) devices offer novel capabilities that can be exploited in AR systems to positively impact human-machine interactions in a variety of future-work and education contexts. This paper presents a systems model for a no-code AR systems framework that can be used to create AR applications that present just-in-time informatics to assist and guide users in the completion of complex task sequences while ensuring operator and environment safety. The salient structural and behavioral aspects of the system, and key use cases are modeled using the Systems Modeling Language (SysML). Representative examples of the model are presented using use case, block definition, internal block, activity, and state-machine diagrams. These models offer new insights into how AR capabilities can be integrated with a variety of engineered systems. In the future such SysML models can steer the design of new tools and an ontology to strengthen connections to domain knowledge. 
    more » « less
  4. ; ; ; ; ; ; ; ( , IEEE)
    Augmented Reality (AR) devices offer novel capabilities that can be exploited in AR systems to positively impact human-machine interactions in a variety of future-work and education contexts. This paper presents a systems model for a no-code AR systems framework that can be used to create AR applications that present just-in-time informatics to assist and guide users in the completion of complex task sequences while ensuring operator and environment safety. The salient structural and behavioral aspects of the system, and key use cases are modeled using the Systems Modeling Language (SysML). Representative examples of the model are presented using use case, block definition, internal block, activity, and state-machine diagrams. These models offer new insights into how AR capabilities can be integrated with a variety of engineered systems. In the future such SysML models can steer the design of new tools and an ontology to strengthen connections to domain knowledge. 
    more » « less
  5. ; ( , Systems Engineering)
    null (Ed.)
    An observed increase in systems scale and complexity has led to a significant momentum in exploring, identifying, and adopting model based systems engineering (MBSE) tools and techniques amongst research communities and industry practitioners. Several attempts to transform systems design and engineering practices through the use of MBSE in academia and industry has led to a considerable increase in the number of articles published containing the keyword “MBSE.” This growth serves as the motivation in this paper to explore the MBSE landscape with the help of text mining techniques to identify the most often used key terms, tools, and languages, in the context of research in MBSE and the thematic aspects defining the use of MBSE by researchers and practitioners. The objective of this paper is to provide a structured comprehensive overview of research contributions across the MBSE landscape by employing text mining techniques for: (a) identifying the concepts and methodologies inferred upon in relation to MBSE, and (b) classifying the literature published to identify commonalities across academic researchers and practitioners using MBSE tools and methods. For this purpose, the abstracts of 2380 relevant articles published in the period of the last two decades from five different databases are mined. It is found that the terms “SysML,” “Cyber Physical Systems,” and “Production” are the most used terms among researchers across the MBSE landscape with SysML being the most widely used modeling language. Further, six major thematic topics are identified that classify articles from over the last two decades with an increasing interest observed in the use of MBSE to support manufacturing and production engineering activities, especially in the cyber physical systems domain. The contributions of this paper provide a leeway on using text mining techniques to understand the research directions that are currently of interest in the field of MBSE and thereby identify potential future research directions. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email