skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Design Heuristics: Analysis and Synthesis from Jet Propulsion Laboratory's Architecture Team
This study offers insight into the processes of expert designers at the Jet Propulsion Laboratory (JPL) and how they make use of heuristics in the design process. A methodology for the extraction, classification, and characterization of heuristics is presented. Ten expert participants were interviewed to identify design heuristics used during early stage space mission design at JPL. In total, 101 heuristics were obtained, classified, and characterized. Through the use of post-interview surveys, participants characterized heuristics based on attributes including source/origin, applicability based on concept maturity, frequency of use, reliability, and tendency to evolve. These findings are presented, and statistically analyzed to show correlations between the participant perceptions of frequency of use, reliability, and evolution of a heuristic. Survey results and analysis aim to identify valid attributes for assessing the applicability and value of multiple heuristics for design practice in early space mission formulation.  more » « less
Award ID(s):
1645316
PAR ID:
10060541
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference.
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This article describes Daphne, a virtual assistant for designing Earth observation distributed spacecraft missions. It is, to the best of our knowledge, the first virtual assistant for such application. The article provides a thorough description of Daphne, including its question answering system and the main features we have implemented to help system engineers design distributed spacecraft missions. In addition, the article describes a study performed at NASA’s Jet Propulsion Laboratory (JPL) to assess the usefulness of Daphne in this use case. The study was conducted with N = 9 subjects from JPL, who were asked to work on a mission design task with two versions of Daphne, one that was fully featured implementing the cognitive assistance functions, and one that only had the features one would find in a traditional design space exploration tool. After the task, they filled out a standard user experience survey, completed a test to assess how much they learned about the task, and were asked a number of questions in a semi-structured exit interview. Results of the study suggest that Daphne can help improve performance during system design tasks compared to traditional tools, while keeping the system usable. However, the study also raises some concerns with respect to a potential reduction in human learning due to the use of the cognitive assistant. The article ends with a list of suggestions for future development of virtual assistants for space mission design. 
    more » « less
  2. In designing complex systems, systems engineers strive to turn an existing situation into a situation that is most preferred. A rational decision maker would choose the alternative that maximizes the expected utility of the existing situation, but there are significant computational challenges to this approach. To overcome these challenges, most decision makers revert to heuristics. In this paper, we propose a conceptual framework for heuristics in design. A preliminary empirical study of designers for a robotics design problem was conducted to observe how participants apply heuristics. Participants having at least 2 years of experience designing robots were recruited to partake in a robotics design session in which participant were given 45 minutes to work on a design problem. A preliminary heuristics extraction method was developed, and the identified heuristics were studied to find trends within the overall set. These trends were the basis of a taxonomy of heuristics consisting of three initial classification methods: design phase, field of study, and action intent. The heuristics and classifications are presented, along with the challenges from extracting heuristics and recommendations for future work to further research design heuristics and to improve the method for extraction. 
    more » « less
  3. Coastal waters off west Greenland are strongly influenced by the input of low salinity water from the Arctic and from meltwater from the Greenland Ice Sheet. Changes in freshwater content in the region can play an important role in stratification, circulation, and primary production; however, investigating salinity variability in the region is challenging because in situ observations are sparse. Here, we used satellite observations of sea surface salinity (SSS) from the Soil Moisture and Ocean Salinity mission produced by LOCEAN and by the Barcelona Expert Center (SMOS LOCEAN and SMOS BEC) and from the Soil Moisture Active Passive mission produced by the Jet Propulsion Laboratory (SMAP JPL) as well as by Remote Sensing Systems (SMAP RSS) to investigate how variability in a narrow coastal band off west Greenland is captured by these different products. Our analyses revealed that the various satellite SSS products capture the seasonal freshening off west Greenland from late spring to early fall. The magnitudes of the freshening and of coastal salinity gradients vary between the products however, being attenuated compared to historical in situ observations in most cases. The seasonal freshening off southwest Greenland is intensified in SMAP JPL and SMOS LOCEAN near the mouth of fjords characterized by large inputs of meltwater near the surface, which suggests an influence of meltwater from the Greenland Ice Sheet. Synoptic observations from 2012 following large ice sheet melting revealed good agreement with the spatial scale of freshening observed with in situ and SMOS LOCEAN data. Our analyses indicate that satellite SSS can capture the influence of meltwater input and associated freshwater plumes off coastal west Greenland, but those representations differ between products. 
    more » « less
  4. Abstract This study works toward addressing a knowledge gap in understanding how heuristics are developed, retrieved, employed, and modified by designers. Having a better awareness of one’s own set of heuristics can be beneficial for relaying to other team members, improving a team’s training processes, and aiding others on their path to design expertise. The ability to understand and justify the use of a heuristic should lead to more effective decision-making in systems design. To do this, the heuristics and their characteristics must be extracted using a repeatable scientific research methodology. This study describes a unique extraction and characterization process compared to prior literature. It includes some of the first work towards documenting heuristics for both designers and operators in a hybrid manufacturing setting. Eight participants performed a series of two design journals, two interviews, and one survey. Heuristics were extracted and refined between each method and then verified by participants in the survey. The surveys produced novel statistically significant findings in regard to heuristic characterizations, impacting how participants view how often a heuristic is used, the reliability of the heuristic, and the evolution of the heuristic. Lastly, an alternate perspective of heuristics as an error management bias is highlighted and discussed. 
    more » « less
  5. Context : Ultrasound imaging is a clinically feasible tool to assess femoral articular cartilage and may have utility in tracking early knee osteoarthritis development. Traditional assessment techniques focus on measurements at a single location, which can be challenging to adopt for novice raters. Objective : To introduce a novel semiautomated ultrasound segmentation technique and determine the intrarater and interrater reliability of average regional femoral articular cartilage thickness and echo intensity of a novice and expert rater. Design : Descriptive observational study. Setting : Orthopedic clinic. Patients or Other Participants : Fifteen participants (mean [SD]; age 23.5 [4.6] y, height = 172.6 [9.3] cm, mass = 79.8 [15.7] kg) with a unilateral history of anterior cruciate ligament reconstruction participated. Intervention : None. Main Outcome Measures : One rater captured anterior femoral cartilage images of the participants’ contralateral knees using a transverse suprapatellar ultrasound assessment. The total femoral cartilage cross-sectional area of each image was segmented by a novice and expert rater. A novel custom program automatically separated the cartilage segmentations into medial, lateral, and intercondylar regions to determine the cross-sectional area and cartilage length. The average cartilage thickness in each region was calculated by dividing the cross-sectional area by the cartilage length. Echo intensity was calculated as the average gray-scale pixel value of each region. Two-way random effect intraclass correlations coefficient (ICC) for absolute agreement were used to determine the interrater reliability between a novice and expert rater, as well as the intrarater reliability of the novice rater. Results : The novice rater demonstrated excellent intrarater (ICC [ 2,k ] range = .993–.997) and interrater (ICC [ 2,k ] range = .944–.991) reliability with the expert rater of all femoral articular cartilage average thickness and echo intensity regions. Conclusions : The novel semiautomated average cartilage thickness and echo-intensity assessment is efficient, systematic, and reliable between an expert and novice rater with minimal training. 
    more » « less