skip to main content


Title: hIPPYlib-MUQ: A Bayesian Inference Software Framework for Integration of Data with Complex Predictive Models under Uncertainty
Recent years have seen a massive explosion of datasets across all areas of science and engineering. The central questions are: How do we optimally learn from data through the lens of models? And how do we account for uncertainties in both data and models? These questions can be mathematically framed as Bayesian inverse problems. While powerful and sophisticated approaches have been developed to tackle these problems, such methods are often challenging to implement and typically require first and second order derivatives that are not always available in existing computational models. In this talk, we present an extensible software framework MUQ-hIPPYlib that overcomes these challenges by providing access to state-of-the-art algorithms that offer the capability to solve complex large-scale Bayesian inverse problems across a broad spectrum of scientific and engineering areas.  more » « less
Award ID(s):
1550547
NSF-PAR ID:
10311440
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
33nd International Conference on Parallel Computational Fluid Dynamics
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Bayesian inference provides a systematic framework for integration of data with mathematical models to quantify the uncertainty in the solution of the inverse problem. However, the solution of Bayesian inverse problems governed by complex forward models described by partial differential equations (PDEs) remains prohibitive with black-box Markov chain Monte Carlo (MCMC) methods. We present hIPPYlib-MUQ, an extensible and scalable software framework that contains implementations of state-of-the art algorithms aimed to overcome the challenges of high-dimensional, PDE-constrained Bayesian inverse problems. These algorithms accelerate MCMC sampling by exploiting the geometry and intrinsic low-dimensionality of parameter space via derivative information and low rank approximation. The software integrates two complementary open-source software packages, hIPPYlib and MUQ. hIPPYlib solves PDE-constrained inverse problems using automatically-generated adjoint-based derivatives, but it lacks full Bayesian capabilities. MUQ provides a spectrum of powerful Bayesian inversion models and algorithms, but expects forward models to come equipped with gradients and Hessians to permit large-scale solution. By combining these two complementary libraries, we created a robust, scalable, and efficient software framework that realizes the benefits of each and allows us to tackle complex large-scale Bayesian inverse problems across a broad spectrum of scientific and engineering disciplines. To illustrate the capabilities of hIPPYlib-MUQ, we present a comparison of a number of MCMC methods available in the integrated software on several high-dimensional Bayesian inverse problems. These include problems characterized by both linear and nonlinear PDEs, various noise models, and different parameter dimensions. The results demonstrate that large (∼ 50×) speedups over conventional black box and gradient-based MCMC algorithms can be obtained by exploiting Hessian information (from the log-posterior), underscoring the power of the integrated hIPPYlib-MUQ framework. 
    more » « less
  2. Background To succeed in engineering careers, students must be able to create and apply models to certain problems. The different types of models include physical, mathematical, computational, graphical, and financial, which are used both in academics, research, and industry. However, many students struggle to define, create, and apply relevant models in their engineering courses. Purpose (Research Questions) The research questions investigated in this study are: (1) What types of models do engineering students identify before and after completing a first-year engineering course? (2) How do students’ responses compare across different courses (a graphical communications course - EGR 120 and a programming course - EGR 115), and sections? Design/Methods The data used for this study were collected in two introductory first-year engineering courses offered during Fall 2019, EGR 115 and EGR 120. Students’ responses to a survey about modeling were qualitatively analyzed. The survey was given at the beginning and the end of the courses. The data analyzed consisted of 560 pre and post surveys for EGR 115 and 384 pre and post surveys for EGR 120. Results Once the analysis is complete, we are hoping to find that the students can better define and apply models in their engineering courses after they have completed the EGR 115 and/or EGR 120 courses. 
    more » « less
  3. We present an overview of four challenging research areas in multiscale physics and engineering as well as four data science topics that may be developed for addressing these challenges. We focus on multiscale spatiotemporal problems in light of the importance of understanding the accompanying scientific processes and engineering ideas, where “multiscale” refers to concurrent, non-trivial and coupled models over scales separated by orders of magnitude in either space, time, energy, momenta, or any other relevant parameter. Specifically, we consider problems where the data may be obtained at various resolutions; analyzing such data and constructing coupled models led to open research questions in various applications of data science. Numeric studies are reported for one of the data science techniques discussed here for illustration, namely, on approximate Bayesian computations. 
    more » « less
  4. Engineering Projects in Community Service (EPICS) High utilizes human-centered design processes to teach high school students how to develop solutions to real-world problems within their communities. The goals of EPICS High are to utilize both principles from engineering and social entrepreneurship to engage high and middle school students as problem-solvers and spark interest in STEM careers. Recently, the Cisco corporate advised fund at the Silicon Valley Community Foundation, granted Arizona State University funds to expand EPICS High to underrepresented students and study the student outcomes from participation in this innovative program. In this exploratory study we combined qualitative methods—in person observations and informal interviews—along with pre and post surveys with high school students, to answer the questions: What skills do students gain and how does their mindset about engineering entrepreneurship develop through participation in EPICS High? Research took place in Title I schools (meaning they have a high number of students from low-income families) as well as non-Title I schools. Our preliminary results show that students made gains in the following areas: their attitudes toward engineering; ability to improve upon existing ideas; incorporating stakeholders; overcoming obstacles; social responsibility; and appreciation of multiple perspectives when solving engineering problems. While males have better baseline scores for most measures, females tend to have the most growth in many of these areas. We conclude that these initial measures show positive outcomes for students participating in EPICS High, and provide questions for further research. 
    more » « less
  5. One significant barrier to broadening participation in engineering and recruiting future engineers is the pervasive lack of understanding or even misunderstanding of what engineering is and what engineers do. The challenges to broadening participation in engineering are further complicated as underrepresented groups often report constructs, such as cultural milieu and outcome expectations, as more important than interest in influencing career choices. Addressing such issues is difficult and single exposure interventions are unlikely to make engineering careers seem more relevant or attainable for most students. More sustainable interventions, designed to (1) challenge misperceptions and create relevant conceptions of engineering; (2) maintain and expand situational interest; and, (3) integrate with individual interests, values, and social identities, appear to hold more promise for creating significant change. As a possible means of developing more sustainable interventions, our ITEST project partners researchers, teachers, and local industry representatives in creating a series (approximately 6 across an academic year) of engineering-related learning activities for middle school children in three school systems in or near rural Appalachia. Across the first year of implementation, we involved nine teachers, six people working at three different companies and more than 500 students with a series of activities in each classroom. To examine the impact of our project, we are using mixed methods, including interviews, surveys, classroom observations, and classroom artifacts gathered from multiple project stakeholders, to answer the following research questions: RQ 1: How do participants conceptualize engineering careers? How and why do such perceptions shift throughout the project? RQ 2: What elements of the targeted intervention affect student motivation towards engineering careers specifically with regard to developing competencies and ability beliefs regarding engineering? RQ 3: How can strategic collaboration between K12 and industry promote a shift in teacher’s conceptions of engineers and increased self-efficacy in building and delivering engineering curriculum? RQ 4: How do stakeholder characteristics, perceptions, and dynamics affect the likelihood of sustainability in strategic collaborations between K12 and industry stakeholders? How do prevailing institutional and collaborative conditions mediate sustainability? Our findings to date offer insights across all research questions and have important implications for stakeholders hoping to raise awareness of engineering among youth, particularly in rural areas. 
    more » « less