skip to main content


Title: Assessing Interdisciplinary Competency in the Disaster Resilience and Risk Management Graduate Program using Concept Maps
Concept maps have emerged as a valid and reliable method for assessing deep conceptual understanding in engineering education within disciplines as well as interdisciplinary knowledge integration across disciplines. Most work on concept maps, however, focuses on undergraduates. In this paper, we use concept maps to examine changes in graduate students’ conceptual understanding and knowledge integration resulting from an interdisciplinary graduate program. Our study context is pair of foundational, team-taught courses in an interdisciplinary Disaster Resilience and Risk Management (DRRM) graduate program. The courses include a 3-hour research course and a 1-hour seminar that aim to build student understanding within and across Urban Affairs and Planning, Civil and Environmental Engineering, Geosciences, and Business Information Technology. The courses introduce core principles of DRRM and relevant research methods in these disciplines, and drive students to understand the intersections of these disciplines in the context of planning for and responding to natural and human-made disasters. To understand graduate student growth from disciplinary-based to interdisciplinary scholars, we pose the research questions: 1) In what ways do graduate students’ understandings of DRRM change as a result of their introduction to an interdisciplinary graduate research program? and 2) To what extent and in what ways do concept maps serve as a tool to capture interdisciplinary learning in this context? Data includes pre/post concept maps centered on disaster resilience and risk management, a one-page explanation of the post-concept map, and ethnographic field notes gathered from class and faculty meetings. Pre-concept maps were collected on the first day of class; post-concept maps will be collected as part of the final course assignment. We assess the students’ concept maps for depth of conceptual understanding within disciplines and interdisciplinary competency across disciplines, using the field notes to provide explanatory context. The results presented in this paper support the inclusion of an explanation component to concept maps, and also suggest that concept maps alone may not be the best measure of student understanding of concepts within and across disciplines in this specific context. If similar programs wish to use concept maps as an assessment method, we suggest the inclusion of an explanation component and suggest providing explicit instructions that specify the intended audience. We also suggest using a holistic scoring method, as it is more likely to capture nuances in the concept maps than traditional scoring methods, which focus solely on counting factors like hierarchies and number of cross-links.  more » « less
Award ID(s):
1735139
NSF-PAR ID:
10108834
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
2019 ASEE Annual Conference and Exposition
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Disasters are becoming more frequent as the global climate changes, and recovery efforts require the cooperation and collaboration of experts and community members across disciplines. The DRRM program, funded through the National Science Foundation (NSF) Research Traineeship (NRT), is an interdisciplinary graduate program that brings together faculty and graduate students from across the university to develop new, transdisciplinary ways of solving disaster-related issues. The core team includes faculty from business, engineering, education, science, and urban planning fields. The overall objective of the program is to create a community of practice amongst the graduate students and faculty to improve understanding and support proactive decision-making related to disasters and disaster management. The specific educational objectives of the program are (1) context mastery and community building, (2) transdisciplinary integration and professional development, and (3) transdisciplinary research. The program’s educational research and assessment activities include program development, trainee learning and development, programmatic educational research, and institutional transformation. The program is now in its fourth year of student enrollment. Core courses on interdisciplinary research methods in disaster resilience are in place, engaging students in domain-specific research related to natural hazards, resilience, and recovery, and in methods of interdisciplinary and transdisciplinary collaboration. In addition to courses, the program offers a range of professional development opportunities through seminars and workshops. Since the program’s inception, the core team has expanded both the numbers of faculty and students and the range of academic disciplines involved in the program, including individuals from additional science and engineering fields as well as those from natural resources and the social sciences. At the same time, the breadth of disciplines and the constraints of individual academic programs have posed substantial structural challenges in engaging students in the process of building interdisciplinary research identities and in building the infrastructure needed to sustain the program past the end of the grant. Our poster and paper will identify major program accomplishments, but also draw on interviews with students to examine the structural challenges and potential solution paths associated with a program of this breadth. Critical opportunities for sustainability and engagement have emerged through integration with a larger university-level center as well as through increased flexibility in program requirements and additional mechanisms for student and faculty collaboration. 
    more » « less
  2. Abstract Background

    Engineering education traditionally emphasizes technical skills, sometimes at the cost of under‐preparing graduates for the real‐world engineering context. In recent decades, attempts to address this issue include increasing project‐based assignments and engineering design courses in curricula; however, a skills gap between education and industry remains.

    Purpose/Hypothesis

    This study aims to understand how undergraduate engineering students perceive product design before and after an upper‐level project‐based design course, as measured through concept maps. The purpose is to measure whether and how students account for the technical and nontechnical elements of design, as well as how a third‐year design course influences these design perceptions.

    Design/Method

    Concept maps about product design were collected from 105 third‐year engineering students at the beginning and end of a design course. Each concept map's content and structure were quantitatively analyzed to evaluate the students' conceptual understandings and compare them across disciplines in the before and after conditions.

    Results

    The analyses report on how student conceptions differ by discipline at the outset and how they changed after taking the course. Mechanical Engineering students showed a decrease in business‐related content and an increased focus on societal content, while students in the Engineering Management and Industrial and Systems Engineering programs showed an increase in business topics, specifically market‐related content.

    Conclusion

    This study reveals how undergraduate students conceptualize product design, and specifically to what extent they consider engineering, business, and societal factors. The design courses were shown to significantly shape student conceptualizations of product design, and they did so in a way that mirrored the topics in the course syllabi. The findings offer insights into the education‐practice skills gap and may help future educators to better prepare engineering students to meet industry needs.

     
    more » « less
  3. The CUAHSI Virtual University is an interinstitutional graduate training framework that was developed to increase access to specialized hydrology courses for graduate students from participating US institutions. The program was designed to capitalize on the benefits of collaborative teaching, allowing students to differentiate their learning and access subject matter experts at multiple institutions, while enrolled in a single course at their home institution, through a framework of reciprocity. Although the CUAHSI Virtual University was developed prior to the COVID-19 pandemic, the resilience of its online education model to such disruptions to classroom teaching increases the urgency of understanding how effective such an approach is at achieving its goals and what challenges multi-institutional graduate training faces for sustainability and expansion within the water sciences or in other disciplines. To gain faculty perspectives on the program, we surveyed (1) water science graduate program faculty who had served as instructors in the program, (2) water science graduate program faculty who were aware of the program, but had not participated, and (3) departmental chairs of participating instructors. Our data show widespread agreement across respondent types that the program is positive for students, diversifying their educational opportunities and increasing access to subject matter experts. Concerns and factors limiting faculty involvement revolved around faculty workload and administrative barriers, including low enrollment at individual institutions. If these barriers can be surmounted, the CUAHSI Virtual University has the potential for wider participation within hydrology and adoption in other STEM disciplines. 
    more » « less
  4. Abstract

    Interdisciplinary teams are on the rise as scientists attempt to address complex environmental issues. While the benefits of team science approaches are clear, researchers often struggle with its implementation, particularly for new team members. The challenges of large projects often weigh on the most vulnerable members of a team: trainees, including undergraduate students, graduate students, and post‐doctoral researchers. Trainees on big projects have to navigate their role on the team, with learning project policies, procedures, and goals, all while also training in key scientific tasks such as co‐authoring papers. To address these challenges, we created and participated in a project‐specific, graduate‐level team science course. The purposes of this course were to: (1) introduce students to the goals of the project, (2) build trainees' understanding of how big projects operate, and (3) allow trainees to explore how their research interests dovetailed with the overall project. Additionally, trainees received training regarding: (1) diversity, equity & inclusion, (2) giving and receiving feedback, and (3) effective communication. Onboarding through the team science course cultivated psychological safety and a collaborative student community across disciplines and institutions. Thus, we recommend a team science course for onboarding students to big projects to help students establish the skills necessary for collaborative research. Project‐based team science classes can benefit student advancement, enhance the productivity of the project, and accelerate the discovery of solutions to ecological issues by building community, establishing a shared project vocabulary, and building a workforce with collaborative skills to better answer ecological research questions.

     
    more » « less
  5. Abstract

    Biodiversity is a complex, yet essential, concept for undergraduate students in ecology and other natural sciences to grasp. As beginner scientists, students must learn to recognize, describe, and interpret patterns of biodiversity across various spatial scales and understand their relationships with ecological processes and human influences. It is also increasingly important for undergraduate programs in ecology and related disciplines to provide students with experiences working with large ecological datasets to develop students’ data science skills and their ability to consider how ecological processes that operate at broader spatial scales (macroscale) affect local ecosystems. To support the goals of improving student understanding of macroscale ecology and biodiversity at multiple spatial scales, we formed an interdisciplinary team that included grant personnel, scientists, and faculty from ecology and spatial sciences to design a flexible learning activity to teach macroscale biodiversity concepts using large datasets from the National Ecological Observatory Network (NEON). We piloted this learning activity in six courses enrolling a total of 109 students, ranging from midlevel ecology and GIS/remote sensing courses, to upper‐level conservation biology. Using our classroom experiences and a pre/postassessment framework, we evaluated whether our learning activity resulted in increased student understanding of macroscale ecology and biodiversity concepts and increased familiarity with analysis techniques, software programs, and large spatio‐ecological datasets. Overall, results suggest that our learning activity improved student understanding of biological diversity, biodiversity metrics, and patterns of biodiversity across several spatial scales. Participating faculty reflected on what went well and what would benefit from changes, and we offer suggestions for implementation of the learning activity based on this feedback. This learning activity introduced students to macroscale ecology and built student skills in working with big data (i.e., large datasets) and performing basic quantitative analyses, skills that are essential for the next generation of ecologists.

     
    more » « less