skip to main content

Title: Evaluating core competencies and learning outcomes for training the next generation of sustainability researchers
The need to train sustainability scientists and engineers to address the complex problems of our world has never been more apparent. We organized an interdisciplinary team of instructors from universities in the states of Maine, New Hampshire, and Rhode Island who designed, taught, and assessed a multi-university course to develop the core competencies necessary for advancing sustainability solutions. Lessons from the course translate across sustainability contexts, but our specific focus was on the issues and trade-offs associated with dams. Dams provide numerous water, energy, and cultural services to society while exacting an ecological toll that disrupts the flow of water, fish, and sediment in rivers. Like many natural resource management challenges, effective dam decisions require collaboration among diverse stakeholders and disciplines. We linked key sustainability principles and practices related to interdisciplinarity, stakeholder engagement, and problem-solving to student learning outcomes that are generalizable beyond our dam-specific context. Students and instructors co-created class activities to build capacity for interdisciplinary collaboration and encourage student leadership and creativity. Assessment results show that students responded positively to activities related to stakeholder engagement and interdisciplinary collaboration, particularly when practicing nested discussion and intrapersonal reflection. These activities helped broaden students’ perspectives on sustainability problems and built greater more » capacity for constructive communication and student leadership. « less
Authors:
; ; ; ; ;
Award ID(s):
1539071
Publication Date:
NSF-PAR ID:
10108388
Journal Name:
Sustainability Science
ISSN:
1862-4065
Sponsoring Org:
National Science Foundation
More Like this
  1. Disasters are becoming more frequent as the global climate changes, and recovery efforts require the cooperation and collaboration of experts and community members across disciplines. The DRRM program, funded through the National Science Foundation (NSF) Research Traineeship (NRT), is an interdisciplinary graduate program that brings together faculty and graduate students from across the university to develop new, transdisciplinary ways of solving disaster-related issues. The core team includes faculty from business, engineering, education, science, and urban planning fields. The overall objective of the program is to create a community of practice amongst the graduate students and faculty to improve understanding and support proactive decision-making related to disasters and disaster management. The specific educational objectives of the program are (1) context mastery and community building, (2) transdisciplinary integration and professional development, and (3) transdisciplinary research. The program’s educational research and assessment activities include program development, trainee learning and development, programmatic educational research, and institutional transformation. The program is now in its fourth year of student enrollment. Core courses on interdisciplinary research methods in disaster resilience are in place, engaging students in domain-specific research related to natural hazards, resilience, and recovery, and in methods of interdisciplinary and transdisciplinary collaboration. In addition to courses,more »the program offers a range of professional development opportunities through seminars and workshops. Since the program’s inception, the core team has expanded both the numbers of faculty and students and the range of academic disciplines involved in the program, including individuals from additional science and engineering fields as well as those from natural resources and the social sciences. At the same time, the breadth of disciplines and the constraints of individual academic programs have posed substantial structural challenges in engaging students in the process of building interdisciplinary research identities and in building the infrastructure needed to sustain the program past the end of the grant. Our poster and paper will identify major program accomplishments, but also draw on interviews with students to examine the structural challenges and potential solution paths associated with a program of this breadth. Critical opportunities for sustainability and engagement have emerged through integration with a larger university-level center as well as through increased flexibility in program requirements and additional mechanisms for student and faculty collaboration.« less
  2. Graduate training often takes a monodisciplinary approach that is not informed by best practices, ignores the needs and preferences of students, and overlooks the increasingly interdisciplinary and international nature of research. This is unfortunate, particularly since graduate education that is fully integrated with interdisciplinary research can help students become part of a trained and diverse workforce equipped to meet society’s many challenges. Against this backdrop, a National Science Foundation Research Traineeship (NRT) program is being established at the University of Kentucky leveraging the most effective instruments for the training of STEM professionals, such as network-based graduate student mentoring and career preparation encompassing both technical and professional skillsets. Briefly, the training graduate students will receive – in a way that is fully integrated with the research they perform – includes: 1) tools such as individual development plans and developmental network maps; 2) a multi-departmental and interdisciplinary course on research-related content; 3) a seminar course on transferrable skills (ethics, research, communication, teaching, mentoring, entrepreneurship, teamwork, management, leadership, outreach, etc.); 4) a certificate to be awarded once students complete the two courses above and garner additional credits from an interdisciplinary curriculum of research-related courses; 5) summer internships at other departments and at externalmore »institutions (other universities, industry, national laboratories) nationwide or abroad; 6) an annual research-related symposium including all elements of a scientific conference; 7) internal collaborative research grants for participants to fund and pursue their own ideas; 8) fields trips to facilities related to the research; and 9) coaching on job hunting as well as résumé, motivation letter and interview preparation. Since a workforce equipped to meet society’s challenges must be both well trained and diverse, multiple initiatives will ensure that this NRT will broaden participation in STEM. Recruitment-wise, close collaboration with a number of entities will provide this NRT with a broad recruitment pool of talented and diverse students. Moreover, collaboration with these entities will provide trainees with ample opportunities to acquire, practice and refine their professional skills, as trainees present their results and recruit in conferences, meetings and outreach events organized by these entities, become members and/or join their leadership, and expand their professional and mentoring network in the process. In addition, minority trainees will be surveyed periodically to probe their feelings of well-being, preparation, acceptance, belonging and distress, as well as their perception of how well structured their departments and programs are. According to recent literature, these factors determine whether or not they perform (i.e., publish) at rates comparable to their male majority peers. Saliently, the evaluation of the educational model employed will afford a comprehensive understanding not only of the academy components that were more utilized and impactful, but will reveal the individual mentoring and skill-building facets of the program driving its successful implementation. The evaluation plan includes outcomes, performance measures, an evaluation timetable, benchmarks and a description of how formative evaluation will improve practice, the evaluation process also extending to research activities.« less
  3. The drive to encourage young people to pursue degrees and careers in engineering has led to an increase in student populations in engineering programs. For some institutions, such as large public research institutions, this has led to large class sizes for courses that are commonly taken across multiple programs. While this decision is reasonable from an operational and resource management perspective, research on large classes have shown that students suffer decreased engagement, motivation and achievement. Instructors, on the other hand, report having difficulty establishing rapport with their students and a growing inability to monitor students’ learning gains and provide quality individualized feedback. To address these issues, our project draws from Lattuca and Stark’s Academic Plan model, which incorporates a thorough consideration of factors influencing curricular activities that can be applied at the course, program, and institutional levels, and assumes that instructors are key actors in curriculum development and revision. We aim to revitalize feedback loops to help instructors and departments continuously improve. Recognizing that we must understand both individual and systems level perspectives, we prioritize regular engagement between faculty and institutional support structures to collaboratively identify problems and systematically establish continuous improvement. In the first phase of this NSF IUSEmore »Institutional Transformation project, we focus on specifically prompting and studying the experiences of 8 instructors of foundational engineering courses usually taught in large class sizes across 4 different departments at a large public research institution. We collected qualitative data (semi-structured interviews, reflective journals, course-related documents) and quantitative data (student surveys and institution-provided transcript data) to answer research questions (e.g., what data do faculty teaching large foundational undergraduate engineering courses identify as being useful so that they may enhance students’ experiences and outcomes within the classes that they teach and across students’ multiple large classes?) at the intersection of learning analytics and faculty change. The data was used as a baseline to further refine data collection protocols, identify data that faculty consider meaningful and useful for managing large foundational engineering courses, and consider ways of productively leveraging institutional data to improve the learning experience in these courses. Data collection for the first phase is ongoing and will continue through the Spring 2018 semester. Findings for this paper will include high-level insights from Fall interviews with instructors as well as data visualizations created from the population-level data characterizing student performance in the foundational courses within the context of pre-college characteristics (e.g., SAT scores) and/or other academic outcomes (e.g., major switching within or out of engineer, degree attainment).« less
  4. One significant barrier to broadening participation in engineering and recruiting future engineers is the pervasive lack of understanding or even misunderstanding of what engineering is and what engineers do. The challenges to broadening participation in engineering are further complicated as underrepresented groups often report constructs, such as cultural milieu and outcome expectations, as more important than interest in influencing career choices. Addressing such issues is difficult and single exposure interventions are unlikely to make engineering careers seem more relevant or attainable for most students. More sustainable interventions, designed to (1) challenge misperceptions and create relevant conceptions of engineering; (2) maintain and expand situational interest; and, (3) integrate with individual interests, values, and social identities, appear to hold more promise for creating significant change. As a possible means of developing more sustainable interventions, our ITEST project partners researchers, teachers, and local industry representatives in creating a series (approximately 6 across an academic year) of engineering-related learning activities for middle school children in three school systems in or near rural Appalachia. Across the first year of implementation, we involved nine teachers, six people working at three different companies and more than 500 students with a series of activities in each classroom. Tomore »examine the impact of our project, we are using mixed methods, including interviews, surveys, classroom observations, and classroom artifacts gathered from multiple project stakeholders, to answer the following research questions: RQ 1: How do participants conceptualize engineering careers? How and why do such perceptions shift throughout the project? RQ 2: What elements of the targeted intervention affect student motivation towards engineering careers specifically with regard to developing competencies and ability beliefs regarding engineering? RQ 3: How can strategic collaboration between K12 and industry promote a shift in teacher’s conceptions of engineers and increased self-efficacy in building and delivering engineering curriculum? RQ 4: How do stakeholder characteristics, perceptions, and dynamics affect the likelihood of sustainability in strategic collaborations between K12 and industry stakeholders? How do prevailing institutional and collaborative conditions mediate sustainability? Our findings to date offer insights across all research questions and have important implications for stakeholders hoping to raise awareness of engineering among youth, particularly in rural areas.« less
  5. Evidence has shown that facilitating student-centered learning (SCL) in STEM classrooms enhances student learning and satisfaction [1]–[3]. However, despite increased support from educational and government bodies to incorporate SCL practices [1], minimal changes have been made in undergraduate STEM curriculum [4]. Faculty often teach as they were taught, relying heavily on traditional lecture-based teaching to disseminate knowledge [4]. Though some faculty express the desire to improve their teaching strategies, they feel limited by a lack of time, training, and incentives [4], [5]. To maximize student learning while minimizing instructor effort to change content, courses can be designed to incorporate simpler, less time-consuming SCL strategies that still have a positive impact on student experience. In this paper, we present one example of utilizing a variety of simple SCL strategies throughout the design and implementation of a 4-week long module. This module focused on introductory tissue engineering concepts and was designed to help students learn foundational knowledge within the field as well as develop critical technical skills. Further, the module sought to develop important professional skills such as problem-solving, teamwork, and communication. During module design and implementation, evidence-based SCL teaching strategies were applied to ensure students developed important knowledge and skills withinmore »the short timeframe. Lectures featured discussion-based active learning exercises to encourage student engagement and peer collaboration [6]–[8]. The module was designed using a situated perspective, acknowledging that knowing is inseparable from doing [9], and therefore each week, the material taught in the two lecture sessions was directly applied to that week’s lab to reinforce students’ conceptual knowledge through hands-on activities and experimental outcomes. Additionally, the majority of assignments served as formative assessments to motivate student performance while providing instructors with feedback to identify misconceptions and make real-time module improvements [10]–[12]. Students anonymously responded to pre- and post-module surveys, which focused on topics such as student motivation for enrolling in the module, module expectations, and prior experience. Students were also surveyed for student satisfaction, learning gains, and graduate student teaching team (GSTT) performance. Data suggests a high level of student satisfaction, as most students’ expectations were met, and often exceeded. Students reported developing a deeper understanding of the field of tissue engineering and learning many of the targeted basic lab skills. In addition to hands-on skills, students gained confidence to participate in research and an appreciation for interacting with and learning from peers. Finally, responses with respect to GSTT performance indicated a perceived emphasis on a learner-centered and knowledge/community-centered approaches over assessment-centeredness [13]. Overall, student feedback indicated that SCL teaching strategies can enhance student learning outcomes and experience, even over the short timeframe of this module. Student recommendations for module improvement focused primarily on modifying the lecture content and laboratory component of the module, and not on changing the teaching strategies employed. The success of this module exemplifies how instructors can implement similar strategies to increase student engagement and encourage in-depth discussions without drastically increasing instructor effort to re-format course content. Introduction.« less