This paper presents the initial work of a recently funded NSF project on ethical and responsible research and practices in science and engineering. The objective of this research is to improve instructor training, interventions, and student outcomes in high schools and universities to improve awareness and commitment to ethical practices in STEM coursework. The project will generate a robust snapshot of the ethical knowledge, reasoning skills, attitudes, and practices of several thousand undergraduate engineering students. This snapshot will inform the development of a three-week enrichment opportunity for high school STEM teachers. Working with university faculty and graduate students, these teachers will develop learning modules on ethical issues related to their courses. The snapshot will also identify gaps and guide the creation of targeted interventions that will be used in second-, third-, and fourth-year engineering courses.
This data-driven project uses a mixed-methods approach to generate a better understanding of the impact of ethics interventions at various points in a student's academic development by developing and using a set of instruments to measure cognitive, affective, and behavioral aspects of ethical competency and self-efficacy. To that end, a second snapshot will be taken by testing and surveying engineering students in their capstone courses to provide a broad overview of the competence and self-confidence that engineering students have in dealing with ethical STEM issues, to determine the efficacy of various interventions, and to improve future interventions. Utilizing repeated measures and possessing a longitudinal dimension, the project will generate extensive data about the development of ethical competency, ethical self-efficacy, and their relationship. The interventions designed for secondary and tertiary classrooms will build on best practices for micro-insertion of ethics content that are practical and help students understand how technical competencies fit within broader social, economic, and environmental contexts. The capstone snapshot will also provide some measure of the impact of other experiences (e.g., undergraduate research, internships, service learning) and courses (e.g., humanities, social science, and business courses) on development of ethical practices. This report marks the start of a five-year project; therefore, the results presented in this paper represent findings from the engineering ethics literature and baseline results from survey of engineering freshmen at Texas A&M University. The findings from the survey are being utilized in developing intervention modules that will be integrated in upper-level engineering courses and training materials for high school teachers.
more »
« less
Efficiently exploring the causal role of contextual moderators in behavioral science
Behavioral science interventions have the potential to address longstanding policy problems, but their effects are typically heterogeneous across contexts (e.g., teachers, schools, and geographic regions). This contextual heterogeneity is poorly understood, however, which reduces the field’s impact and its understanding of mechanisms. Here, we present an efficient way to interrogate heterogeneity and address these gaps in knowledge. This method a) presents scenarios that vividly represent different moderating contexts, b) measures a short-term behavioral outcome (e.g., an academic choice) that is known to relate to typical intervention outcomes (e.g., academic achievement), and c) assesses the causal effect of the moderating context on the link between the psychological variable typically targeted by interventions and this short-term outcome. We illustrated the utility of this approach across four experiments (total n = 3,235) that directly tested contextual moderators of the links between growth mindset, which is the belief that ability can be developed, and students’ academic choices. The present results showed that teachers’ growth mindset-supportive messages and the structural opportunities they provide moderated the link between students’ mindsets and their choices (studies 1 to 3). This pattern was replicated in a nationally representative sample of adolescents and did not vary across demographic subgroups (study 2), nor was this pattern the result of several possible confounds (studies 3 to 4). Discussion centers on how this method of interrogating contextual heterogeneity can be applied to other behavioral science interventions and broaden their impact in other policy domains.
more »
« less
- Award ID(s):
- 2004831
- NSF-PAR ID:
- 10433157
- Date Published:
- Journal Name:
- Proceedings of the National Academy of Sciences
- Volume:
- 120
- Issue:
- 1
- ISSN:
- 0027-8424
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
Abstract Growth mindset interventions directed at students aim to change students' beliefs about the malleability of ability. These interventions have had mixed results, with some showing impressive findings (e.g., improving grades and persistence in science and closing performance gaps), while other implementations have shown null findings. This heterogeneity suggests that growth mindset interventions should not be viewed as a sole solution for improving educational outcomes for students and that further research is needed to identify the contextual factors that influence their effectiveness. We propose new theoretical directions in mindset research that adopts an anti‐deficit model and moves away from focusing exclusively on students and their belief systems. Instead, we encourage a new wave of mindset research that considers the institutional, cultural, and contextual environment that either corroborates or negates students' mindset beliefs. We propose a new approach to mindset research that emphasizes innovative approaches to better understand the conditions under which mindset interventions are effective.
-
more » « less
Abstract Educational outcomes remain highly unequal within and across nations. Students’ mindsets—their beliefs about whether intellectual abilities can be developed—have been identified as a potential lever for making adolescents’ academic outcomes more equitable. Recent research, however, suggests that intervention programs aimed at changing students’ mindsets should be supplemented by programs aimed at the changing the mindset
culture , which is defined as the shared set of beliefs about learning in a school or classroom. This paper reviews the theoretical and empirical origin of the mindset culture and examines its potential to reduce group-based inequalities in education. In particular, experiments have identified two broad ways the mindset culture is communicated by teachers: via informalmessages about growth (e.g., that all students will be helped to learn and succeed), and formalopportunities to improve (e.g., learning-focused grading policies and opportunities to revise and earn credit). New field experiments, applying techniques from behavioral science, have also revealed effective ways to influence teachers’ culture-creating behaviors. This paper describes recent breakthroughs in the U.S. educational context and discusses how lessons from these studies might be applied in future, global collaborations with researchers and practitioners. -
more » « less
Abstract This paper describes a Human‐Centred Learning Analytics (HCLA) design approach for developing learning analytics (LA) dashboards for K‐12 classrooms that maintain both contextual relevance and scalability—two goals that are often in competition. Using mixed methods, we collected observational and interview data from teacher partners and assessment data from their students' engagement with the lesson materials. This DBR‐based, human‐centred design process resulted in a dashboard that supported teachers in addressing their students' learning needs. To develop the dashboard features that could support teachers, we found that a design refinement process that drew on the insights of teachers with varying teaching experience, philosophies and teaching contexts strengthened the resulting outcome. The versatile nature of the approach, in terms of student learning outcomes, makes it useful for HCLA design efforts across diverse K‐12 educational contexts.
Practitioner notes What is already known about this topic
Learning analytics that are aligned to both a learning theory and learning design support student learning.
LA dashboards that support users to understand the associated learning analytics data provide actionable insight.
Design‐based research is a promising methodology for Human‐Centred Learning Analytics design, particularly in the K‐12 educational context.
What this paper adds
Leveraging a longstanding, yet fluid, research‐practice partnership is an effective design‐based research adaptation for addressing the high variation in instructional practices that characterize K‐12 education.
Using both quantitative and qualitative data that reflects students' developing knowledge effectively supports teachers' inquiry into student learning.
Teachers' use of learning analytics dashboards is heavily influenced by their perspectives on teaching and learning.
Implications for practice and/or policy
Impact on student learning outcomes, alongside usability and feasibility, should be included as a necessary metric for the effectiveness of LA design.
LA dashboard developers should both leverage learning data that reflect students' developing knowledge and position teachers to take responsive pedagogical action to support student learning.
LA researchers and developers should utilize a long‐term, yet fluid, research‐practice partnership to form a multi‐stakeholder, multidisciplinary design team for Human‐Centred Learning Analytics design.
-
Beliefs play a central role in human development. For instance, a growth mindset—a belief about the malleability of intelligence—can shape how adolescents interpret and respond to academic difficulties and how they subsequently navigate the educational system. But do usually-adaptive beliefs have the same effects for adolescents regardless of the contexts they are in? Answering this question can reveal new insights into classic developmental questions about continuity and change. Here we present the Mindset × Context framework and we apply this model to the instructive case of growth mindset interventions. We show that teaching students a growth mindset is most effective in educational contexts that provide affordances for a growth mindset; that is, contexts that permit and encourage students to view ability as developable and to act on that belief. This evidence contradicts the “beliefs alone” hypothesis, which holds that teaching adolescents a growth mindset is enough and that students can profit from these beliefs in almost any context, even unsupportive ones. The Mindset × Context framework leads to the realization that in order to produce more widespread and lasting change, we must complement the belief-changing interventions that have been aimed at students with new interventions that guide teachers toward classroom policies and practices that allow students' growth mindset beliefs to take root and yield benefits.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1073/pnas.2216315120
