More Like this

1. Changing the Paradigm: Developing a Framework for Secondary Analysis of EER Qualitative Datasets

   Case, J. ; Matusovich, H. ; Paretti, M. ; Sochacka, N. ; Walther, J. ( August 2022 , 2022 ASEE Annual Conference & Exposition)

   This paper reports on a project funded through the Engineering Education and Centers (EEC) Division of the National Science Foundation. Since 2010, EEC has funded more than 500 proposals totaling over $150 million through engineering education research (EER) programs such as Research in Engineering Education (REE) and Research in the Formation of Engineers (RFE), to enhance understanding and improve practice. The resulting archive of robust qualitative and quantitative data represents a vast untapped potential to exponentially increase the impact of EEC funding and transform engineering education. But tapping this potential has thus far been an intractable problem, despite ongoing calls for data sharing by public funders of research. Changing the paradigm of single-use data collection requires actionable, proven practices for effective, ethical data sharing, coupled with sufficient incentives to both share and use existing data. To that end, this project draws together a team of experts to overcome substantial obstacles in qualitative data sharing by building a framework to guide secondary analysis in engineering education research (EER), and to test this framework using pioneering data sets. Herein, we report on accomplishments within the first year of the project during which time we gathered a group of 13 expert qualitative researchersmore »to engage in the first of a series of working meetings intended to meet our project goals. We came into this first workshop with a potentially limiting definition of secondary data analysis and the idea that people would want to share existing datasets if we could find ways around anticipated hurdles. However, the workshop yielded a broader definition of secondary data analysis and revealed a stronger interest in creating new datasets designed for sharing rather than sharing existing datasets. Thus, we have reconceived our second phase as one that is a cohesive effort based on an inclusive “open cohort model” to pilot projects related to secondary data analysis.« less
2. Surfacing Equity Issues in Large Computing Courses with Peer-Ranked, Demographically-Labeled Student Feedback

   https://doi.org/10.1145/3512912  

   Xie, Benjamin ; Oleson, Alannah ; Everson, Jayne ; Ko, Amy J. ( March 2022 , Proceedings of the ACM on Human-Computer Interaction)

   As computing courses become larger, students of minoritized groups continue to disproportionately face challenges that hinder their academic and professional success (e.g. implicit bias, microaggressions, lack of resources, assumptions of preparatory privilege). This can impact career aspirations and sense of belonging in computing communities. Instructors have the power to make immediate changes to support more equitable learning, but they are often unaware of students' challenges. To help both instructors and students understand the inequities in their classes, we developed StudentAmp, an interactive system that uses student feedback and self-reported demographic information (e.g. gender, ethnicity, disability, educational background) to show challenges and how they affect students differently. To help instructors make sense of feedback, StudentAmp ranks challenges by student-perceived disruptiveness. We conducted formative evaluations with five large college computing courses (150 - 750 students) being taught remotely during the COVID-19 pandemic. We found that students shared challenges beyond the scope of the course, perceived sharing information about who they were as useful but potentially dangerous, and that teaching teams were able to use this information to consider the positionality of students sharing challenges. Our findings relate to a central design tension of supporting equity by sharing contextualized information about students whilemore »also ensuring their privacy and well-being.« less
3. Partnering Undergraduate Engineering Students with Preservice Teachers to Design and Teach an Elementary Engineering Lesson Through Ed+gineering

   Gutierrez, K. ; Ringleb, S. ; Kidd, J. ; Ayala, O. ; Pazos, P. ; Kaipa, K. ( June 2020 , 2020 ASEE Virtual Annual Conference Content Access, Virtual Online)

   Major challenges in engineering education include retention of undergraduate engineering students (UESs) and continued engagement after the first year when concepts increase in difficulty. Additionally, employers, as well as ABET, look for students to demonstrate non-technical skills, including the ability to work successfully in groups, the ability to communicate both within and outside their discipline, and the ability to find information that will help them solve problems and contribute to lifelong learning. Teacher education is also facing challenges given the recent incorporation of engineering practices and core ideas into the Next Generation Science Standards (NGSS) and state level standards of learning. To help teachers meet these standards in their classrooms, education courses for preservice teachers (PSTs) must provide resources and opportunities to increase science and engineering knowledge, and the associated pedagogies. To address these challenges, Ed+gineering, an NSF-funded multidisciplinary collaborative service learning project, was implemented into two sets of paired-classes in engineering and education: a 100 level mechanical engineering class (n = 42) and a foundations class in education (n = 17), and a fluid mechanics class in mechanical engineering technology (n = 23) and a science methods class (n = 15). The paired classes collaborated in multidisciplinary teams ofmore »5-8 undergraduate students to plan and teach engineering lessons to local elementary school students. Teams completed a series of previously tested, scaffolded activities to guide their collaboration. Designing and delivering lessons engaged university students in collaborative processes that promoted social learning, including researching and planning, peer mentoring, teaching and receiving feedback, and reflecting and revising their engineering lesson. The research questions examined in this pilot, mixed-methods research study include: (1) How did PSTs’ Ed+gineering experiences influence their engineering and science knowledge?; (2) How did PSTs’ and UESs’ Ed+gineering experiences influence their pedagogical understanding?; and (3) What were PSTs’ and UESs’ overall perceptions of their Ed+gineering experiences? Both quantitative (e.g., Engineering Design Process assessment, Science Content Knowledge assessment) and qualitative (student reflections) data were used to assess knowledge gains and project perceptions following the semester-long intervention. Findings suggest that the PSTs were more aware and comfortable with the engineering field following lesson development and delivery, and often better able to explain particular science/engineering concepts. Both PSTs and UESs, but especially the latter, came to realize the importance of planning and preparing lessons to be taught to an audience. UESs reported greater appreciation for the work of educators. PSTs and UESs expressed how they learned to work in groups with multidisciplinary members—this is a valuable lesson for their respective professional careers. Yearly, the Ed+gineering research team will also request and review student retention reports in their respective programs to assess project impact.« less
4. Let’s Role Play! the Impact of Video Frequency and Role Playing on the Utility of a Psychological Safety Team Intervention.

   Drum, A. ; Cole, C. ; Ritter, S. ; Mohammed, S. ; Miller, S. ( August 2022 , International Design Engineering Technical Conferences and Computers and Information in Engineering Conference)

   There is growing evidence on the importance of psychological safety, or how comfortable participants feel in sharing their opinions and ideas in a team, in engineering team performance. However, how to support it in engineering student teams has yet to be explored. The goal of this study was to investigate whether a video intervention with assigned roles could foster psychological safety in student engineering teams. In addition, we sought to explore the impact of the frequency of the videos and the utility of the roles on the self-efficacy of students and the perceived psychological safety of the team. Specifically, this study introduces video interventions and the four lenses of psychological safety (Turn-Taking Equalizer, Point of View Shifter, Affirmation Advocate, and Creativity Promoter), and seeks to determine their effectiveness at increasing psychological safety self-efficacy and individual levels of psychological safety. A pilot study was completed with 54 participants (36 males, 17 females, 1 non-binary/third gender) enrolled in a cornerstone engineering design course. Over 10 weeks, data was collected at 5 time points. The results present four key findings. Most notably, 1) a video educating all students about psychological safety in general was effective in improving psychological safety self-efficacy and students retainedmore »this information to the end of the project;2) intervention groups taught to use the four lenses did not have a statistically significant higher level of psychological safety than non- intervention groups; and 3) intervention groups perceived the use of the lenses to increase psychological safety. These results provide a baseline understanding that is needed to support psychological safety including: when to intervene, how to intervene, and how frequently to intervene.« less
5. The State of US Farm Operator Livelihoods

   https://doi.org/10.3389/fsufs.2021.795901  

   Burchfield, Emily K. ; Schumacher, Britta L. ; Spangler, Kaitlyn ; Rissing, Andrea ( February 2022 , Frontiers in Sustainable Food Systems)

   In nine of the last 10 years, the United States Department of Agriculture (USDA) has reported that the average funds generated on-farm for farm operators to meet living expenses and debt obligations have been negative. This paper pieces together disparate data to understand why farm operators in the most productive agricultural systems on the planet are systematically losing money. The data-driven narrative we present highlights some troubling trends in US farm operator livelihoods. Though US farms are more productive than ever before, rising input costs, volatile production values, and rising land rents have left farmers with unprecedented levels of farm debt, low on-farm incomes, and high reliance on federal programs. For many US farm operators, the indicators of a “good livelihood”—stability, security, equitable rewards for work—are largely absent. We conclude by proposing three axes of intervention that would help US agriculture better sustain all farmers' livelihoods, a crucial step toward improving overall agricultural sustainability: (1) increase the diversity of people, crops, and cropping systems, (2) improve equity in access to land, support, and capital, and (3) improve the quality, accessibility, and content of data to facilitate monitoring of multiple indicators of agricultural “success.”