Search for: All records

This project aims to enhance students’ learning in foundational engineering courses through oral exams based on the research conducted at the University of California San Diego. The adaptive dialogic nature of oral exams provides instructors an opportunity to better understand students’ thought processes, thus holding promise for improving both assessments of conceptual mastery and students’ learning attitudes and strategies. However, the issues of oral exam reliability, validity, and scalability have not been fully addressed. As with any assessment format, careful design is needed to maximize the benefits of oral exams to student learning and minimize the potential concerns. Compared to traditional written exams, oral exams have a unique design space, which involves a large range of parameters, including the type of oral assessment questions, grading criteria, how oral exams are administered, how questions are communicated and presented to the students, how feedback were provided, and other logistical perspectives such as weight of oral exam in overall course grade, frequency of oral assessment, etc. In order to address the scalability for high enrollment classes, key elements of the project are the involvement of the entire instructional team (instructors and teaching assistants). Thus the project will create a new training program to prepare faculty and teaching assistants to administer oral exams that include considerations of issues such as bias and students with disabilities. The purpose of this study is to create a framework to integrate oral exams in core undergraduate engineering courses, complementing existing assessment strategies by (1) creating a guideline to optimize the oral exam design parameters for the best students learning outcomes; and (2) Create a new training program to prepare faculty and teaching assistants to administer oral exams. The project will implement an iterative design strategy using an evidence-based approach of evaluation. The effectiveness of the oral exams will be evaluated by tracking student improvements on conceptual questions across consecutive oral exams in a single course, as well as across other courses. Since its start in January 2021, the project is well underway. In this poster, we will present a summary of the results from year 1: (1) exploration of the oral exam design parameters, and its impact in students’ engagement and perception of oral exams towards learning; (2) the effectiveness of the newly developed instructor and teaching assistants training programs (3) The development of the evaluation instruments to gauge the project success; (4) instructors and teaching assistants experience and perceptions. 

This work-in-progress paper presents an innovative practice of using oral exams to maintain academic integrity and promote student engagement in large-enrollment engineering courses during remote instruction. With the abrupt and widespread transition to distance learning and assessment brought on by the COVID-19 pandemic, there has been a registered upsurge in academic integrity violations globally. To address the challenge of compromised integrity, in the winter quarter of 2021 we have implemented oral exams across six mostly high-enrollment mechanical and electrical engineering undergraduate courses. We present our oral exam design parameters in each of the courses and discuss how oral exams relate to academic integrity, student engagement, stress, and implicit bias. We also address the challenge of scalability, as most of our oral exams were implemented in large classes, where academic integrity and student-instructor disconnection have generally gotten disproportionately worse during remote learning. Our survey results indicate that oral exams have positively contributed to academic integrity in our courses. Based on our preliminary study and experiences, we expect oral exams can be effectively leveraged to hinder cheating and foster academic honesty in students, even when in-person instruction and assessment resumes. 

The Improving Student Experiences to Increase Student Engagement (ISE-2) grant was awarded to Texas A&M University by the National Science Foundation, through EEC-Engineering Diversity Activities (Grant No. 1648016) with the goal of increasing student engagement and retention in the College of Engineering. The major component of the intervention was a faculty development program aimed to increase active learning, improve classroom climates, and decrease implicit bias and deficit thinking. Faculty teaching first- and second-year Engineering courses participated in the ISE-2 faculty development program, with the first cohort (n = 10) in Summer 2017 and the second cohort (n = 5) in Summer 2018. This paper describes the content of each of these components of the faculty development program and provides access to a Google drive (still in development at the time of the abstract) with resources for others to use. The faculty development program consisted of three workshops, a series of coffee hour conversations, and two deliverables from the participants (a teaching plan at the conclusion of the summer training and a final reflection a year following the training). Anchoring the program was a framework for teaching in a diverse classroom (Adams & Love, 2009). Workshop 1 (early May) consisted of an overview of the ISE-2 program. During the first workshop, faculty were introduced to social cognitive biases and the behaviors that result from these biases. During this workshop, the ISE-2 team shared findings from a climate study related to the classroom experiences of students at the College of Engineering. Workshop 2 (mid-May) focused on how undergraduate students learn, provided evidence for the effectiveness of active learning strategies, and exposed faculty participants to active learning strategies. Workshop 3 (early August) integrated the material from the first two workshops as faculty participants prepared to apply the material to their own teaching. Prior to each workshop, the faculty participants were provided with pre-workshop readings to familiarize them with some of the content matter. Coffee hour conversations—informal discussions between the participating faculty and the ISE-2 team centered around a teaching topic selected by participants—were conducted on a near-weekly basis between the second and third workshops. Handouts and worksheets were provided at each coffee hour and served to guide the coffee hour discussions. After the last workshop but before the Fall semester, faculty participants created a teaching plan to incorporate what they learned in the ISE-2 program into their own teaching. At the end of the academic year, the faculty participants are tasked with completing a final reflection on how ISE-2 has affected their teaching in the previous academic year. In this paper, we will report the content of each of the three workshops and explain how these workshops are related to the overarching goals of the ISE-2 program. Then, we will discuss how each of the coffee hour conversation topics complement the material covered in the workshops. Lastly, we will explore the role of the teaching plans and final reflections in changing instructional practices for faculty. 

“Improving Student Experiences to Increase Student Engagement” (ISE-2) was funded by the National Science Foundation, through EEC-Engineering Diversity Activities, at Texas A&M University. The grant activity focuses on a faculty development program for faculty who teach first- and second-year engineering courses. As part of the evaluation plan, classroom observations were conducted by the ISE-2 team to assess the classroom climate and teaching practices of ISE-2 faculty participants and non-participant faculty peers. Since Spring 2017, the team has conducted 78 classroom observations. The ISE-2 evaluation team had expert classroom observers train novice observers. The observer training sessions became the basis of this DIY Classroom Observation Toolkit, which is available for people who are interested in conducting systematic classroom observations but have limited experience with qualitative coding and observational research. The goal of the Toolkit is for these individuals to teach themselves using the Toolkit components: a) an annotated bibliography introducing articles that are helpful to understanding and conducting classroom observations, b) training videos teaching viewers to conduct classroom observations using a protocol, and c) a series of sample classroom videos and validation keys for each of the sample videos. This paper serves as a user manual for the Toolkit, which can be accessed at http://bit.ly/diyclassobtoolkit. 

“Improving Student Experiences to Increase Student Engagement” (ISE-2) was awarded to Texas A&M University by the National Science Foundation, through EEC-Engineering Diversity Activities. ISE-2 is a faculty development program focused on reducing implicit bias and increasing active learning, with the goals of (a) increasing student engagement, success, and retention, and (b) ultimately seeing greater increases for underrepresented minority (URM), women, and first-generation students. Ten faculty teaching first- and second-year Engineering courses participated in the first cohort of ISE-2 in Summer 2017, which consisted of three workshops and six informal “coffee conversations”. At the conclusion of the workshops, each faculty was tasked with completing a teaching plan for the Fall 2017 semester, to incorporate the strategies and knowledge from ISE-2 into the courses they plan to teach. Focus groups with the ISE-2 faculty were conducted in Fall 2017 to obtain feedback about the faculty development program. Classroom observations were conducted using environmental scans and the Classroom Observation Protocol for Undergraduate STEM (COPUS)1 to assess the classroom climate of faculty in the experimental (ISE-2) and control groups. Student surveys were also administered to students who were taught by ISE-2 faculty and control group faculty to assess student engagement and classroom climate. While the project is still ongoing, feedback from faculty regarding ISE-2 have been positive. 

A search for pair production of squarks or gluinos decaying via sleptons or weak bosons is reported. The search targets a final state with exactly two leptons with same-sign electric charge or at least three leptons without any charge requirement. The analysed data set corresponds to an integrated luminosity of 139 fb⁻¹of proton-proton collisions collected at a centre-of-mass energy of 13 TeV with the ATLAS detector at the LHC. Multiple signal regions are defined, targeting several SUSY simplified models yielding the desired final states. A single control region is used to constrain the normalisation of theWZ+ jets background. No significant excess of events over the Standard Model expectation is observed. The results are interpreted in the context of several supersymmetric models featuring R-parity conservation or R-parity violation, yielding exclusion limits surpassing those from previous searches. In models considering gluino (squark) pair production, gluino (squark) masses up to 2.2 (1.7) TeV are excluded at 95% confidence level.

 

A search for supersymmetry targeting the direct production of winos and higgsinos is conducted in final states with either two leptons (eorμ) with the same electric charge, or three leptons. The analysis uses 139 fb⁻¹ofppcollision data at$$ \sqrt{s} $$$\sqrt{s}$= 13 TeV collected with the ATLAS detector during Run 2 of the Large Hadron Collider. No significant excess over the Standard Model expectation is observed. Simplified and complete models with and withoutR-parity conservation are considered. In topologies with intermediate states including eitherWhorWZpairs, wino masses up to 525 GeV and 250 GeV are excluded, respectively, for a bino of vanishing mass. Higgsino masses smaller than 440 GeV are excluded in a naturalR-parity-violating model with bilinear terms. Upper limits on the production cross section of generic events beyond the Standard Model as low as 40 ab are obtained in signal regions optimised for these models and also for anR-parity-violating scenario with baryon-number-violating higgsino decays into top quarks and jets. The analysis significantly improves sensitivity to supersymmetric models and other processes beyond the Standard Model that may contribute to the considered final states.