More Like this

1. Composing Team Compositions: An Examination of Instructors’ Current Algorithmic Team Formation Practices

   Emily M. Hastings, Vidushi Ojha ( October 2023 , Proceedings of the ACM on Human-Computer Interaction)

   Jeff Nichols (Ed.)

   Instructors using algorithmic team formation tools must decide which criteria (e.g., skills, demographics, etc.) to use to group students into teams based on their teamwork goals, and have many possible sources from which to draw these configurations (e.g., the literature, other faculty, their students, etc.). However, tools offer considerable flexibility and selecting ineffective configurations can lead to teams that do not collaborate successfully. Due to such tools’ relative novelty, there is currently little knowledge of how instructors choose which of these sources to utilize, how they relate different criteria to their goals for the planned teamwork, or how they determine if their configuration or the generated teams are successful. To close this gap, we conducted a survey (N=77) and interview (N=21) study of instructors using CATME Team-Maker and other criteria-based processes to investigate instructors’ goals and decisions when using team formation tools. The results showed that instructors prioritized students learning to work with diverse teammates and performed “sanity checks” on their formation approach’s output to ensure that the generated teams would support this goal, especially focusing on criteria like gender and race. However, they sometimes struggled to relate their educational goals to specific settings in the tool. In general, they also did not solicit any input from students when configuring the tool, despite acknowledging that this information might be useful. By opening the “black box” of the algorithm to students, more learner-centered approaches to forming teams could therefore be a promising way to provide more support to instructors configuring algorithmic tools while at the same time supporting student agency and learning about teamwork. 

   more » « less
2. Experiences during the implementation of two different project-based learning assignments in a fluid mechanics course.

   Ayala, O. ( August 2022 , Zone 1 Conference of the American Society for Engineering Education)

   There is growing evidence of the effectiveness of project-based learning (PBL) in preparing students to solve complex problems. In PBL implementations in engineering, students are treated as professional engineers facing projects centered around real-world problems, including the complexity and uncertainty that influence such problems. Not only does this help students to analyze and solve an authentic real-world task, promoting critical thinking, but also students learn from each other, learning valuable communication and teamwork skills. Faculty play an important part by assuming non-conventional roles (e.g., client, senior professional engineer, consultant) to help students throughout this instructional and learning approach. Typically in PBLs, students work on projects over extended periods of time that culminate in realistic products or presentations. In order to be successful, students need to learn how to frame a problem, identify stakeholders and their requirements, design and select concepts, test them, and so on. Two different implementations of PBL projects in a fluid mechanics course are presented in this paper. This required, junior-level course has been taught since 2014 by the same instructor. The first PBL project presented is a complete design of pumped pipeline systems for a hypothetical plant. In the second project, engineering students partnered with pre-service teachers to design and teach an elementary school lesson on fluid mechanics concepts. With the PBL implementations, it is expected that students: 1) engage in a deeper learning process where concepts can be reemphasized, and students can realize applicability; 2) develop and practice teamwork skills; 3) learn and practice how to communicate effectively to peers and to those from other fields; and 4) increase their confidence working on open-ended situations and problems. The goal of this paper is to present the experiences of the authors with both PBL implementations. It explains how the projects were scaffolded through the entire semester, including how the sequence of course content was modified, how team dynamics were monitored, the faculty roles, and the end products and presentations. Students' experiences are also presented. To evaluate and compare students’ learning and satisfaction with the team experience between the two PBL implementations, a shortened version of the NCEES FE exam and the Comprehensive Assessment of Team Member Effectiveness (CATME) survey were utilized. Students completed the FE exam during the first week and then again during the last week of the semester in order to assess students’ growth in fluid mechanics knowledge. The CATME survey was completed mid-semester to help faculty identify and address problems within team dynamics, and at the end of the semester to evaluate individual students’ teamwork performance. The results showed that no major differences were observed in terms of the learned fluid mechanics content, however, the data showed interesting preliminary observations regarding teamwork satisfaction. Through reflective assignments (e.g., short answer reflections, focus groups), student perceptions of the PBL implementations are discussed in the paper. Finally, some of the challenges and lessons learned from implementing both projects multiple times, as well as access to some of the PBL course materials and assignments will be provided. 

   more » « less
3. Insights from the First Year of Project # 2044472 “Improving the Conceptual Mastery of Engineering Students in High Enrollment Engineering Courses through Oral Exams

   Qi, H. ; Lubarda M. ; Schurgers C. ; Sandoval C. ; Klement, L. ; Ghazinejad M. ; Relaford-Doyle, J. ; Kim, M. ; Minnes, M. ; Baghdadchi S. ; et al ( June 2022 , ASEE Annual Conference proceedings)

   This project aims to enhance students’ learning in foundational engineering courses through oral exams based on the research conducted at the University of California San Diego. The adaptive dialogic nature of oral exams provides instructors an opportunity to better understand students’ thought processes, thus holding promise for improving both assessments of conceptual mastery and students’ learning attitudes and strategies. However, the issues of oral exam reliability, validity, and scalability have not been fully addressed. As with any assessment format, careful design is needed to maximize the benefits of oral exams to student learning and minimize the potential concerns. Compared to traditional written exams, oral exams have a unique design space, which involves a large range of parameters, including the type of oral assessment questions, grading criteria, how oral exams are administered, how questions are communicated and presented to the students, how feedback were provided, and other logistical perspectives such as weight of oral exam in overall course grade, frequency of oral assessment, etc. In order to address the scalability for high enrollment classes, key elements of the project are the involvement of the entire instructional team (instructors and teaching assistants). Thus the project will create a new training program to prepare faculty and teaching assistants to administer oral exams that include considerations of issues such as bias and students with disabilities. The purpose of this study is to create a framework to integrate oral exams in core undergraduate engineering courses, complementing existing assessment strategies by (1) creating a guideline to optimize the oral exam design parameters for the best students learning outcomes; and (2) Create a new training program to prepare faculty and teaching assistants to administer oral exams. The project will implement an iterative design strategy using an evidence-based approach of evaluation. The effectiveness of the oral exams will be evaluated by tracking student improvements on conceptual questions across consecutive oral exams in a single course, as well as across other courses. Since its start in January 2021, the project is well underway. In this poster, we will present a summary of the results from year 1: (1) exploration of the oral exam design parameters, and its impact in students’ engagement and perception of oral exams towards learning; (2) the effectiveness of the newly developed instructor and teaching assistants training programs (3) The development of the evaluation instruments to gauge the project success; (4) instructors and teaching assistants experience and perceptions. 

   more » « less
4. Operationalizing team commitment in a project-based learning environment

   https://doi.org/10.1109/FIE56618.2022.9962577  

   Jaiswal, Aparajita ; Karabiyik, Tugba ; Thomas, Paul ; Magana, Alejandra J. ( October 2022 , Proceedings of the Frontiers in Education Conference (FIE))

   Commitment is a multi-dimensional construct that has been extensively researched in the context of organizations. Organizational and professional commitment have been positively associated with technical performance, client service, attention to detail, and degree of involvement with one’s job. However, there is a relative dearth of research in terms of team commitment, especially in educational settings. Teamwork is considered a 21stcentury skill and higher education institutions are focusing on helping students to develop teamwork skills by applied projects in the coursework. But studies have demonstrated that creating a team is not enough to help students build teamwork skills. Literature supports the use of team contracts to bolster commitment, among team members. However, the relationship between team contracts and team commitment has not been formally operationalized.This research category study presents a mixed-methods approach towards characterizing and operationalizing team commitment exhibited by students enrolled in a sophomore-level systems analysis and design course by analyzing team contracts and team retrospective reflections. The course covers concepts pertaining to information systems development and includes a semester-long team project where the students work together in four or five member teams to develop the project deliverables. The students have prior software development experiences through an introductory systems development course as well as multiple programming courses. The data for this study was collected through the team contracts signed by students belonging to one of the 23 teams of this course. The study aims to answer the following research question: How can team commitment be characterized in a sophomore-level system analysis and design course among the student teams?A rubric was developed to quantify the team commitment levels of students based on their responses on the team contracts. Students were classified as high or low commitment based on the rubric scores. The emergent themes of high and low commitment teams were also presented. The results indicated that the high commitment teams were focused on setting goals, effective communication, and having mechanisms in place for timely feedback and improvement. On the other hand, low commitment teams did not articulate the goals of the project, they demonstrated a lack of dedication for attending team meetings regularly, working as a team, and had a lack of proper coordination while working together. 

   more » « less
5. A Longitudinal Study of the Integration of Writing Support in a Multi-Semester Senior Capstone Course

   Pflueger, Ruth C. ; Meckley, Jonathan A. ( March 2022 , 2022 ASEE North Central Section Annual Conference)

   ABET lists the ability to communicate in writing to both technical and non-technical audiences as a required outcome for baccalaureate engineering students [1]. From emails and memos to formal reports, the ability to communicate is vital to the engineering profession. This Work in Progress paper describes research being done as part of an NSF-funded project, Writing Assignment Tutor Training in STEM (WATTS). The method is designed to improve feedback writing tutors without technical backgrounds give to engineering students on technical reports. Students in engineering programs have few opportunities to develop their writing skills. Usually, composition courses are part of the general education curriculum. Students often see these courses as unrelated to their majors and careers [2]. Ideally, writing support should be integrated throughout a program. Since WATTs capitalizes on existing resources and requires only a modest amount of faculty time, it could enable engineering programs to provide additional writing support to students in multiple courses and provide a bridge for them to see the connection between writing concepts learned in composition courses and their technical reports. WATTS was developed in a junior-level circuit analysis course, where students were completing the same lab and writing individual reports. This paper focuses on a senior capstone course that utilizes concepts taught in previous courses to prepare students to complete an independent team research or design project. Projects are unique, usually based on the needs of an industrial sponsor, and are completed over three consecutive semesters. Each semester, teams write a report based on their activities during that semester, with a comprehensive report in the final semester. The multi-semester nature of the senior design project provides an opportunity for the researchers to chart longitudinal changes from the first to the students’ third semester interactions with the writing tutors, assessing the value of an integrated approach. The program’s impact on students’ attitudes toward revision and the value of tutoring, as well as the impact on tutors, are part of the assessment plan. The program hopes to change the students’ focus from simply presenting their results to communicating them. The goals of the project are to demonstrate to students that revision is essential to the writing process and that feedback can improve their written communication abilities. The expectation is that after graduation they will continue to seek critical feedback as part of their career growth. Surveys given to both students and tutors revealed that the sessions were taken seriously by the students and that meaningful collaboration was achieved between them. An evaluation of the writing in pre-tutored to final submitted report shows statistically significant improvement. Preliminary and current results will be included within the paper. [1] Criteria for Accrediting Engineering Technology Programs, ABET, Baltimore, MD., 2020, p.5, ETAC Criteria (abet.org) [2] Bergmann, L. S. and Zepernick, J., “Disciplinarity and Transfer: Students’ Perceptions of Learning to Write,” Writing Program Administration, 31, Fall/Winter 2007. 

   more » « less