An official website of the United States government
Writing Assignment Tutor Training in STEM (WATTS) is part of a three-year NSF IUSE grant with participants at three institutions. This research project seeks to determine to what extent students in the WATTS project show greater writing improvement than students using writing tutors not trained in WATTS. The team collected baseline, control, and experimental data. Baseline data included reports written by engineering and engineering technology students with no intervention to determine if there were variations in written communication related to student demographics and institutions. Control data included reports written by students who visited tutors with no WATTS training, and experimental data included reports written by students who visited tutors who were WATTS-trained. Reports were evaluated by the research team using a slightly modified version of the American Association of Colleges and Universities (AAC&U) Written Communication VALUE Rubric. Baseline data assessment also provided an opportunity to test the effectiveness of the rubric. This paper presents findings from the analysis of the control and experimental data to determine the impact of WATTS on student writing in lab reports. An aggregate score for each lab report was determined by averaging the reviewer scores. An analysis was run to determine if there was a statistical difference between pre-tutoring lab report scores from the baseline, control, and experimental rubric scores for each criterion and total scores; there was not a statistically significant difference. The research team ran a Wilcoxon signed-rank test to assess the relationship between control and experimental aggregate rubric scores for each criterion. The preliminary analysis of the control and experimental data shows that the WATTS intervention has a positive, statistically significant impact on written communication skills regardless of the campus student demographics. Since WATTS has been shown to be a low-cost, effective intervention to improve engineering and engineering technology students’ written communication skills at these participating campuses, it has potential use for other institutions to positively impact their students’ written communication.
more »
« less
Preliminary Analyses (WIP): Patterns in Student Response to a Team Communication Intervention
This work-in-progress paper reports on the assessment of an intervention on team communication and decision making processes to see whether such an intervention is related to improvement in the rating of equity of idea contributions. A hierarchical linear model was fit to teamwork data from 3,721 students in 40 courses. We find that students’ reports of equitable idea sharing are actually lower after the intervention than before; we hypothesize that the decreased rating might reflect increased student awareness of inequities rather than a true decrease in equitable idea sharing. This pattern held for most gender and racial groups, with the notable exception of non-binary students, who instead reported greater idea equity post-intervention, though we note the small sample size for this group. Finally, we find that decreases in reported idea sharing were largest when students reported the intervention was “highly relevant” to their team yet “not very helpful”.
more »
« less
- Award ID(s):
- 2120252
- PAR ID:
- 10347050
- Date Published:
- Journal Name:
- American Society for Engineering Education (ASEE) Annual Conference & Exposition
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Writing Assignment Tutor Training in STEM (WATTS) is part of a three-year NSF IUSE grant with participants at three institutions. This research project seeks to determine to what extent students in the WATTS project show greater writing improvement than students using writing tutors not trained in WATTS. The team collected baseline, control, and experimental data. Baseline data included reports written by engineering and engineering technology students with no intervention to determine if there were variations in written communication related to student demographics and institutions. Control data included reports written by students who visited tutors with no WATTS training, and experimental data included reports written by students who visited tutors who were WATTS-trained. Reports were evaluated by the research team using a slightly modified version of the American Association of Colleges and Universities (AAC&U) Written Communication VALUE Rubric. Baseline data assessment also provided an opportunity to test the effectiveness of the rubric. This paper presents findings from the analysis of the control and experimental data to determine the impact of WATTS on student writing in lab reports. An aggregate score for each lab report was determined by averaging the reviewer scores. An analysis was run to determine if there was a statistical difference between pre-tutoring lab report scores from the baseline, control, and experimental rubric scores for each criterion and total scores; there was not a statistically significant difference. The research team ran a Wilcoxon signed-rank test to assess the relationship between control and experimental aggregate rubric scores for each criterion. The preliminary analysis of the control and experimental data shows that the WATTS intervention has a positive, statistically significant impact on written communication skills regardless of the campus student demographics. Since WATTS has been shown to be a low-cost, effective intervention to improve engineering and engineering technology students’ written communication skills at these participating campuses, it has potential use for other institutions to positively impact their students’ written communication.more » « less
-
Writing Assignment Tutor Training in STEM (WATTS) is part of a three-year NSF IUSE grant with participants at three institutions. This research project seeks to determine to what extent students in the WATTS project show greater writing improvement than students using writing tutors not trained in WATTS. The team collected baseline, control, and experimental data. Baseline data included reports written by engineering and engineering technology students with no intervention to determine if there were variations in written communication related to student demographics and institutions. Control data included reports written by students who visited tutors with no WATTS training, and experimental data included reports written by students who visited tutors who were WATTS-trained. Reports were evaluated by the research team using a slightly modified version of the American Association of Colleges and Universities (AAC&U) Written Communication VALUE Rubric. Baseline data assessment also provided an opportunity to test the effectiveness of the rubric. This paper presents findings from the analysis of the control and experimental data to determine the impact of WATTS on student writing in lab reports. An aggregate score for each lab report was determined by averaging the reviewer scores. An analysis was run to determine if there was a statistical difference between pre-tutoring lab report scores from the baseline, control, and experimental rubric scores for each criterion and total scores; there was not a statistically significant difference. The research team ran a Wilcoxon signed-rank test to assess the relationship between control and experimental aggregate rubric scores for each criterion. The preliminary analysis of the control and experimental data shows that the WATTS intervention has a positive, statistically significant impact on written communication skills regardless of the campus student demographics. Since WATTS has been shown to be a low-cost, effective intervention to improve engineering and engineering technology students’ written communication skills at these participating campuses, it has potential use for other institutions to positively impact their students’ written communication. This material is based upon work supported by the National Science Foundation under Grant Nos. 2013467, 2013496, and 2013541.more » « less
-
Problem. Currently, state- and district-level policies in the United States call for teachers to be qualified to teach computing in K-12 classrooms. Recognizing that equity-focused practices are key to reaching all students in computing and leveraging a researcher-practitioner partnership (RPP), we piloted an intervention designed to provide one-on-one coaching to teachers. Research Question. Our research questions for this project were: 1) What impact does CS coaching have on teacher capacity to implement equitable teaching practices? and 2) What, if any, changes to teacher practice are sustained during and after the CS coaching process? Methodology. Our mixed-methods study leveraged three primary forms of data from teachers who were coached (coachees) and teachers providing coaching (coaches). These included pre- and post-surveys, coaching logs, and self-reflection checklists. Findings. Participants reported use of high-impact instructional design and classroom practices increased significantly from pre- to post-intervention. Their abilities to discuss topics of identity and plan activities that use evidence-based, CS-specific teaching strategies saw the most dramatic increase from pre- to post-intervention. Implications. Coaching may be an impactful way to develop teacher’s use of equitable teaching practices.more » « less
-
This study analyzes the impact of the Chicago Alliance for Equity in Computer Science (CAFÉCS) Research Practice Partnership (RPP) on the Chicago Public School (CPS) Office of Computer Science (OCS). Using a qualitative analysis drawing on data from leadership team meetings, published articles and presentations, and evaluation reports from 11 years of the partnership, we utilized a framework developed by the CAFÉCS leadership team to document the impact on district (1) Programs, (2) Research, (3) Organizational Structures, and (4) Policies leading to (5) Equitable Results for students, condensed as PROSPER. In particular, we explore the role of the RPP in supporting a 500% increase in graduating students who completed at least one high school computer science (CS) course between 2016 and 2020 in Chicago Public Schools (CPS). This study adds to the existing literature on assessing the impact of RPPs through the development of the PROSPER Framework, which may be a useful tool to help RPPs examine impacts on partner districts.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
