An official website of the United States government
Students can have widely varying experiences while working on CS2 coding projects. Challenging experiences can lead to lower motivation and less success in completing these assignments. In this paper, we identify the common struggles CS2 students face while working on course projects and examine whether or not there is evidence of improvement in these areas of struggle between projects. While previous work has been conducted on understanding the importance of self-regulated learning to student success, it has not been fully investigated in the scope of CS2 coursework. We share our observations on investigating student struggles while working on coding projects through their self-reported response to a project reflection form. We apply emergent coding to identify student struggles at three points during the course and compare them against student actions in the course, such as project start times and office hours participation, to identify if students were overcoming these struggles. Through our coding and analysis we have found that while a majority of students encounter struggles with time management and debugging of failing tests, students tend to emphasize wanting to improve their time management skills in future coding assignments.
more »
« less
GenBio-MAPS as a Case Study to Understand and Address the Effects of Test-Taking Motivation in Low-Stakes Program Assessments
The General Biology–Measuring Achievement and Progression in Science (GenBio-MAPS) assessment measures student understanding of the Vision and Change core concepts at the beginning, middle, and end of undergraduate biology degree programs. Assessment coordinators typically administer this instrument as a low-stakes assignment for which students receive participation credit. While these conditions can elicit high participation rates, it remains unclear how to best measure and account for potential variation in the amount of effort students give to the assessment. To better understand student test-taking motivation, we analyzed GenBio-MAPS data from more than 8000 students at 20 institutions. While the majority of students give acceptable effort, some students exhibited behaviors associated with low motivation, such as low self-reported effort, short test completion time, and high levels of rapid-selection behavior on test questions. Standard least-squares regression models revealed that students’ self-reported effort predicts their observable time-based behaviors and that these motivation indices predict students’ GenBio-MAPS scores. Furthermore, we observed that test-taking behaviors and performance change as students progress through the assessment. We provide recommendations for identifying and filtering out data from students with low test-taking motivation so that the filtered data set better represents student understanding.
more »
« less
- Award ID(s):
- 1610621
- PAR ID:
- 10310464
- Editor(s):
- Long, Tammy
- Date Published:
- Journal Name:
- CBE—Life Sciences Education
- Volume:
- 20
- Issue:
- 2
- ISSN:
- 1931-7913
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
It is no secret that the retention of students majoring in Science, Technology, Engineering, and Mathematics (STEM) has presented itself to be a challenge across the country. The National Science Foundation (NSF) allots substantial funding annually towards this effort. Jackson State University’s (JSU) Students Understanding Chemistry Concepts to Enhance STEM Skills (SUCCESS) Program is one such effort funded by the NSF. While the JSU Department of Biology had over 900 majors in 2016, data suggested that less than 23% would graduate with a bachelor’s degree within six years of entry. According to data obtained, the first four chemistry courses, General Chemistry (I & II) and Organic Chemistry (I & II), were significant barriers to the educational success of many Biology majors. A review of the literature provides many examples of initiatives to improve student retention. A reoccurring theme found that the comprehensive understanding of the students’ experiences within a particular major is essential to determining how best to impact student retention in that department. Student focus groups were implemented to evaluate the perceptions of Biology majors enrolled in Chemistry classes who utilized the SUCCESS Program. The overall impression of students in the SUCCESS Program was that it was helpful and beneficial to their classroom success, increased their confidence to learn Chemistry, and improved their understanding of Chemistry concepts. The students often identified scheduling conflicts as a hindrance to their participation. They also felt that the program was needed to help most students pass their tests.more » « less
-
Students' confusion is a barrier for learning, contributing to loss of motivation and to disengagement with course materials. However, detecting students' confusion in large-scale courses is both time and resource intensive. This paper provides a new approach for confusion detection in online forums that is based on harnessing the power of students' self-reported affective states (reported using a set of pre-defined hashtags). It presents a rule for labeling confusion, based on students' hashtags in their posts, that is shown to align with teachers' judgement. We use this labeling rule to inform the design of an automated classifier for confusion detection for the case when there are no self-reported hashtags present in the test set. We demonstrate this approach in a large scale Biology course using the Nota Bene annotation platform. This work lays the foundation to empower teachers with better support tools for detecting and alleviating confusion in online courses.more » « less
-
null (Ed.)While many studies have demonstrated the efficacy of programs designed to increase underrepresented minority participation, this article establishes a guiding theoretical model which examines why such programs might work. Theoretical models are often used to support curricular innovation by specifying guidelines for how to design new programs intended to broaden participation in STEM. The theoretical model of the Performance Pyramid was used as the foundation to develop intrusive Peer Partnership Learning (PPL) communities and develop a measure of student needs. The PPL communities were designed for students to simultaneously take College Algebra and General Biology I and involved weekly sessions led by trained PPL leaders to reinforce course content and work on biology projects with imbedded math content. The augmented SSNS (SSNS-A) was developed to measures these students needs that are directly related to the Performance Pyramid constructs. In addition, other outcomes measures were selected to identify, analyze and address the barriers to student performance in both courses related to the seven support systems of the Performance Pyramid. This theory-based program was developed to (a) advance and test pedagogical linkages between biological and mathematical concepts; (b) improve, test, and refine the assessment instruments, and (c) test the acceptability and efficacy of a fully integrated biology-math curriculum on student performance and attitudes.more » « less
-
Undergraduate programs in computer science (CS) face high dropout rates, and many students struggle while learning to program. Studies show that perceived programming ability is a significant factor in students' decision to major in CS. Fortunately, psychology research shows that promoting the growth mindset, or the belief that intelligence grows with effort, can improve student persistence and performance. However, mindset interventions have been less successful in CS than in other domains. We conducted a small-scale interview study to explore how CS students talk about their intelligence, mindsets, and programming behaviors. We found that students' mindsets rarely aligned with definitions in the literature; some present mindsets that combine fixed and growth attributes, while others behave in ways that do not align with their mindsets. We also found that students frequently evaluate their self-efficacy by appraising their programming intelligence, using surprising criteria like typing speed and ease of debugging to measure ability. We conducted a survey study with 103 students to explore these self-assessment criteria further, and found that students use varying and conflicting criteria to evaluate intelligence in CS. We believe the criteria that students choose may interact with mindsets and impact their motivation and approach to programming, which could help explain the limited success of mindset interventions in CS.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1187/cbe.20-10-0243
