skip to main content


Title: All the Pieces Matter: The Relationship of Momentary Self-efficacy and Affective Experiences with CS1 Achievement and Interest in Computing
There are significant participation gaps in computing, and the way to address these participation gaps lies not simply in getting students from underrepresented groups into a CS1 classroom, but supporting students to pursue their interest in computing further beyond CS1. There are many factors that may influence students’ pursuit of computing beyond introductory courses, including their sense that they can do what CS courses require of them (their self-efficacy) and positive emotional experiences in CS courses. When interest has been addressed in computing education, research has treated it mostly as an outcome of particular pedagogical approaches or curricula; what has not been studied is how students’ longer-term interest develops through more granular experiences that students have as they begin to engage with computing. In this paper, we present the results of a study designed to investigate how students’ interest in computing develops as a product of their momentary self-efficacy and affective experiences. Using a methodology that is relatively uncommon to computer science education—the experience sampling method, which involves frequently asking students brief, unobtrusive questions about their experiences—we surveyed CS1 students every week over the course of a semester to capture the nuances of their experiences. 74 CS1 students responded 14-18 times over the course of a semester about their self-efficacy, frustration, and situational interest. With this data, we used a multivariate, multi-level statistical model that allowed us to estimate how students’ granular, momentary experiences (measured through the experience sampling method surveys) and initial interest, self-efficacy, and self-reported gender (measured through traditional surveys) relate to their longer-term interest and achievement in the course. We found that students’ momentary experiences have a significant impact on their interest in computing and course outcomes, even controlling for the self-efficacy and interest students reported at the beginning of the semester. We also found significant gender differences in students’ momentary experiences, however, these were reduced substantially when students’ self-efficacy was added to the model, suggesting that gender gaps could instead be self-efficacy gaps. These results suggest that students’ momentary experiences in CS1, how they experience the course week to week, have an impact on their longer-term interest and learning outcomes. Furthermore, we found that male and female students reported different experiences, suggesting that improving the CS1 experiences that students have could help to close gender-related participation gaps. In all, this study shows that the granular experiences students have in CS1 matter for key outcomes of interest to computing education researchers and educators and that the experience sampling method, more common in fields adjacent to computer science education, provides one way for researchers to integrate the experiences students have into our accounts of why students become interested in computing.  more » « less
Award ID(s):
1937700
NSF-PAR ID:
10288353
Author(s) / Creator(s):
;
Editor(s):
Ko, A. K.
Date Published:
Journal Name:
Proceedings of the 17th ACM Conference on International Computing Education Research
Page Range / eLocation ID:
252 to 265
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Computer Science (CS) is not introduced equitably across K-12 schools, yet it is increasingly a necessary skill regardless of vocational pathway. Co-curricular activities such as summer camps have become a popular way to introduce CS to K-12 students. Researchers at our institution, through partnerships with other educational institutions and practitioners, developed a transdisciplinary approach of teaching CS in K-12 informal learning environments. Building on positive results in the K-12 informal learning environment, researchers are exploring the applicability of the transdisciplinary modules in formal instruction for early college learners in CS0 and CS1 courses. This paper explores self-efficacy data collected from multiple CS0 and CS1 courses. Learners include freshmen in computing majors and in non-computing majors. We compare their self efficacy growth in computing across race and gender, considering their formal or informal CS education experiences prior to entering college. This work is a part of a larger effort to redesign CS0 and CS1 courses to introduce more complex concepts and important design concepts such as parallel and distributed computing earlier in the curriculum. The authors’ longer-term goal is to investigate active learning strategies that will introduce higher level computer science topics early in the curriculum to enable students to recognize content applicability earlier in their college pathway. 
    more » « less
  2. Need/Motivation (e.g., goals, gaps in knowledge) The ESTEEM implemented a STEM building capacity project through students’ early access to a sustainable and innovative STEM Stepping Stones, called Micro-Internships (MI). The goal is to reap key benefits of a full-length internship and undergraduate research experiences in an abbreviated format, including access, success, degree completion, transfer, and recruiting and retaining more Latinx and underrepresented students into the STEM workforce. The MIs are designed with the goals to provide opportunities for students at a community college and HSI, with authentic STEM research and applied learning experiences (ALE), support for appropriate STEM pathway/career, preparation and confidence to succeed in STEM and engage in summer long REUs, and with improved outcomes. The MI projects are accessible early to more students and build momentum to better overcome critical obstacles to success. The MIs are shorter, flexibly scheduled throughout the year, easily accessible, and participation in multiple MI is encouraged. ESTEEM also establishes a sustainable and collaborative model, working with partners from BSCS Science Education, for MI’s mentor, training, compliance, and building capacity, with shared values and practices to maximize the improvement of student outcomes. New Knowledge (e.g., hypothesis, research questions) Research indicates that REU/internship experiences can be particularly powerful for students from Latinx and underrepresented groups in STEM. However, those experiences are difficult to access for many HSI-community college students (85% of our students hold off-campus jobs), and lack of confidence is a barrier for a majority of our students. The gap between those who can and those who cannot is the “internship access gap.” This project is at a central California Community College (CCC) and HSI, the only affordable post-secondary option in a region serving a historically underrepresented population in STEM, including 75% Hispanic, and 87% have not completed college. MI is designed to reduce inequalities inherent in the internship paradigm by providing access to professional and research skills for those underserved students. The MI has been designed to reduce barriers by offering: shorter duration (25 contact hours); flexible timing (one week to once a week over many weeks); open access/large group; and proximal location (on-campus). MI mentors participate in week-long summer workshops and ongoing monthly community of practice with the goal of co-constructing a shared vision, engaging in conversations about pedagogy and learning, and sustaining the MI program going forward. Approach (e.g., objectives/specific aims, research methodologies, and analysis) Research Question and Methodology: We want to know: How does participation in a micro-internship affect students’ interest and confidence to pursue STEM? We used a mixed-methods design triangulating quantitative Likert-style survey data with interpretive coding of open-responses to reveal themes in students’ motivations, attitudes toward STEM, and confidence. Participants: The study sampled students enrolled either part-time or full-time at the community college. Although each MI was classified within STEM, they were open to any interested student in any major. Demographically, participants self-identified as 70% Hispanic/Latinx, 13% Mixed-Race, and 42 female. Instrument: Student surveys were developed from two previously validated instruments that examine the impact of the MI intervention on student interest in STEM careers and pursuing internships/REUs. Also, the pre- and post (every e months to assess longitudinal outcomes) -surveys included relevant open response prompts. The surveys collected students’ demographics; interest, confidence, and motivation in pursuing a career in STEM; perceived obstacles; and past experiences with internships and MIs. 171 students responded to the pre-survey at the time of submission. Outcomes (e.g., preliminary findings, accomplishments to date) Because we just finished year 1, we lack at this time longitudinal data to reveal if student confidence is maintained over time and whether or not students are more likely to (i) enroll in more internships, (ii) transfer to a four-year university, or (iii) shorten the time it takes for degree attainment. For short term outcomes, students significantly Increased their confidence to continue pursuing opportunities to develop within the STEM pipeline, including full-length internships, completing STEM degrees, and applying for jobs in STEM. For example, using a 2-tailed t-test we compared means before and after the MI experience. 15 out of 16 questions that showed improvement in scores were related to student confidence to pursue STEM or perceived enjoyment of a STEM career. Finding from the free-response questions, showed that the majority of students reported enrolling in the MI to gain knowledge and experience. After the MI, 66% of students reported having gained valuable knowledge and experience, and 35% of students spoke about gaining confidence and/or momentum to pursue STEM as a career. Broader Impacts (e.g., the participation of underrepresented minorities in STEM; development of a diverse STEM workforce, enhanced infrastructure for research and education) The ESTEEM project has the potential for a transformational impact on STEM undergraduate education’s access and success for underrepresented and Latinx community college students, as well as for STEM capacity building at Hartnell College, a CCC and HSI, for students, faculty, professionals, and processes that foster research in STEM and education. Through sharing and transfer abilities of the ESTEEM model to similar institutions, the project has the potential to change the way students are served at an early and critical stage of their higher education experience at CCC, where one in every five community college student in the nation attends a CCC, over 67% of CCC students identify themselves with ethnic backgrounds that are not White, and 40 to 50% of University of California and California State University graduates in STEM started at a CCC, thus making it a key leverage point for recruiting and retaining a more diverse STEM workforce. 
    more » « less
  3. The STEM Excellence through Engagement in Collaboration, Research, and Scholarship (SEECRS) project at Whatcom Community College is a five-year program aiming to support academically talented students with demonstrated financial need in biology, chemistry, geology, computer science, engineering, and physics. This project is funded by an NSF S-STEM (Scholarships in Science, Technology, Engineering, and Mathematics) grant awarded in January 2017. Through an inclusive and long-range effort, the college identified a strong need for financial and comprehensive supports for STEM students. This project will offer financial, academic, and professional support to three two-year cohorts of students. The SEECRS project aims to utilize a STEM-specific guided pathways approach to strengthen recruitment, retention, and matriculation of STEM students at the community college level. Scholarship recipients will be supported through participation in the SEECRS Scholars Academy, a multi-pronged approach to student support combining elements of community building, faculty mentorship, targeted advising activities, authentic science practice, and social activities. Students are introduced to disciplines of interest through opportunities to engage in course-based undergraduate research experiences (CUREs) in Biology, Chemistry and Engineering courses, funded summer research opportunities, and seminars presented by STEM professionals. Communities of practice will be nurtured through the introduction of cohort building and faculty mentorship. Cohort development starts with a required two-credit course for all scholars that emphasizes STEM identity development, specifically focusing on identifying and coping with the ways non-dominant individuals (racial/ethnic minorities, non-male gender, lower socioeconomic status, first-generation, 2-year community college vs. 4-year institutions) are made to feel as outsiders in STEM. Each SEECRS scholar is paired with a faculty mentor who engages in ongoing mentor training. The project evaluation will determine the efficacy of the project activities in achieving their intended outcomes. Specifically, we will collect data to answer the research question: To what extent can a guided pathways approach provide a coordinated and supported STEM experience at Whatcom Community College that: (1) increases student success, and (2) positively shifts students’ STEM self-identity? The evaluation will employ a quasi-experimental research design, specifically a pretest-posttest design with a matched comparison group. Our first cohort of 14 students was selected over two application rounds (winter and summer 2017). We awarded ten full scholarships and four half-scholarships based on financial need data. Cohort demographics of note compared to institutional percentages are: females (64% vs. 57%), Hispanic (14% vs. 17%), African American (7% vs. 2%), white (79% vs. 66%), first generation college bound (43% vs. 37%). The cohort is comprised of six students interested in engineering, six in biology, and one each in geology and environmental sciences. With increased communication between the project team, our Financial Aid office, Entry and Advising, high school outreach, and the Title III grant-funded Achieve, Inspire, Motivate (AIM) Program, as well as a longer advertising time, we anticipate significantly enhancing our applicant pool for the next cohort. The results and lessons learned from our first year of implementation will be presented. 
    more » « less
  4. The STEM Excellence through Engagement in Collaboration, Research, and Scholarship (SEECRS) project at Whatcom Community College is a five-year program aiming to support academically talented students with demonstrated financial need in biology, chemistry, geology, computer science, engineering, and physics. This project is funded by an NSF S-STEM (Scholarships in Science, Technology, Engineering, and Mathematics) grant awarded in January 2017. Through an inclusive and long-range effort, the college identified a strong need for financial and comprehensive supports for STEM students. This project will offer financial, academic, and professional support to three two-year cohorts of students. The SEECRS project aims to utilize a STEM-specific guided pathways approach to strengthen recruitment, retention, and matriculation of STEM students at the community college level. Scholarship recipients will be supported through participation in the SEECRS Scholars Academy, a multi-pronged approach to student support combining elements of community building, faculty mentorship, targeted advising activities, authentic science practice, and social activities. Students are introduced to disciplines of interest through opportunities to engage in course-based undergraduate research experiences (CUREs) in Biology, Chemistry and Engineering courses, funded summer research opportunities, and seminars presented by STEM professionals. Communities of practice will be nurtured through the introduction of cohort building and faculty mentorship. Cohort development starts with a required two-credit course for all scholars that emphasizes STEM identity development, specifically focusing on identifying and coping with the ways non-dominant individuals (racial/ethnic minorities, non-male gender, lower socioeconomic status, first-generation, 2-year community college vs. 4-year institutions) are made to feel as outsiders in STEM. Each SEECRS scholar is paired with a faculty mentor who engages in ongoing mentor training. The project evaluation will determine the efficacy of the project activities in achieving their intended outcomes. Specifically, we will collect data to answer the research question: To what extent can a guided pathways approach provide a coordinated and supported STEM experience at Whatcom Community College that: (1) increases student success, and (2) positively shifts students’ STEM self-identity? The evaluation will employ a quasi-experimental research design, specifically a pretest-posttest design with a matched comparison group. Our first cohort of 14 students was selected over two application rounds (winter and summer 2017). We awarded ten full scholarships and four half-scholarships based on financial need data. Cohort demographics of note compared to institutional percentages are: females (64% vs. 57%), Hispanic (14% vs. 17%), African American (7% vs. 2%), white (79% vs. 66%), first generation college bound (43% vs. 37%). The cohort is comprised of six students interested in engineering, six in biology, and one each in geology and environmental sciences. With increased communication between the project team, our Financial Aid office, Entry and Advising, high school outreach, and the Title III grant-funded Achieve, Inspire, Motivate (AIM) Program, as well as a longer advertising time, we anticipate significantly enhancing our applicant pool for the next cohort. The results and lessons learned from our first year of implementation will be presented. 
    more » « less
  5. null (Ed.)
    Bridge courses are often created to provide participants with remediation instruction on discipline-specific content knowledge, like chemistry and mathematics, before enrollment in regular (semester-long) courses. The bridge courses are then designed to impact student’s academic success in the short-term. Also, as a consequence of the bridge course experience, it is often expected that students’ dropout rates on those regular courses will decrease. However, the bridge courses are often short (ten or fewer days) and packed with content, thus creating challenges for helping students sustain their learning gains over time. With the support of the NSF funded (DUE - Division Of Undergraduate Education) STEM Center at Sam Houston State University, we are designing a course for entering chemistry students that consists of a one-week pre-semester intensive bridge component, which then flows into a one-month co-curricular support component at the beginning of the semester. The primary goals of the bridge component of the course are to strengthen student academic preparedness, calibrated-self-efficacy, and to foster networking leading to a strong learning community. The goal of the co-curricular extension is to help students sustain and build upon the learning gains of the initial bridge component. We plan to extend the co-curricular portion of the course in future years. A key measure of success will be improved participant course grades in the introductory chemistry courses for majors. Our design process has been centered on weekly meetings that alternate between literature review and course design. The design process was initiated with backward design principles and continues with ongoing revision. The goals, design strategy, and design process of this new course will be presented along with the achieved student outcomes during the implementation of the past summer 2020. 
    more » « less