skip to main content


Title: Computational thinking and assignment resubmission predict persistence in a computer science MOOC
Abstract

Massive open online course (MOOC) studies have shown that precourse skills (such as precomputational thinking) and course engagement measures (such as making multiple submission attempts with assignments when the initial submission is incorrect) predict students' grade performance, yet little is known about whether these factors predict students' course retention. In applying survival analysis to a sample of more than 20,000 participants from one popular computer science MOOC, we found that students' precomputational thinking skills and their perseverance in assignment submission strongly predict their persistence in the MOOC. Moreover, we discovered that precomputational thinking skills, programming experience, and gender, which were previously considered to be constant predictors of students' retention, have effects that attenuate over the course milestones. This finding suggests that MOOC educators should take a growth perspective towards students' persistence: As students overcome the initial hurdles, their resilience grows stronger.

 
more » « less
NSF-PAR ID:
10376027
Author(s) / Creator(s):
 ;  ;  ;  
Publisher / Repository:
Wiley-Blackwell
Date Published:
Journal Name:
Journal of Computer Assisted Learning
Volume:
36
Issue:
5
ISSN:
0266-4909
Page Range / eLocation ID:
p. 581-594
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. In this proposal, we will share some initial findings about how teacher and student engagement in cogenerative dialogues influenced the development of the Culturally Relevant Pedagogical Guidelines for Computational Thinking and Computer Science (CRPG-CSCT). The CRPG-CSCT’s purpose is to provide computer science teachers with tools to enhance their instruction by accurately reflecting students’ diverse cultural resources in the classroom. Additionally, the CRPG-CSCT will provide guidance to non-computer science teachers on how to facilitate the integration of computational thinking skills to a broad spectrum of classes in the arts, humanities, sciences, social sciences, and mathematics. Our initial findings shared here are part of a larger NSF-funded research project (Award No. 2122367) which aims to better understand the barriers to entry and challenges for success faced by underrepresented secondary school students in computer science, through direct engagement with the students themselves. Throughout the 2022-23 academic year, the researchers have been working with a small team of secondary school teachers, students, and instructional designers, as well as university faculty in computer science, secondary education, and sociology to develop the CRPG-CSCT. The CRPG-CSCT is rooted in the tenets of culturally relevant pedagogy (Ladson-Billings, 1995) and borrows from Muhammad’s (2020) work in Cultivating Genius: An Equity Framework for Culturally and Historically Responsive Literacy. The CRPG-CCT is being developed over six day-long workshops held throughout the academic year. At the time of this submission, five of the six workshops had been completed. Each workshop utilized cogenerative dialogues (cogens) as the primary tool for organizing and sustaining participants’ engagement. Through cogens, participants more deeply learn about students’ cultural capital and the value of utilizing that capital within the classroom (Roth, Lawless, & Tobin, 2000). The success of cogens relies on following specific protocols (Emdin, 2016), such as listening attentively, ensuring there are equal opportunities for all participants to share, and affirming the experiences of other participants. The goal of a cogen is to reach a collective decision, based on the dialogue, that will positively impact students by explicitly addressing barriers to their engagement in the classroom. During each workshop, one member of the research team and one undergraduate research assistant observed the interactions among cogen participants and documented these in the form of ethnographic field notes. Another undergraduate research assistant took detailed notes during the workshop to record the content of small and large group discussions, presentations, and questions/responses throughout the workshops. A grounded theory approach was used to analyze the field notes. Additionally, at the conclusion of each workshop, participants completed a Cogen Feedback Survey (CFS) to gather additional information. The CFS were analyzed through open thematic coding, memos, and code frequencies. Our preliminary results demonstrate high levels of engagement from teacher and student participants during the workshops. Students identified that the cogen structure allowed them to participate comfortably, openly, and honestly. Further, students described feeling valued and heard. Students’ ideas and experiences were frequently affirmed, which served as an important step toward dismantling traditional teacher-student boundaries that might otherwise prevent them from sharing freely. Another result from the use of cogens was the shared experience of participants comprehending views from the other group’s perspective in the classroom. Students appreciated the opportunity to learn from teachers about their struggles in keeping students engaged. Teachers appreciated the opportunity to better understand students’ schooling experiences and how these may affirm or deny aspects of their identity. Finally, all participants shared meaningful suggestions and strategies for future workshops and for the collective betterment of the group. Initial findings shared here are important for several reasons. First, our findings suggest that cogens are an effective approach for fostering participants’ commitment to creating the conditions for students’ success in the classroom. Within the context of the workshops, cogens provided teachers, students, and faculty with opportunities to engage in authentic conversations for addressing the recruitment and retention problems in computer science for underrepresented students. These conversations often resulted in the development of tangible pedagogical approaches, examples, metaphors, and other strategies to directly address the recruitment and retention of underrepresented students in computer science. Finally, while we are still developing the CRPG-CSCT, cogens provided us with the opportunity to ensure the voices of teachers and students are well represented in and central to the document. 
    more » « less
  2. Abstract

    Massive Online Open Courses (MOOCs) provide opportunities to learn a vast range of subjects. Because MOOCs are open to anyone with computer access and rarely have prerequisite requirements, the range of student backgrounds can be far more varied than in conventional classroom‐based courses. Prior studies have shown that misconceptions have a huge impact on students' learning performance; however, no study has empirically examined the relationship between misconceptions and learning persistence. This study of 12,913 MOOC‐takers examines how students' misconceptions about the upcoming course material affect course completion. Using a survival analysis approach, we found that, controlling for the score in a pre‐course test, students holding more misconceptions had a higher dropout rate at the start of the course, an effect that diminished over time. Other student variables were found to have a positive impact on survival that persisted throughout the entire course: U.S. location, higher age, an intention to complete, better English skills, prior familiarity with the subject, motivation to earn a certificate, and score and time spent on the previous problem set (homework). By contrast, student gender, education level, number of previous MOOCs completed, and motivation to participate in online discussion forums did not affect survival.

     
    more » « less
  3. With support from the National Science Foundation’s Division of Undergraduate Education, this five-year project led by a two-year HSI seeks to provide underrepresented students with mentored work experiences in computer information systems. Students will have access to on-campus work experiences and internships in businesses and industries. It is anticipated that some examples of potential student projects include mobile application development, cybersecurity, and computer support. It is expected that these experiences will increase undergraduate student interest, persistence, and success in computer information systems, as well as in STEM more broadly. To ensure that they are well-prepared for and gain the most from their work experiences, students will receive training on employability skills such as communication, teamwork, and project management. In addition, during their work experiences, students will be mentored by faculty, industry professionals, and peers. To strengthen the capacity of faculty to serve all students, including Hispanic students, the project will provide faculty with professional development focused on equity mindset. This framework to provide mentored work experiences will be developed and piloted at Phoenix College, in the computer information technology department and eventually expanded to other STEM fields at the institution. Following this, the project also intends to expand this framework four other two-year HSIs in the region. Through this work, the project aims to develop a replicable model for how two-year institutions can develop work experiences that foster increased student graduation and entry into STEM career pathways. This project, which is currently in its first year, seeks to examine how a curriculum that integrates cross-sector partnerships to provide work experiences can enhance STEM learning and retention. Using mixed methods and grounded theory, the project will expand knowledge about: (1) the impact of cross-sector partnerships that support work-focused experiential teaching and learning; (2) systematic ways to maintain and better use cross-sector partnerships; and (3) the degree to which a model of work-focused learning experiences can be adopted at other two-year HSIs and by other STEM fields. Baseline data about Hispanic serving identity at the pilot institution has been collected and assessed at the institutional, departmental, and for different educator roles including faculty, support staff, and administrative leaders to produce inputs towards developing a detailed plan of action. Early results from baseline data, visualizations, and planning responses will be reported in the submission. Expected long term results of the project include: development of sustainable mechanisms to foster cross-sector partnerships; increased student retention and workforce readiness; and measurable successes for STEM students, particularly Hispanic students, at two-year HSIs. 
    more » « less
  4. This work in progress is motivated by a self-study conducted at Texas State University. The study revealed that the average second year science, technology, engineering and math (STEM) student retention rate is 56% vs. 67% for all majors, and that 16% of STEM majors are female while 57% of all undergraduate students are female. Using these statistics, the authors identified the need to offer motivating experiences to freshman in STEM while creating a sense of community among other STEM students. This paper reports on the impact of two interventions designed by the authors and aligned with this need. The interventions are: (1) a one-day multi- disciplinary summer orientation (summer15) to give participants the opportunity to undertake projects that demonstrate the relevance of spatial and computational thinking skills and (2) a subsequent six-week spatial visualization skills training (fall 2015) for students in need to refine these skills. The interventions have spatial skills as a common topic and introduce participants to career applications through laboratory tours and talks. Swail et al.1 mentions that the three elements to address in order to best support students’ persistence and achievement are cognitive, social, and institutional factors. The interventions address all elements to some extent and are part of an NSF IUSE grant (2015-2018) to improve STEM retention. The summer 2015 orientation was attended by 17 freshmen level students in Physics, Engineering, Engineering Technology, and Computer Science. The orientation was in addition to “Bobcat Preview”, a separate mandatory one-week length freshman orientation that includes academic advising and educational and spirit sessions to acclimate students to the campus. The effectiveness of the orientation was assessed through exit surveys administered to participants. Current results are encouraging; 100% of the participants answered that the orientation created a space to learn about science and engineering, facilitated them to make friends and encouraged peer interaction. Eighty percent indicated that the orientation helped them to build confidence in their majors. Exit survey findings were positively linked to a former exit survey from an orientation given to a group of 18 talented and low-income students in 2013. The training on refining spatial visualization skills connects to the summer orientation by its goals. It offers freshman students in need to refine spatial skills a further way to increase motivation to STEM and create community among other students. It is also an effective approach to support students’ persistence and achievement. Bairaktarova et al.2 mention that spatial skills ability is gradually becoming a standard assessment of an individual’s likelihood to succeed as an engineer. Metz et al.3 report that well-developed spatial skills have been shown to lead to success in Engineering and Technology, Computer Science, Chemistry, Computer Aided Design and Mathematics. The effectiveness of the fall 2015 training was assessed through comparison between pre and post tests results and exit surveys administered to participants. All participants improved their pre-training scores and average improvement in students’ scores was 18.334%. 
    more » « less
  5. This work in progress is motivated by a self-study conducted at Texas State University. The study revealed that the average second year science, technology, engineering and math (STEM) student retention rate is 56% vs. 67% for all majors, and that 16% of STEM majors are female while 57% of all undergraduate students are female. Using these statistics, the authors identified the need to offer motivating experiences to freshman in STEM while creating a sense of community among other STEM students. This paper reports on the impact of two interventions designed by the authors and aligned with this need. The interventions are: (1) a one-day multi- disciplinary summer orientation (summer15) to give participants the opportunity to undertake projects that demonstrate the relevance of spatial and computational thinking skills and (2) a subsequent six-week spatial visualization skills training (fall 2015) for students in need to refine these skills. The interventions have spatial skills as a common topic and introduce participants to career applications through laboratory tours and talks. Swail et al.[1] mentions that the three elements to address in order to best support students’ persistence and achievement are cognitive, social, and institutional factors. The interventions address all elements to some extent and are part of an NSF IUSE grant (2015-2018) to improve STEM retention. The summer 2015 orientation was attended by 17 freshmen level students in Physics, Engineering, Engineering Technology, and Computer Science. The orientation was in addition to “Bobcat Preview”, a separate mandatory one-week length freshman orientation that includes academic advising and educational and spirit sessions to acclimate students to the campus. The effectiveness of the orientation was assessed through exit surveys administered to participants. Current results are encouraging; 100% of the participants answered that the orientation created a space to learn about science and engineering, facilitated them to make friends and encouraged peer interaction. Eighty percent indicated that the orientation helped them to build confidence in their majors. Exit survey findings were positively linked to a former exit survey from an orientation given to a group of 18 talented and low-income students in 2013. The training on refining spatial visualization skills connects to the summer orientation by its goals. It offers freshman students in need to refine spatial skills a further way to increase motivation to STEM and create community among other students. It is also an effective approach to support students’ persistence and achievement. Bairaktarova et al.[2] mention that spatial skills ability is gradually becoming a standard assessment of an individual’s likelihood to succeed as an engineer. Metz et al.[3] report that well-developed spatial skills have been shown to lead to success in Engineering and Technology, Computer Science, Chemistry, Computer Aided Design and Mathematics. The effectiveness of the fall 2015 training was assessed through comparison between pre and post tests results and exit surveys administered to participants. All participants improved their pre-training scores and average improvement in students’ scores was 18.334%. 
    more » « less