skip to main content


Title: Correlations between student connectivity and academic performance: a pandemic follow-up
Social network analysis (SNA) has been gaining traction as a technique for quantitatively studying student collaboration. We analyze networks, constructed from student self-reports of collaboration on homework assignments, in two courses from the University of Colorado Boulder and one course from the Colorado School of Mines. All three courses occurred during the COVID-19 pandemic, which allows for a comparison between the course at the Colorado School of Mines (in a fully remote format) with results from a previous pre-pandemic study of student collaboration at the Colorado School of Mines (in a hybrid format). We compute nodal centrality measures and calculate the correlation between student centrality and performance. Results varied widely between each of the courses studied. The course at the Colorado School of Mines had strong correlations between many centrality measures and performance which matched the patterns seen in the pre-pandemic study. The courses at the University of Colorado Boulder showed weaker correlations, and one course showed nearly no correlations at all between students' connectivity to their classmates and their performance. Taken together, the results from the trio of courses indicate that the context and environment in which the course is situated play a more important role in fostering a correlation between student collaboration and course performance than the format (remote, hybrid, in-person) of the course. Additionally, we conducted a short study on the effect that missing nodes may have on the correlations calculated from the measured networks. This investigation showed that missing nodes tend to shift correlations towards zero, providing evidence that the statistically significant correlations measured in our networks are not spurious.  more » « less
Award ID(s):
1839232
NSF-PAR ID:
10361373
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
ArXivorg
ISSN:
2331-8422
Page Range / eLocation ID:
2210.01207
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. A substantial percentage of engineering graduates, especially those from traditionally underrepresented groups, complete their lower-division education at a community college before transferring to a university to earn their degree. However, engineering programs at many community colleges, because of their relatively small scale with often only one permanent faculty member, struggle to offer lower-division engineering courses with the breadth and frequency needed by students for effective and efficient transfer preparation. As a result, engineering education becomes impractical and at times inaccessible for many community college students. Through a grant from the National Science Foundation Improving Undergraduate STEM Education program (NSF IUSE), three community colleges from Northern California collaborated to increase the availability and accessibility of the engineering curriculum by developing resources and teaching strategies to enable small-to-medium sized community college engineering programs to support a comprehensive set of lower-division engineering courses. These resources were developed for use in a variety of delivery formats (e.g., fully online, online/hybrid, flipped face-to-face, etc.), providing flexibility for local community colleges to leverage according to their individual needs. This paper focuses on the development and testing of the resources for an introductory Materials Science course with 3-unit lecture and 1-unit laboratory components. Although most of the course resources were developed to allow online delivery if desired, the laboratory curriculum was designed to require some limited face-to-face interaction with traditional materials testing equipment. In addition to the resources themselves, the paper presents the results of the pilot implementation of the course during the Spring 2015 semester, taught using a flipped delivery format consisting of asynchronous remote viewing of lecture videos and face-to-face student-centered problem-solving and lab exercises. These same resources were then implemented in a flipped format by an instructor who had never previously taught the course, at a community college that did not have its own materials laboratory facilities. Site visits were arranged with a nearby community college to afford students an opportunity to complete certain lab activities using traditional materials testing equipment. In both implementations of the course, student surveys and interviews were used to determine students’ perceptions of the effectiveness of the course resources, student use of these resources, and overall satisfaction with the course. Additionally, student performance on assessments was compared with that of traditional lecture delivery of the courses in prior years. 
    more » « less
  2. This paper describes an evidence based-practice paper to a formative response to the engineering faculty and students’ needs at Anonymous University. Within two weeks, the pandemic forced the vast majority of the 1.5 million faculty and 20 million students nationwide to transition all courses from face-to-face to entirely online. Never in the history of higher education has there been a concerted effort to adapt so quickly and radically, nor have we had the technology to facilitate such a rapid and massive change. At Anonymous University, over 700 engineering educators were racing to transition their courses. Many of those faculty had never experienced online course preparation, much less taught one synchronously or asynchronously. Faculty development centers and technology specialists across the university made a great effort to aid educators in this transition. These educators had questions about the best practices for moving online, how their students were affected, and the best ways to engage their students. However, these faculty’s detailed questions were answerable only by faculty peers’ experience, students’ feedback, and advice from experts in relevant engineering education research-based practices. This paper describes rapid, continuous, and formative feedback provided by the Engineering Education Faculty Group (EEFG) to provide an immediate response for peer faculty guidance during the pandemic, creating a community of practice. The faculty membership spans multiple colleges in the university, including engineering, education, and liberal arts. The EEFG transitioned immediately to weekly meetings focused on the rapidly changing needs of their colleagues. Two surveys were generated rapidly by Hammond et al. to characterize student and faculty concerns and needs in March of 2020 and were distributed through various means and media. Survey 1 and 2 had 3381 and 1506 respondents respectively with most being students, with 113 faculty respondents in survey 1, the focus of this piece of work. The first survey was disseminated as aggregated data to the College of Engineering faculty with suggested modifications to course structures based on these findings. The EEFG continued to meet and collaborate during the remainder of the Spring 2020 semester and has continued through to this day. This group has acted as a hub for teaching innovation in remote online pedagogy and techniques, while also operating as a support structure for members of the group, aiding those members with training in teaching tools, discussion difficult current events, and various challenges they are facing in their professional teaching lives. While the aggregated data gathered from the surveys developed by Hammond et al. was useful beyond measure in the early weeks of the pandemic, little attention at the time was given to the responses of faculty to that survey. The focus of this work has been to characterize faculty perceptions at the beginning of the pandemic and compare those responses between engineering and non-engineering faculty respondents, while also comparing reported perceptions of pre- and post-transition to remote online teaching. Interviews were conducted between 4 members of the EEFG with the goal of characterizing some of the experiences they have had while being members of the group during the time of the pandemic utilizing Grounded theory qualitative analysis. 
    more » « less
  3. Abstract

    We examine the impact of the coronavirus pandemic on teaching and learning in an Engineering School of a large US research university. We focus on the adjustment of instructors as they converted their courses to distance teaching and learning formats (e.g., virtual sessions, online forums) and on bachelor student experiences with those changes. While both instructors and students experienced liminality, the pandemic affected these groups differently. Instructors attempted to formcommunitaswith their students by prioritizing their teaching responsibilities, increasing the accessibility of course materials, and being more available to students compared to pre‐pandemic times. However, students struggled to adapt to online learning contexts which lacked the sense of togetherness previously offered by in‐person classes, study‐groups, tutorial sessions, and communal study spaces. Unable to interact with their peers and createcommunitas, learning online proved to be an ineffective “solution.” Interacting with classmates and working in study groups are among the practices that can help students adjust to course delivery changes, even if it means those cultural practices go virtual. We argue that higher learning institutions, regardless of type (e.g., R1, R2, liberal arts, community colleges), should strengthen their remote teaching approaches. However, those strategies should incorporate: building strong relationships within and across roles, designing inclusive teaching and learning practices that take the contexts in which students learn into account, increasing spaces for peer‐to‐peer learning, and becoming proficient in the technologies needed to teach virtually.

     
    more » « less
  4. The Mechanical Engineering Department at a private, mid-sized university was awarded the National Science Foundation (NSF) Revolutionizing Engineering and Computer Science Departments (RED) grant in July 2017 to support the development of a program that fosters students’ engineering identities in a culture of doing engineering with industry engineers. The Department is cultivating this culture of “engineering with engineers” through a strong connection to industry, and through changes in the four essential areas of, a shared department vision, faculty, curriculum and supportive policies. This paper reports our continued efforts in these four areas and our measurement of their impact. Shared department vision: During the first year of the project, the department worked together to revise its mission to reflect the goal of fostering engineering identity. From this shared vision, the department aims to build a culture to promote inclusive practices. In the past year during the COVID-19 pandemic, this shared vision continued to guide many acts of care and community building for the department. Faculty: The pandemic prompted faculty to reflect on how they delivered their courses and cared for students. To promote inclusive practice, faculty utilized recorded lectures, online collaboration tools and instant messaging apps to provide multiple ways of communication for students. Although faculty summer immersion had to be postponed due to pandemic, interactions with industry continued in design courses, and via virtual seminars and socials. Efforts were also extended to strengthen connections between the department and recent graduates who just began working in industry and could become mentors for current students. Curriculum: A new curriculum to support the goals of this project was rolled out in the 2019-20 academic year. The pandemic hit right in the middle of the initial implementation of this new curriculum. Therefore, to maintain the essence of the new curriculum that emphasizes hands-on, doing engineering and experiential learning in the remote setting, many adjustments and modifications were made. Although initial evidence indicates the effectiveness of the new courses/curriculum even under remote teaching and learning, there are also many lessons-learned that can be examined for future implementations and modifications of the curriculum. Supportive policies: The department agreed to celebrate various acts of care for students and cares for teaching and learning in Annual Performance Reviews. Faculty also worked with other departments, the college, and the university to develop supportive policies beyond the department. For example, based on the recommendation from the department, the college set up a Student Advocate role who would assist students navigate through any incident that make they feel excluded. The new university tenure and promotion guidelines have just been approved with the support from the faculty in the department. Additionally, the department’s effort of building an inclusive culture is aligned with the university initiative for a reform to emphasize anti-racism curriculum. Details of the action items in each area of change that the department has taken to build this inclusive culture to foster engineering identity are shared in this paper. In addition, research gauging the impact of our efforts are discussed. This project was funded by the Division of Undergraduate Education (DUE) IUSE/PFE: RED grant through NSF. 
    more » « less
  5. Course-based Undergraduate Research Experiences (CUREs) are an increasingly utilized model for exposing students to research. The lack of robust assessments is a major hurdle to wider adoption of CUREs. The Coronavirus Infectious Disease 2019 (COVID-19) pandemic necessitated a drastic shift of in-person courses to the online format. Using the Participant Perception Indicator (PPI) survey, we measured students’ self-reported changes in learning from such a biochemistry course at a large university in south Florida based on the Biochemistry Authentic Scientific Inquiry Lab (BASIL) model. By doing this, we were able to better understand the student-benefits of CUREs and how these benefits are affected by changes in learning modalities between two relevant semesters, i.e., winter and summer of 2020. Anticipated learning outcomes (ALOs) help partially fill the gap left by the loss of physical interaction in experimental procedures. Our analysis indicated that students learned more through bioinformatic experiments compared to their wet-lab counterparts. Using pre- and post- surveys, students reported that their experience and confidence gains lagged behind their knowledge gain of technique-based skills. Students are not as confident in their understanding of techniques when unable to perform those in the physical laboratory. Thus, despite extensive pursuit of the purpose and protocols of the experiments and techniques, neither their experience nor their confidence was on par with their knowledge. This study is one of the first examples demonstrating a quantitative student-learning assessment of a CURE in the science, technology, engineering, and mathematics (STEM) disciplines. The novel assessment strategies targeted to identify gaps in learning mastery could facilitate the adoption of CUREs, fostering opportunities for all undergraduate students to vital laboratory research experiences in STEM. 
    more » « less