skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Using GitHub in large software engineering classes. An exploratory case study
Background and Context: GitHub has been recently used in Software Engineering (SE) classes to facilitate collaboration in student team projects as well as help teachers to evaluate the contributions of their students more objectively. Objective: We explore the benefits and drawbacks of using GitHub as a means for team collaboration and performance evaluation in large SE classes. Method: Our research method takes the form of a case study conducted in a senior level SE class with 91 students. Our study also includes entry and exit surveys, an exit interview, and a qualitative analysis of students’ commit behavior. Findings: Different teams adapt GitHub to their workflow differently. Furthermore, despite the steep learning curve, using GitHub should not affect the quality of students’ submissions. However, using GitHub metrics as a proxy for evaluating team performance can be risky. Implications: We provide several recommendations for integrating Web-based configuration management tools in SE classes.  more » « less
Award ID(s):
1821525
PAR ID:
10151614
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Computer Science Education
ISSN:
0899-3408
Page Range / eLocation ID:
1 to 32
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; (, IEEE Global Engineering Education Conference (EDUCON))
    Recent trends in the cybersecurity workforce have recognized that effective solutions for complex problems require collective efforts from individuals with diverse sets of knowledge, skills, and abilities. Therefore, the growing need to train students in team collaboration skills propelled educators in computer science and engineering to adopt team-based pedagogical strategies. Team-based pedagogy has shown success in enhancing students' knowledge in course subjects and their motivation in learning. However, it is limited in offering concrete frameworks specifically focusing on how to teach team collaboration skills. As part of an interdisciplinary effort, we draw on Transactive Memory Systems Theory-a communication theory that explains how individuals in groups learn who knows what and organize who does what-in developing a Team Knowledge Sharing Assignment as a tool for student teams to structure their team collaboration processes. This paper reports a result of a case study in designing and facilitating the assignment for cybersecurity students enrolled in a scholarship program. Students' evaluations and the instructor's assessment reveal that the assignment made a positive impact on students' team collaboration skills by helping them successfully identify their team members' expertise and capitalize on their team's knowledge resources when delegating functional roles. Based on this case study, we offer practical suggestions on how the assignment could be used for various classes or cybersecurity projects and how instructors could maximize its benefits. 
    more » « less
  2. ; ; ; ; ; ; ; (, 2021 ASEE Annual Conference)
    null (Ed.)
    Engineers need to develop professional skills, including the ability to work successfully in teams and to communicate within and outside of their discipline, in addition to required technical skills. A collaborative multi-disciplinary service learning project referred to as Ed+gineering was implemented in a 100-level mechanical engineering course. In this collaboration, mechanical engineering students, primarily in the second semester of their freshman year or first semester of their second year, worked over the course of a semester with education students taking a foundations course to develop and deliver engineering lessons to fourth or fifth graders. Students in comparison engineering classes worked on a team project focused on experimental design for a small satellite system. The purpose of this study was to determine if participating in the Ed+gineering collaboration had a positive effect on teamwork effectiveness and satisfaction when compared to the comparison class. In both team projects, the five dimensions of the Comprehensive Assessment of Team Member Effectiveness (CATME) system were used as a quantitative assessment. The five dimensions of CATME Behaviorally Anchored Ratings Scale (BARS) (contribution to the team’s work, interacting with teammates, keeping the team on track, expecting quality, and having relevant Knowledge, Skills, and Abilities - KSAs) were measured. Additionally, within the CATME platform team satisfaction, team interdependence and team cohesiveness were measured. ANCOVA analysis was used to assess the quantitative data from CATME. Preliminary results suggest that students in the treatment classes had higher team member effectiveness and overall satisfaction scores than students in the comparison classes. Qualitative data from reflections written at the completion of the aforementioned projects were used to explore these results. 
    more » « less
  3. ; ; ; (, ACM Transactions on Computing Education)
    Assessing team software development projects is notoriously difficult and typically based on subjective metrics. To help make assessments more rigorous, we conducted an empirical study to explore relationships between subjective metrics based on peer and instructor assessments, and objective metrics based on GitHub and chat data. We studied 23 undergraduate software teams (n= 117 students) from two undergraduate computing courses at two North American research universities. We collected data on teams’ (a) commits and issues from their GitHub code repositories, (b) chat messages from their Slack and Microsoft Teams channels, (c) peer evaluation ratings from the CATME peer evaluation system, and (d) individual assignment grades from the courses. We derived metrics from (a) and (b) to measure both individual team members’contributionsto the team, and theequalityof team members’ contributions. We then performed Pearson analyses to identify correlations among the metrics, peer evaluation ratings, and individual grades. We found significant positive correlations between team members’ GitHub contributions, chat contributions, and peer evaluation ratings. In addition, the equality of teams’ GitHub contributions was positively correlated with teams’ average peer evaluation ratings and negatively correlated with the variance in those ratings. However, no such positive correlations were detected between the equality of teams’ chat contributions and their peer evaluation ratings. Our study extends previous research results by providing evidence that (a) team members’ chat contributions, like their GitHub contributions, are positively correlated with their peer evaluation ratings; (b) team members’ chat contributions are positively correlated with their GitHub contributions; and (c) the equality of team’ GitHub contributions is positively correlated with their peer evaluation ratings. These results lend further support to the idea that combining objective and subjective metrics can make the assessment of team software projects more comprehensive and rigorous. 
    more » « less
  4. ; ; ; ; (, NA)
    NA (Ed.)
    Project GOALS (Greater Opportunities to Advance Lifelong Success), an NSF Advanced Technological Education targeted research project, brought together researchers and community college educators from 2020 through 2024 to co-develop, test, package, and distribute resources for developing technicians' professional skills. Through this work, the team discovered the barriers that hinder both instructors and students from connecting around professional skills development. To address these barriers, the Project GOALS team developed an instructional framework grounded in research that integrates focused low-stakes activities into classes as students work toward their technical certificates. Based on our research, we believe Project GOALS provides ways for students to students' career readiness. In this research brief, the team describes how the Project GOALS co-development collaboration revealed the supports that technical instructors need to build students' professional awareness and reflection habits. Through qualitative analysis, Project GOALS researchers discovered the challenges that prevent many instructors from sharing their honest assessments of students' professional skills. The brief describes findings and recommends ways that community colleges can provide the assistance and resources that instructors need to develop students' professional skills. 
    more » « less
  5. ; ; (, International Society of the Learning Sciences Repository)
    Learning algebra concepts, particularly those involving functions, is crucial yet challenging in mathematics education. Research suggests that collaborative learning, where students work in small teams to solve math problems, can support conceptual learning. However, collaborative problem solving (CPS) is complex and requires students’ social and cognitive skills for success. This study investigates the impacts of guided facilitation on supporting CPS in mathematics tasks during small-team collaboration. Using epistemic network analysis and sequential pattern mining, we analyzed chat logs from student teams and human facilitators and compared the interactions in facilitated and unfacilitated teams. Results indicated that near-peer facilitation effectively promoted constructive behaviors like multiple turns of social negotiation, while reducing inappropriate communications. Different facilitation strategies, such as encouraging students to respond to each other or clarify their statements, elicited targeted CPS behaviors, possibly leading to improved team performance. Findings have practical implications for facilitating CPS in mathematics classrooms. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email