skip to main content


Title: When Optimal Team Formation is a Choice - Self-Selection versus Intelligent Team Formation Strategies in a Large Online Project-Based Course
Prior research in Team-Based Massive Open Online Project courses (TB-MOOPs) has demonstrated both the importance of effective group composition and the potential for using automated methods for forming effective teams. Past work on automated team assignment has produced both spectacular failures and spectacular successes. In either case, different contexts pose particular challenges that may interfere with the applicability of approaches that have succeeded in other contexts. This paper reports on a case study investigating the applicability of an automated team assignment approach that has succeeded spectacularly in TB-MOOP contexts to a large online project-based course. The analysis offers both evidence of partial success of the paradigm as well as insights into areas for growth.  more » « less
Award ID(s):
1302522
NSF-PAR ID:
10080586
Author(s) / Creator(s):
Date Published:
Journal Name:
Proceedings of AI in Education
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Recent trends in the cybersecurity workforce have recognized that effective solutions for complex problems require collective efforts from individuals with diverse sets of knowledge, skills, and abilities. Therefore, the growing need to train students in team collaboration skills propelled educators in computer science and engineering to adopt team-based pedagogical strategies. Team-based pedagogy has shown success in enhancing students' knowledge in course subjects and their motivation in learning. However, it is limited in offering concrete frameworks specifically focusing on how to teach team collaboration skills. As part of an interdisciplinary effort, we draw on Transactive Memory Systems Theory-a communication theory that explains how individuals in groups learn who knows what and organize who does what-in developing a Team Knowledge Sharing Assignment as a tool for student teams to structure their team collaboration processes. This paper reports a result of a case study in designing and facilitating the assignment for cybersecurity students enrolled in a scholarship program. Students' evaluations and the instructor's assessment reveal that the assignment made a positive impact on students' team collaboration skills by helping them successfully identify their team members' expertise and capitalize on their team's knowledge resources when delegating functional roles. Based on this case study, we offer practical suggestions on how the assignment could be used for various classes or cybersecurity projects and how instructors could maximize its benefits. 
    more » « less
  2. The configuration that an instructor enters into an algorithmic team formation tool determines how students are grouped into teams, impacting their learning experiences. One way to decide the configuration is to solicit input from the students. Prior work has investigated the criteria students prefer for team formation, but has not studied how students prioritize the criteria or to what degree students agree with each other. This paper describes a workflow for gathering student preferences for how to weight the criteria entered into a team formation tool, and presents the results of a study in which the workflow was implemented in four semesters of the same project-based design course. In the most recent semester, the workflow was supplemented with an online peer discussion to learn about students' rationale for their selections. Our results show that students want to be grouped with other students who share the same course commitment and compatible schedules the most. Students prioritize demographic attributes next, and then task skills such as programming needed for the project work. We found these outcomes to be consistent in each instance of the course. Instructors can use our results to guide team formation in their own project-based design courses and replicate our workflow to gather student preferences for team formation in any course. 
    more » « less
  3. null (Ed.)
    In Open Source Software (OSS) projects, pre-built tools dominate DevOps-oriented pipelines. In practice, a multitude of configuration management, cloud-based continuous integration, and automated deployment tools exist, and often more than one for each task. Tools are adopted (and given up) by OSS projects regularly. Prior work has shown that some tool adoptions are preceded by discussions, and that tool adoptions can result in benefits to the project. But important questions remain: how do teams decide to adopt a tool? What is discussed before the adoption and for how long? And, what team characteristics are determinant of the adoption? In this paper, we employ a large-scale empirical study in order to characterize the team discussions and to discern the teamlevel determinants of tool adoption into OSS projects' development pipelines. Guided by theories of team and individual motivations and dynamics, we perform exploratory data analyses, do deep-dive case studies, and develop regression models to learn the determinants of adoption and discussion length, and the direction of their effect on the adoption. From data of commit and comment traces of large-scale GitHub projects, our models find that prior exposure to a tool and member involvement are positively associated with the tool adoption, while longer discussions and the number of newer team members associate negatively. These results can provide guidance beyond the technical appropriateness for the timeliness of tool adoptions in diverse programmer teams. Our data and code is available at https://github.com/lkyin/tool_adoptions. 
    more » « less
  4. Motivation: This is a complete paper. There was a sudden shift from traditional learning to online learning in Spring 2020 with the outbreak of COVID-19. Although online learning is not a new topic of discussion, universities, faculty, and students were not prepared for this sudden change in learning. According to a recent article in ‘The Chronicle of Higher Education, “even under the best of circumstances, virtual learning requires a different, carefully crafted approach to engagement”. The Design Thinking course under study is a required freshmen level course offered in a Mid-western University. The Design Thinking course is offered in a flipped format where all the content to be learned is given to students beforehand and the in-class session is used for active discussions and hands-on learning related to the content provided at the small group level. The final learning objective of the course is a group project where student groups are expected to come up with functional prototypes to solve a real-world problem following the Design Thinking process. There were eighteen sections of the Design Thinking course offered in Spring 2020, and with the outbreak of COVID-19, a few instructors decided to offer synchronous online classes (where instructors were present online during class time and provided orientation and guidance just like a normal class) and a few others decided to offer asynchronous online classes (where orientation from the instructor was delivered asynchronous and the instructor was online during officially scheduled class time but interactions were more like office hours). Students were required to be present synchronously at the team level during the class time in a synchronous online class. In an asynchronous online class, students could be synchronous at the team level to complete their assignment any time prior to the deadline such that they could work during class time but they were not required to work at that time. Through this complete paper, we are trying to understand student learning, social presence and learner satisfaction with respect to different modes of instruction in a freshmen level Design Thinking course. Background: According to literature, synchronous online learning has advantages such as interaction, a classroom environment, and better course quality whereas asynchronous online learning has advantages such as self-controlled and self-directed learning. The disadvantages of synchronous online learning include the learning process, technology issues, and distraction. Social isolation, lack of interaction, and technology issue are a few disadvantages related to asynchronous online learning. Problem Being Addressed: There is a limited literature base investigating different modes of online instruction in a Design Thinking course. Through this paper, we are trying to understand and share the effectiveness of synchronous and asynchronous modes of instruction in an online Flipped Design Thinking Course. The results of the paper could also help in this time of pandemic by shedding light on the more effective way to teach highly active group-based classrooms for better student learning, social presence, and learner satisfaction. Method/Assessment: An end of semester survey was monitored in Spring 2020 to understand student experiences in synchronous and asynchronous Design Thinking course sections. The survey was sent to 720 students enrolled in the course in Spring 2020 and 324 students responded to the survey. Learning was measured using the survey instrument developed by Walker (2003) and the social presence and learner satisfaction was measured by the survey modified by Richardson and Swan (2003). Likert scale was used to measure survey responses. Anticipated Results: Data would be analyzed and the paper would be completed by draft paper submission. As the course under study is a flipped and active course with a significant component of group work, the anticipated results after analysis could be that one mode of instruction has higher student learning, social presence, and learner satisfaction compared to the other. 
    more » « less
  5. Team- and project-based pedagogies are increasingly normative in engineering education and beyond. Student teamwork holds the promise of developing collaborative skills deemed essential for new engineers by professional accreditation bodies such as ABET. The emphasis on these models, furthermore, reflects developments in pedagogical theory, stressing the importance of experiential learning and the social construction of knowledge, repositioning the instructor as a facilitator and guide. Teamwork in an educational context differs from that in professional contexts in that learning outcomes for all team members – both in terms of technical knowledge and team-working skills – are a primary goal of the activity, even while more tangible task-related outcomes might be the main concern of the students themselves. However, team-based learning also holds the potential for team members to have negative experiences, of which instructors may have little or no awareness, especially in real-time. Teams may achieve team-level outcomes required for successful completion, in spite of uneven levels of participation and contribution. Reduced participation on the part of an individual team member may have many causes, pro-active or reactive: it may be a deliberate refusal to engage, a lack of self-confidence, or a response to hostility from other members, among other possibilities. Inequitable team interactions will lead to uneven uptake of desired learning outcomes. Fostering equity in interactions and identifying inequitable practices among team members is therefore an important part of implementing team-based pedagogies, and an essential first step in identifying and challenging systematic patterns of inequity with regard to members of historically marginalized groups. This paper will therefore explore ways in which equity in group decision-making may be conceptualized and observed, laying the foundations for identifying and addressing inequities in the student experience. It will begin by considering different potential manifestations of interactional equity, surveying notions derived from prior education research in the fields of health, mathematics, engineering, and the natural sciences. These notions include: equity of participation on the basis of quantified vocal contributions (in terms of words, utterances, or clausal units); distribution and evolution of interactional roles; equity of idea endorsement and uptake; distribution of inchargeness and influence; equity of access to positional identities and discourse practices; and team member citizenship. In the paper’s empirical component, we trial measures of equity taken or developed from this literature on a small dataset of transcripts showing verbal interactions between undergraduate student team members in a first-year engineering design course. Some measures will be qualitative and others quantitative, depending on the particular form and manifestation of equity they are designed to examine. Measures include manual coding of speech acts and interactional ‘bids’, statistical measures of utterance frequency and length, and computational approaches to modeling interactional features such as social impact and receptivity. Results are compared with the students’ own reflections on the interactions, taken immediately afterward. Recommendations are made for the application of the measures, both from research and practice perspectives. Keywords: Teamwork, Equity, Interaction, Design 
    more » « less