skip to main content


Title: How to Support Newcomers in Scientific Hackathons - An Action Research Study on Expert Mentoring
Time-bounded events such as hackathons have become a global phenomenon. Scientific communities in particular show growing interest in organizing them to attract newcomers and develop technical artifacts to expand their code base. Current hackathon approaches presume that participants have sufficient expertise to work on projects on their own. They only provide occasional support by domain experts serving as mentors which might not be sufficient for newcomers. Drawing from work on workplace and educational mentoring, we developed and evaluated an approach where each hackathon team is supported by a community member who serves in a mentor role that goes beyond providing occasional support. Evaluating this approach, we found that teams who took ownership of their projects, set achievable goals early while building social ties with their mentor and receiving learning-oriented support reported positive perceptions related to their project and an increased interest in the scientific community that organized the hackathon. Our work thus contributes to our understanding of mentoring in hackathons, an area which has not been extensively studied. It also proposes a feasible approach for scientific communities to attract and integrate newcomers which is crucial for their long-term survival.  more » « less
Award ID(s):
1901311
NSF-PAR ID:
10286251
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Proceedings of the ACM on Human-Computer Interaction
Volume:
4
Issue:
CSCW1
ISSN:
2573-0142
Page Range / eLocation ID:
1 to 23
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Applying for grants from the National Science Foundation (NSF) requires a paradigm shift at many community and technical colleges, because the primary emphasis at two-year colleges is on teaching. This shift is necessary because of the NSF expectation that a STEM faculty member will lead the project as Principal Investigator. Preparing successful NSF grant proposals also requires knowledge, skills, and strategies that differ from other sources from which two-year colleges seek grant funding. Since 2012, the Mentor-Connect project has been working to build capacity among two-year colleges and leadership skills among their STEM faculty to help them prepare competitive grant proposals for the National Science Foundation’s Advanced Technological Education (NSF-ATE) program. NSF-ATE focuses on improving the education of technicians for advanced technology fields that drive the nation’s economy. As an NSF-ATE-funded initiative, Mentor-Connect has developed a three-pronged approach of mentoring, technical assistance, and digital resources to help potential grantees with the complexities of the proposal submission process. Grant funding makes it possible to provide this help at no cost to eligible, two-year college educators. Mentor-Connect support services for prospective grantees are available for those who are new to ATE (community or technical colleges that have not received an NSF ATE award in 7 or more years), those seeking a larger second grant from the ATE Program after completing a small, new-to-ATE project, and for those whose first or second grant proposal submission to the NSF ATE Program was declined (not funded). The Mentor-Connect project has succeeded in raising interest in the NSF-ATE program. Over a seven-year period more than 80% of the 143 participating colleges have submitted proposals. Overall, the funding rate among colleges that participated in the Mentor-Connect project is exceptionally high. Of the 97 New-to-ATE proposals submitted from Cohorts 1 through 6, 71 have been funded, for a funding rate of 73%. Mentor-Connect is also contributing to a more geographically and demographically diverse NSF-ATE program. To analyze longer-term impacts, the project’s evaluator is conducting campus site visits at the new-to-ATE grantee institutions as their initial ATE projects are being completed. A third-party researcher has contributed to the site-visit protocol being used by evaluators. The researcher is also analyzing the site-visit reports to harvest outcomes from this work. This paper shares findings from seven cohorts that have completed a grant cycle with funding results known, as well as qualitative data from site visits with the first two cohorts of grantees. Recommendations for further research are also included. 
    more » « less
  2. Applying for grants from the National Science Foundation (NSF) requires a paradigm shift at many community and technical colleges, because the primary emphasis at two-year colleges is on teaching. This shift is necessary because of the NSF expectation that a STEM faculty member will lead the project as Principal Investigator. Preparing successful NSF grant proposals also requires knowledge, skills, and strategies that differ from other sources from which two-year colleges seek grant funding. Since 2012, the Mentor-Connect project has been working to build capacity among two-year colleges and leadership skills among their STEM faculty to help them prepare competitive grant proposals for the National Science Foundation’s Advanced Technological Education (NSF-ATE) program. NSF-ATE focuses on improving the education of technicians for advanced technology fields that drive the nation’s economy. As an NSF-ATE-funded initiative, Mentor-Connect has developed a three-pronged approach of mentoring, technical assistance, and digital resources to help potential grantees with the complexities of the proposal submission process. Grant funding makes it possible to provide this help at no cost to eligible, two-year college educators. Mentor-Connect support services for prospective grantees are available for those who are new to ATE (community or technical colleges that have not received an NSF ATE award in 7 or more years), those seeking a larger second grant from the ATE Program after completing a small, new-to-ATE project, and for those whose first or second grant proposal submission to the NSF ATE Program was declined (not funded). The Mentor-Connect project has succeeded in raising interest in the NSF-ATE program. Over a seven-year period more than 80% of the 143 participating colleges have submitted proposals. Overall, the funding rate among colleges that participated in the Mentor-Connect project is exceptionally high. Of the 97 New-to-ATE proposals submitted from Cohorts 1 through 6, 71 have been funded, for a funding rate of 73%. Mentor-Connect is also contributing to a more geographically and demographically diverse NSF-ATE program. To analyze longer-term impacts, the project’s evaluator is conducting campus site visits at the new-to-ATE grantee institutions as their initial ATE projects are being completed. A third-party researcher has contributed to the site-visit protocol being used by evaluators. The researcher is also analyzing the site-visit reports to harvest outcomes from this work. This paper shares findings from seven cohorts that have completed a grant cycle with funding results known, as well as qualitative data from site visits with the first two cohorts of grantees. Recommendations for further research are also included. 
    more » « less
  3. Abstract

    Mentoring is a well-known way to help newcomers to Open Source Software (OSS) projects overcome initial contribution barriers. Through mentoring, newcomers learn to acquire essential technical, social, and organizational skills. Despite the importance of OSS mentors, they are understudied in the literature. Understanding who OSS project mentors are, the challenges they face, and the strategies they use can help OSS projects better support mentors’ work. In this paper, we employ a two-stage study to comprehensively investigate mentors in OSS. First, we identify the characteristics of mentors in the Apache Software Foundation, a large OSS community, using an online survey. We found that less experienced volunteer contributors are less likely to take on the mentorship role. Second, through interviews with OSS mentors (n=18), we identify the challenges that mentors face and how they mitigate them. In total, we identified 25 general mentorship challenges and 7 sub-categories of challenges regarding task recommendation. We also identified 13 strategies to overcome the challenges related to task recommendation. Our results provide insights for OSS communities, formal mentorship programs, and tool builders who design automated support for task assignment and internship.

     
    more » « less
  4. Community code engagements -- short-term, intensive software development events -- are used by some scientific communities to create new software features and promote community building. But there is as yet little empirical support for their effectiveness. This paper presents a qualitative study of two types of community code engagements: Google Summer of Code (GSoC) and hackathons. We investigated the range of outcomes these engagements produce and the underlying practices that lead to these outcomes. In GSoC, the vision and experience of core members of the community influence project selection, and the intensive mentoring process facilitates creation of strong ties. Most GSoC projects result in stable features. The agenda setting phase of hackathons reveals high priority issues perceived by the community. Social events among the relatively large numbers of participants over brief engagements tend to create weak ties. Most hackathons result in prototypes rather than finished tools. We discuss themes and tradeoffs that suggest directions for future empirical work around designing community code engagements. 
    more » « less
  5. Hackathons are events where people who are not normally collocated converge for a few days to write code together. Hackathons, it seems, are everywhere. We know that long- term collocation helps advance technical work and facilitate enduring interpersonal relationships, but can similar benefits come from brief, hackathon-style collocation? How do participants spend their time preparing, working face-to- face, and following through these brief encounters? Do the activities participants select suggest a tradeoff between the social and technical benefits of collocation? We present results from a multiple-case study that suggest the way that hackathon-style collocation advances technical work varies across technical domain, community structure, and expertise of participants. Building social ties, in contrast, seems relatively constant across hackathons. Results from different hackathon team formation strategies suggest a tradeoff between advancing technical work and building social ties. Our findings have implications for technology support that needs to be in place for hackathons and for understanding the role of brief interludes of collocation in loosely-coupled, geographically distributed work. 
    more » « less