skip to main content


The NSF Public Access Repository (NSF-PAR) system and access will be unavailable from 11:00 PM ET on Friday, July 12 until 9:00 AM ET on Saturday, July 13 due to maintenance. We apologize for the inconvenience.

Title: CoFrame: A System for Training Novice Cobot Programmers
The introduction of collaborative robots (cobots) into the workplace has presented both opportunities and challenges for those seeking to utilize their functionality. Prior research has shown that despite the capabilities afforded by cobots, there is a disconnect between those capabilities and the applications that they currently are deployed in, partially due to a lack of effective cobot-focused instruction in the field. Experts who work successfully within this collaborative domain could offer insight into the considerations and process they use to more effectively capture this cobot capability. Using an analysis of expert insights in the collaborative interaction design space, we developed a set of Expert Frames based on these insights and integrated these Expert Frames into a new training and programming system that can be used to teach novice operators to think, program, and troubleshoot in ways that experts do. We present our system and case studies that demonstrate how Expert Frames provide novice users with the ability to analyze and learn from complex cobot application scenarios.  more » « less
Award ID(s):
1822872 1925043
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
HRI '22: Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction
Page Range / eLocation ID:
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Ruis, Andrew R. ; Lee, Seung B. (Ed.)
    Rapid advances in technology also come with increased training needs for people who engineer and interact with these technologies. One such technology is collaborative robots, cobots, which are designed to be safer and easier to use than their traditional robotic counterparts. However, there have been few studies of how people use cobots and even fewer identifying what a user must know to properly set up and effectively use cobots for their manufacturing processes. In this study, we interviewed nine experts in robots and automation in manufacturing settings. We employ a quantitative ethnographic approach to gain qualitative insights into the cultural practices of robotics experts and corroborate these stories with quantitative warrants. Both quantitative and qualitative analyses revealed that experts put safety first when designing and monitoring cobot applications. This study improves our understanding of expert problem-solving in collaborative robotics, defines an expert model that can serve as a basis for the development of an authentic learning technology, and illustrates a useful method for modeling expertise in vocational settings. 
    more » « less
  2. Collaborative robots, or cobots, represent a breakthrough technology designed for high-level (e.g., collaborative) interactions between workers and robots with capabilities for flexible deployment in industries such as manufacturing. Understanding how workers and companies use and integrate cobots is important to inform the future design of cobot systems and educational technologies that facilitate effective worker-cobot interaction. Yet, little is known about typical training for collaboration and the application of cobots in manufacturing. To close this gap, we interviewed nine experts in manufacturing about their experience with cobots. Our thematic analysis revealed that, contrary to the envisioned use, experts described most cobot applications as only low-level (e.g., pressing start/stop buttons) interactions with little flexible deployment, and experts felt traditional robotics skills were needed for collaborative and flexible interaction with cobots. We conclude with design recommendations for improved future robots, including programming and interface designs, and educational technologies to support collaborative use. 
    more » « less
  3. Collaborative robots (cobots) are increasingly utilized within the manufacturing industry. However, despite the promise of collaboration and easier programming when compared to traditional industrial robots, cobots introduce new interaction paradigms that require more thought about the environment and distribution of tasks to fully realize their collaboration capabilities. Due to these additional requirements, these collaboration capabilities are underutilized in current manufacturing. Therefore, to make cobots more accessible and easy to use, new systems need to be developed that support users during interaction. In this research, we propose a set of tools that target cobot use for multiple groups of individuals that use them, to better support users and simplify cobot collaboration. 
    more » « less
  4. null (Ed.)
    It is hard for experts to create good instructional resources due to a phenomenon known as the expert blind spot: They forget what it was like to be a novice, so they cannot pinpoint exactly where novices commonly struggle and how to best phrase their explanations. To help overcome these expert blind spots for computer programming topics, we created a learnersourcing system that elicits explanations of misconceptions directly from learners while they are coding. We have deployed this system for the past three years to the widely-used Python Tutor coding website ( and collected 16,791 learner-written explanations. To our knowledge, this is the largest dataset of explanations for programming misconceptions. By inspecting this dataset, we found surprising insights that we did not originally think of due to our own expert blind spots as programming instructors. We are now using these insights to improve compiler and run-time error messages to explain common novice misconceptions. 
    more » « less
  5. Robots are ubiquitous in small-to-large-scale manufacturers. While collaborative robots (cobots) have significant potential in these settings due to their flexibility and ease of use, proper integration is critical to realize their full potential. Specifically, cobots need to be integrated in ways that utilize their strengths, improve manufacturing performance, and facilitate use in concert with human workers. Efective integration requires careful consideration and the knowledge of roboticists, manufacturing engineers, and business administrators. We propose an approach involving the stages of planning, analysis, development, and presentation, to inform manufacturers about cobot integration within their facilities prior to the integration process. We contextualize our approach in a case study with an SME collaborator and discuss insights learned. 
    more » « less