skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 10:00 PM to 12:00 PM ET on Tuesday, March 25 due to maintenance. We apologize for the inconvenience.


Title: Interaction Templates: A Data-Driven Approach for Authoring Robot Programs
Socially interactive robots present numerous unique programming challenges for interaction developers. While modern authoring tools succeed at making the authoring experience approachable and convenient for developers from a wide variety of backgrounds, they are less successful at targeting assistance to developers based on the specific task or interaction being authored. We propose interaction templates, a data-driven solution for (1) matching in-progress robot programs to candidate task or interaction models and then (2) providing assistance to developers by using the matched models to generate modifications to in-progress programs. In this paper, we present the various dimensions that define first how interaction templates might be used, then how interaction templates may be represented, and finally how they might be collected.  more » « less
Award ID(s):
1925043 1924435
PAR ID:
10340538
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
PLATEAU: 12th Annual Workshop at theIntersection of PL and HCI
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Collaborative robots promise to transform work across many industries and promote “human-robot teaming” as a novel paradigm. However, realizing this promise requires the understanding of how existing tasks, developed for and performed by humans, can be effectively translated into tasks that robots can singularly or human-robot teams can collaboratively perform. In the interest of developing tools that facilitate this process we present Authr, an end-to-end task authoring environment that assists engineers at manufacturing facilities in translating existing manual tasks into plans applicable for human-robot teams and simulates these plans as they would be performed by the human and robot. We evaluated Authr with two user studies, which demonstrate the usability and effectiveness of Authr as an interface and the benefits of assistive task allocation methods for designing complex tasks for human-robot teams. We discuss the implications of these findings for the design of software tools for authoring human-robot collaborative plans. 
    more » « less
  2. Intelligent tutoring systems (ITSs) have consistently been shown to improve the educational outcomes of students when used alone or combined with traditional instruction. However, building an ITS is a time-consuming process which requires specialized knowledge of existing tools. Extant authoring methods, including the Cognitive Tutor Authoring Tools' (CTAT) example-tracing method and SimStudent's Authoring by Tutoring, use programming-by-demonstration to allow authors to build ITSs more quickly than they could by hand programming with model-tracing. Yet these methods still suffer from long authoring times or difficulty creating complete models. In this study, we demonstrate that Simulated Learners built with the Apprentice Learner (AL) Framework can be combined with a novel interaction design that emphasizes model transparency, input flexibility, and problem solving control to enable authors to achieve greater model completeness in less time than existing authoring methods. 
    more » « less
  3. Computer-aided design (CAD) programs are essential to engineering as they allow for better designs through low-cost iterations. While CAD programs are typically taught to undergraduate students as a job skill, such software can also help students learn engineering concepts. A current limitation of CAD programs (even those that are specifically designed for educational purposes) is that they are not capable of providing automated real-time help to students. To encourage CAD programs to build in assistance to students, we used data generated from students using a free, open-source CAD software called Aladdin to demonstrate how student data combined with machine learning techniques can predict how well a particular student will perform in a design task. We challenged students to design a house that consumed zero net energy as part of an introductory engineering technology undergraduate course. Using data from 128 students, along with the scikit-learn Python machine learning library, we tested our models using both total counts of design actions and sequences of design actions as inputs. We found that our models using early design sequence actions are particularly valuable for prediction. Our logistic regression model achieved a >60% chance of predicting if a student would succeed in designing a zero net energy house. Our results suggest that it would be feasible for Aladdin to provide useful feedback to students when they are approximately halfway through their design. Further improvements to these models could lead to earlier predictions and thus provide students feedback sooner to enhance their learning. 
    more » « less
  4. Educational technologies can provide students with adaptive feedback and guidance, but these systems lack personal interactions that make social and cultural connections to the student's own classroom and prior experiences. Social or companion robots have a high capacity for these types of interactions, but typically require advanced levels of expertise to program. In this study, we examined teachers use of an authoring tool to enable them to leverage their classroom-based expertise to design robot-assisted homework assignments, and explore how seeing a robot enact their designs influences their work. We found that the tool enabled the teachers to create novel social interactions for homework activities that were similar to their classroom interaction patterns. These interaction designs evolved over time and were shaped by the teacher's emerging mental model of the social robot, their concept of the students' perspective of these interactions, and a shift towards informal classroom-like interaction paradigms, thus transforming their view of what they can achieve with homework. We discuss how these findings demonstrate how the context of the activity can influence initial mental models of social activities and suggest practical guidance on designing authoring tools to best facilitate the creation of computer or robot supported social activities, such as homework. 
    more » « less
  5. Abstract This commentary discusses new advances in the predictability of east African rains and highlights the potential for improved early warning systems (EWS), humanitarian relief efforts, and agricultural decision‐making. Following an unprecedented sequence of five droughts, 23 million east Africans faced starvation in 2022, requiring >$2 billion in aid. Here, we update climate attribution studies showing that these droughts resulted from an interaction of climate change and La Niña. Then we describe, for the first time, how attribution‐based insights can be combined with the latest dynamical models to predict droughts at 8‐month lead‐times. We then discuss behavioral and social barriers to forecast use, and review literature examining how EWS might (or might not) enhance agro‐pastoral advisories and humanitarian interventions. Finally, in reference to the new World Meteorological Organization “Early Warning for All” Executive Action Plan, we conclude with a set of recommendations supporting actionable and authoritative climate services.Trust,urgency, andaccuracycan help overcome barriers created bylimitedfunding,uncertain tradeoffs, andinertia. Understanding how climate change is producing predictable climate extremes now, investing in African‐led EWS, and building better links between EWS and agricultural development efforts can support long‐term adaptation, reducing chronic needs for billions of dollars in reactive assistance. In Africa and beyond, climate change brings increasingly extreme sea surface temperature (SST) gradients. Using climate models, we can often see these extremes coming. Prediction, therefore, offers opportunities for proactive risk management and improved advisory services, if we can create effective societal linkages via cross‐silo collaborations. 
    more » « less