skip to main content

Title: Scheduling and Path-Planning for Operator Oversight of Multiple Robots
There is a need for semi-autonomous systems capable of performing both automated tasks and supervised maneuvers. When dealing with multiple robots or robots with high complexity (such as humanoids), we face the issue of effectively coordinating operators across robots. We build on our previous work to present a methodology for designing trajectories and policies for robots such that a few operators can supervise multiple robots. Specifically, we: (1) Analyze the complexity of the problem, (2) Design a procedure for generating policies allowing operators to oversee many robots, (3) Present a method for designing policies and robot trajectories to allow operators to oversee multiple robots, and (4) Include both simulation and hardware experiments demonstrating our methodologies.
; ; ; ;
Award ID(s):
2034123 2024733
Publication Date:
Journal Name:
Page Range or eLocation-ID:
Sponsoring Org:
National Science Foundation
More Like this
  1. Rapid advancements in Artificial Intelligence have shifted the focus from traditional human-directed robots to fully autonomous ones that do not require explicit human control. These are commonly referred to as Human-on-the-Loop (HotL) systems. Transparency of HotL systems necessitates clear explanations of autonomous behavior so that humans are aware of what is happening in the environment and can understand why robots behave in a certain way. However, in complex multi-robot environments, especially those in which the robots are autonomous and mobile, humans may struggle to maintain situational awareness. Presenting humans with rich explanations of autonomous behavior tends to overload them with lots of information and negatively affect their understanding of the situation. Therefore, explaining the autonomous behavior of multiple robots creates a design tension that demands careful investigation. This paper examines the User Interface (UI) design trade-offs associated with providing timely and detailed explanations of autonomous behavior for swarms of small Unmanned Aerial Systems (sUAS) or drones. We analyze the impact of UI design choices on human awareness of the situation. We conducted multiple user studies with both inexperienced and expert sUAS operators to present our design solution and initial guidelines for designing the HotL multi-sUAS interface.
  2. Planning locomotion trajectories for legged microrobots is challenging. This is because of their complex morphology, high frequency passive dynamics, and discontinuous contact interactions with their environment. Consequently, such research is often driven by time-consuming experimental methods. As an alternative, we present a framework for systematically modeling, planning, and controlling legged microrobots. We develop a three- dimensional dynamic model of a 1.5 g quadrupedal microrobot with complexity (e.g., number of degrees of freedom) similar to larger-scale legged robots. We then adapt a recently developed variational contact-implicit trajectory optimization method to generate feasible whole-body locomotion plans for this microrobot, and demonstrate that these plans can be tracked with simple joint-space controllers. We plan and execute periodic gaits at multiple stride frequencies and on various surfaces. These gaits achieve high per-cycle velocities, including a maximum of 10.87 mm/cycle, which is 15% faster than previously measured for this microrobot. Furthermore, we plan and execute a vertical jump of 9.96 mm, which is 78% of the microrobot’s center-of- mass height. To the best of our knowledge, this is the first end-to-end demonstration of planning and tracking whole-body dynamic locomotion on a millimeter-scale legged microrobot.
  3. We present a data-driven algorithm for efficiently computing stochastic control policies for general joint chance constrained optimal control problems. Our approach leverages the theory of kernel distribution embeddings, which allows representing expectation operators as inner products in a reproducing kernel Hilbert space. This framework enables approximately reformulating the original problem using a dataset of observed trajectories from the system without imposing prior assumptions on the parameterization of the system dynamics or the structure of the uncertainty. By optimizing over a finite subset of stochastic open-loop control trajectories, we relax the original problem to a linear program over the control parameters that can be efficiently solved using standard convex optimization techniques. We demonstrate our proposed approach in simulation on a system with nonlinear non-Markovian dynamics navigating in a cluttered environment.
  4. Social robots are emerging as an important intervention for a variety of vulnerable populations. However, engaging participants in the design of social robots in a way that is ethical, meaningful, and rigorous can be challenging. Many current methods in human–robotic interaction rely on laboratory practices, often experimental, and many times involving deception which could erode trust in vulnerable populations. Therefore, in this paper, we share our human-centered design methodology informed by a participatory approach, drawing on three years of data from a project aimed to design and develop a social robot to improve the mental health of teens. We present three method cases from the project that describe creative and age appropriate methods to gather contextually valid data from a teen population. Specific techniques include design research, scenario and script writing, prototyping, and teens as operators and collaborative actors. In each case, we describe the method and its implementation and discuss the potential strengths and limitations. We conclude by situating these methods by presenting a set of recommended participatory research principles that may be appropriate for designing new technologies with vulnerable populations.
  5. This paper draws on ethnographic fieldwork conducted with Alaskan engineers, builders, and housing experts on cold climate housing design in Native Alaskan communities and explores multiple levels of challenges to designing and building in remote areas. It examines how the history of land ownership and governance in Alaska shapes the imaginaries of engineers and builders working to address housing equity in the state. Specifically, we study cold climate housing projects being carried out in Alaska and compare the design of these projects to wider colonial legacies and failed housing policies. This includes examining both considerations that need to be made at the start of design and engineering projects, as well as how complexity figures into the culture of cold climate engineers and builders in Alaska. Theoretically, this paper draws on Annemarie Mol and John Law’s conceptualization of complexity as a social practice (2002), in which they argue against reductionism by calling attention to the “multiplicity” of ways in which actions and knowledge come into being. In drawing on this work, we seek to engage with multiple histories and worldviews, including dominant notions of “home” that contribute to reproducing housing insecurity and colonial legacies in rural communities (Christensen 2017). Building onmore »this theoretical framework, we thread together a critical description of the social terrain in which engineering and building projects in remote Alaska Native communities are situated. Such situated understandings necessitate engineers and builders working on these projects to think locally while recognizing the broader contributions of home designs developed thousands of miles from the Arctic. The implications of this complexity, we argue, are important for engineering educators and students to incorporate in their approaches to design and engineering learning opportunities across multiple contexts, including engineering programs, construction, architecture, industrial design, environmental and sustainability science, and the social sciences. To address complex challenges in which these disciplines must all take part, engineers and others who make up these teams of diverse expertise must navigate layers of complexity and understand and value how social forces shape building projects. Cold climate contexts like the ones we describe here provide examples that can engage educators, learners, and practitioners.« less