skip to main content


Title: Misdirection in Robot Teams: Methods and Ethical Considerations
Trust, dependability, cohesion, and capability are integral to an effective team. These attributes are the same for teams of robots. When multiple teams with competing incentives are tasked, a strategy, if available, may be to weaken, influence or sway the attributes of other teams and limit their understanding of their full range of options. Such strategies are widely found in nature and in sporting contests such as feints, misdirection, etc. This talk focuses on one class of higher-level strategies for multi-robots, i.e., to intentionally misdirect using shills or confederates where needed, and the ethical considerations associated with deploying such teams. As multi-robot systems become more autonomous, distributed, networked, numerous, and with more capability to make critical decisions, the prospect for intentional and unintentional misdirection must be anticipated. While benefits are clearly apparent to the team performing the deception, ethical questions surrounding the use of misdirection or other forms of deception are quite real.  more » « less
Award ID(s):
1848653
NSF-PAR ID:
10098534
Author(s) / Creator(s):
Date Published:
Journal Name:
2019 International Association for Computing and Philosophy annual conference
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Teams of robots tasked with making critical decisions in competitive environments are at risk for being shepherded or misdirected to a location that is advantageous for a competing team. Our lab is working to understand how adversarial teams of robots can successfully move their competition to desired locations in part so that we can then devise practices to counter these strategies and help make team functioning more successful and secure. In this paper, preliminary research is presented that studies how a team of robots can be shepherded or misdirected to a disadvantageous location. We draw inspiration from herding practices as well as deceptive practices seen in higher-order primates and humans. We define behaviors for the target (mark) agents to be moved as well as members of the shepherding team (a pushing agent and pulling shills) and present simulation results showing how these behaviors move robots to a desired location. These behaviors were implemented and trialed on hardware platform. A discussion of ongoing research into understanding misdirection in multi-robot teams concludes this paper. 
    more » « less
  2. This NSF funded project currently underway studies strategies to enable robots, multi-robots and teams of multi-robots to model, generate, and cope with misdirection in various situations. This research direction in robotic control offers a novel approach to resilience in and among these teams to these forms of possible disruption. Computational models, drawn particularly from studies of human endeavors and group behaviors, provide a general framework for understanding, producing, and countering misdirection in robotic systems. A framework of computational models will be designed using recursive schema-theoretic models of behaviors at the individual and team levels, building on decentralized methods of control and communication. 
    more » « less
  3. null (Ed.)
    When teams of mobile robots are tasked with different goals in a competitive environment, misdirection and counter-misdirection can provide significant advantages. Researchers have studied different misdirection methods but the number of approaches on counter-misdirection for multi-robot systems is still limited. In this work, a novel counter-misdirection approach for behavior-based multi-robot teams is developed by deploying a new type of agent: counter misdirection agents (CMAs). These agents can detect the misdirection process and “push back” the misdirected agents collaboratively to stop the misdirection process. This approach has been implemented not only in simulation for various conditions, but also on a physical robotic testbed to study its effectiveness. It shows that this approach can stop the misdirection process effectively with a sufficient number of CMAs. This novel counter-misdirection approach can potentially be applied to different competitive scenarios such as military and sports applications. 
    more » « less
  4. We consider the problem of multi-robot sensor coverage, which deals with deploying a multi-robot team in an environment and optimizing the sensing quality of the overall environment. As real-world environments involve a variety of sensory information, and individual robots are limited in their available number of sensors, successful multi-robot sensor coverage requires the deployment of robots in such a way that each individual team member’s sensing quality is maximized. Additionally, because individual robots have varying complements of sensors and both robots and sensors can fail, robots must be able to adapt and adjust how they value each sensing capability in order to obtain the most complete view of the environment, even through changes in team composition. We introduce a novel formulation for sensor coverage by multi-robot teams with heterogeneous sensing capabilities that maximizes each robot's sensing quality, balancing the varying sensing capabilities of individual robots based on the overall team composition. We propose a solution based on regularized optimization that uses sparsity-inducing terms to ensure a robot team focuses on all possible event types, and which we show is proven to converge to the optimal solution. Through extensive simulation, we show that our approach is able to effectively deploy a multi-robot team to maximize the sensing quality of an environment, responding to failures in the multi-robot team more robustly than non-adaptive approaches. 
    more » « less
  5. Complex problems require complex teams comprised of individuals with different backgrounds, skills and perspectives to work effectively toward their solution. Increasingly, this is being accomplished through the creation of multi-team systems (MTS) that are developed and implemented in alignment with team science-based strategies. MTS are comprised of individual teams with their own goals that are interconnected and work collaboratively toward a larger, common goal. Attitudinal (cohesion, trust, commitment), behavioral (coordination, communication, shared leadership) and cognitive (situational awareness, shared mental models) competencies support MTS effectiveness. Multisector MTS are even more complex, as team members bring aspects of their organizational culture into the MTS, and if priorities and practices are not well aligned, team function and effectiveness can suffer. Thus, for multisector MTS to work, they must begin with a foundational understanding of the component parts, that is, each organization’s culture and priorities, and how – or if – they align for the success of the collaborative. We created a multisector MTS to develop and implement a project funded by the National Science Foundation’s (NSF’s) Scholarships in Science, Technology, Engineering and Mathematics (S-STEM) program. The project’s objectives are to: increase the number of domestic low-income academically talented students with demonstrated financial need obtaining master's degrees in supported disciplines and entering the US STEM workforce; implement and evaluate the impact of our Flexible Internship-Research-Education (FIRE) model, which integrates evidence-based strategies that provide student career and educational development support, on student success; and implement, study and disseminate an MTS model for multi -organizational collaboration toward career and educational development. The partners include four universities – three Carnegie R2 public Historically Black Colleges and Universities and one Carnegie R1 private, highly selective admissions institution – and a major government employer. Six teams comprise our MTS; with the exception of one, each team has representatives from each partner organization. We sought to understand how each organization’s culture influenced – or might potentially influence – team interactions. The guiding research question for this study is: In what ways – positive or negative – do partner organizations’ cultures impact team members’ engagement with the project? We were interested in gauging how organizational culture, operationalized by performance values (rewarding individual performance vs. team performance), communications (transparent vs. need-to-know, clarity, frequency), conflict resolution and collaborative vs. competitive environments, manifested in their engagement with the MTS. We also explored how – or if – their organization’s priorities aligned with the overall project’s aims and what specific areas might be sources of support and/or challenges as the teams progressed. We conducted open-ended structured interviews with eight project team members who each served on at least one of the six teams. We are completing both content and thematic analyses to understand how team members speak about their organizational influences and engagements within and among the teams. We are finding team members are adaptable; regardless of individual or organizational priorities, when challenges arise, they can re-center on the project’s aims and work collaboratively toward student success. We expect results will illuminate factors multisector MTS teams should consider when forming collaborations. 
    more » « less