skip to main content


Title: A Vision of Augmented Reality for Urban Search and Rescue
Search and rescue (SAR) operations are often nearly computer-technology-free due to the fragility and connectivity needs of current information communication technology (ICT). In this design fiction, we envision a world where SAR uses augmented reality (AR) and the surplus labor of volunteers during crisis response efforts. Unmanned aerial vehicles, crowdsourced mapping platforms, and concepts from video game mapping technologies can all be mixed to keep SAR operations complexity-free while incorporating ICTs. Our scenario describes a near-future SAR operation with currently available technology being assembled and deployed without issue. After our scenario, we discuss socio-technical barriers for technology use like technical fragility and overwhelming complexity. We also discuss how to work around those barriers and how to use video games as a testbed for SAR technology. We hope to inspire more resilient ICT design that is accessible without training.  more » « less
Award ID(s):
1651532
NSF-PAR ID:
10174283
Author(s) / Creator(s):
; ;
Publisher / Repository:
ACM Digital Library
Date Published:
Journal Name:
Proceedings of the Halfway to the Future Symposium 2019
Page Range / eLocation ID:
1 - 4
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Background Over the past 2 decades, various desktop and mobile telemedicine systems have been developed to support communication and care coordination among distributed medical teams. However, in the hands-busy care environment, such technologies could become cumbersome because they require medical professionals to manually operate them. Smart glasses have been gaining momentum because of their advantages in enabling hands-free operation and see-what-I-see video-based consultation. Previous research has tested this novel technology in different health care settings. Objective The aim of this study was to review how smart glasses were designed, used, and evaluated as a telemedicine tool to support distributed care coordination and communication, as well as highlight the potential benefits and limitations regarding medical professionals’ use of smart glasses in practice. Methods We conducted a literature search in 6 databases that cover research within both health care and computer science domains. We used the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology to review articles. A total of 5865 articles were retrieved and screened by 3 researchers, with 21 (0.36%) articles included for in-depth analysis. Results All of the reviewed articles (21/21, 100%) used off-the-shelf smart glass device and videoconferencing software, which had a high level of technology readiness for real-world use and deployment in care settings. The common system features used and evaluated in these studies included video and audio streaming, annotation, augmented reality, and hands-free interactions. These studies focused on evaluating the technical feasibility, effectiveness, and user experience of smart glasses. Although the smart glass technology has demonstrated numerous benefits and high levels of user acceptance, the reviewed studies noted a variety of barriers to successful adoption of this novel technology in actual care settings, including technical limitations, human factors and ergonomics, privacy and security issues, and organizational challenges. Conclusions User-centered system design, improved hardware performance, and software reliability are needed to realize the potential of smart glasses. More research is needed to examine and evaluate medical professionals’ needs, preferences, and perceptions, as well as elucidate how smart glasses affect the clinical workflow in complex care environments. Our findings inform the design, implementation, and evaluation of smart glasses that will improve organizational and patient outcomes. 
    more » « less
  2. null (Ed.)
    Unoccupied Aerial Vehicles (UAVs), or drone technologies, with their high spatial resolution, temporal flexibility, and ability to repeat photogrammetry, afford a significant advancement in other remote sensing approaches for coastal mapping, habitat monitoring, and environmental management. However, geographical drone mapping and in situ fieldwork often come with a steep learning curve requiring a background in drone operations, Geographic Information Systems (GIS), remote sensing and related analytical techniques. Such a learning curve can be an obstacle for field implementation for researchers, community organizations and citizen scientists wishing to include introductory drone operations into their work. In this study, we develop a comprehensive drone training program for research partners and community members to use cost-effective, consumer-quality drones to engage in introductory drone mapping of coastal seagrass monitoring sites along the west coast of North America. As a first step toward a longer-term Public Participation GIS process in the study area, the training program includes lessons for beginner drone users related to flying drones, autonomous route planning and mapping, field safety, GIS analysis, image correction and processing, and Federal Aviation Administration (FAA) certification and regulations. Training our research partners and students, who are in most cases novice users, is the first step in a larger process to increase participation in a broader project for seagrass monitoring in our case study. While our training program originated in the United States, we discuss our experiences for research partners and communities around the globe to become more confident in introductory drone operations for basic science. In particular, our work targets novice users without a strong background in geographic research or remote sensing. Such training provides technical guidance on the implementation of a drone mapping program for coastal research, and synthesizes our approaches to provide broad guidance for using drones in support of a developing Public Participation GIS process. 
    more » « less
  3. Many studies show that college engineering students’ sense of ethical and social responsibility declines over the course of their college careers (Cech, 2014; Canny & Bielefeldt, 2015; Schiff et al., 2021). One reason is that many college engineering programs and courses reinforce the social-technical dualism, which treats social and macro-ethical issues as distinct from the technical work more often associated with “real” engineering. Some programs, like the Science, Technology and Society (STS) program at [institution made confidential for review], attempt to challenge this dualism by supporting the integration of social and technical considerations within students’ design work and by asking students to grapple with the complex ethics of their work. However, this program is still embedded within a department, university, and society that subscribes to harmful ideologies such as technocracy, capitalism, and meritocracy, which value efficiency, surveillance, and control. These ideologies and their associated values constrain the imagination for what is possible in design work, for instance, by relying on technological ‘quick fixes’ to address complex social problems or by propping up large corporations as innovators, without adequately grappling with the harm that these corporations might be doing. This cultural reality creates an uphill battle for educators attempting to support engineering students’ sense of social consciousness and ethical responsibility. Thus, this study attempts to understand how engineering students’ imaginations are being constrained by societal structures and ideologies and when do they “break free” from these constraints? In this paper, we present a preliminary analysis of first-year STS students collaboratively reasoning through a simulated design scenario about a small community store facing challenges related to the Covid-19 pandemic (adapted from Gupta, 2017). Using discourse and narrative analysis, we analyzed multiple focus group interviews to identify what we call “co-occurrences,” or ideas that tend to hang together in participants’ reasoning. Examining these co-occurrences provides insight into the variety of ways socio-technical imaginaries play out in students’ design thinking. 
    more » « less
  4. Research has shown that engineering students are graduating without all of the skills that they need to succeed in professional engineering practice. While undergraduate engineering programs emphasize technical design and analysis, they generally do not adequately teach or discuss marketability, and evidence suggests that engineering students are graduating without a sufficient grasp of the bigger picture of design. This is reinforced by the available tools for use in engineering education, which are highly focused on ensuring technical feasibility, and a corresponding lack of tools for engineers to explore other design needs. At the same time, research in engineering design has resulted in new market-driven design techniques, which provide guidance for design practitioners regarding how to develop products that are both technically sound and marketable. However, this concept of market-driven design has not yet been widely integrated into engineering curricula. By exploring how current students conceptualize design, this study seeks to contribute to a more balanced perspective on design in undergraduate engineers that accounts for both technical feasibility and market needs. In this paper, we examine third-year Engineering Management students’ mental models of design prior to and after a project-based design course that emphasizes market-driven design concepts and tools. The fundamental research questions are: (1) To what extent do undergraduate engineering students' initial conceptions of design account for the market context, such as competition and consumer considerations? (2) In what ways do these design conceptions change after introducing market-driven design techniques and tools in a design course? Using concept mapping exercises (pre- and post-course), open-ended reflection assignments, surveys, and an assessment of project performance, we reveal how students conceive of and learn about the market context as an integral part of the design process. This contributes to insights regarding how students conceptually balance the technical and non-technical elements of design, as well as evidence regarding the value of a constructivism-based educational approach to advancing student understanding of market-driven design. The results provide a foundational understanding and recommendations regarding holistic design education for engineers in order to reduce the school to work transition gap. 
    more » « less
  5. This paper describes the temporal progression of human and social dimensions that undergraduate information and communications technology (ICT) students realized during an experiential learning externship where they explored digital divide technology solutions for low-income neighborhoods in the surrounding urban community. The described research represents significant adaptation and use of socio-technical integration research (STIR) with undergraduate ICT students engaged in work based experiential learning to promote equity in STEM education, instill a sense of civic responsibility, and practice approaches to tackling complex societal problems. Methods used for the research study included: STIR, semi-structured interviews, and on-site group observations. Using STIR, an embedded social scientist conducted regular one-on-one dialogs with three of four student externs, to collaboratively describe each student’s consideration of human and social dimensions as part of their technical work, explore alternative choices and their potential outcomes, and engage in reflexive learning that in some cases, influenced deliberate changes to material and behavioral practices. The on-site observation of group activities within the ICT innovation center situated in the local urban community provided additional ecosystem context during technical solution design and development of the digital divide solution for local high schools and feeder schools. Outcomes for participating undergraduate ICT students showed: 1) Technology learning improvements for all students; 2) Capacity building to reflect, anticipate and respond to socio-technical interactions for some students; and 3) Each student was able to progress to a new level of socio-technical learning and decision making. Reflexive discourse with participants surfaced cultural assets and consideration of alternative knowledges in collaborative technology design, development, and implementation that can potentially lead to solutions that are more community centered now and in the future as the ICT students transition to the workforce. 
    more » « less