skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: The Entoptic Field Camera as Metaphor-Driven Research-through-Design with AI Technologies
Artificial intelligence (AI) technologies are widely deployed in smartphone photography; and prompt-based image synthesis models have rapidly become commonplace. In this paper, we describe a Research-through-Design (RtD) project which explores this shift in the means and modes of image production via the creation and use of the Entoptic Field Camera. Entoptic phenomena usually refer to perceptions of floaters or bright blue dots stemming from the physiological interplay of the eye and brain. We use the term entoptic as a metaphor to investigate how the material interplay of data and models in AI technologies shapes human experiences of reality. Through our case study using first-person design and a field study, we offer implications for critical, reflective, more-than-human and ludic design to engage AI technologies; the conceptualisation of an RtD research space which contributes to AI literacy discourses; and outline a research trajectory concerning materiality and design affordances of AI technologies.  more » « less
Award ID(s):
2142795
PAR ID:
10431794
Author(s) / Creator(s):
; ; ; ; ; ; ;
Date Published:
Journal Name:
The Entoptic Field Camera as Metaphor-Driven Research-through-Design with AI Technologies
Page Range / eLocation ID:
1 to 19
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; (, Proceedings of the American Society for Engineering Management 2020 International Annual Conference)
    Keathley, H.; Enos, J.; Parrish, M. (Ed.)
    The role of human-machine teams in society is increasing, as big data and computing power explode. One popular approach to AI is deep learning, which is useful for classification, feature identification, and predictive modeling. However, deep learning models often suffer from inadequate transparency and poor explainability. One aspect of human systems integration is the design of interfaces that support human decision-making. AI models have multiple types of uncertainty embedded, which may be difficult for users to understand. Humans that use these tools need to understand how much they should trust the AI. This study evaluates one simple approach for communicating uncertainty, a visual confidence bar ranging from 0-100%. We perform a human-subject online experiment using an existing image recognition deep learning model to test the effect of (1) providing single vs. multiple recommendations from the AI and (2) including uncertainty information. For each image, participants described the subject in an open textbox and rated their confidence in their answers. Performance was evaluated at four levels of accuracy ranging from the same as the image label to the correct category of the image. The results suggest that AI recommendations increase accuracy, even if the human and AI have different definitions of accuracy. In addition, providing multiple ranked recommendations, with or without the confidence bar, increases operator confidence and reduces perceived task difficulty. More research is needed to determine how people approach uncertain information from an AI system and develop effective visualizations for communicating uncertainty. 
    more » « less
  2. ; ; ; ; ; ; ; (, Journal of The Colloquium for Information Systems Security Education)
    Artificial Intelligence (AI) technologies have become increasingly pervasive in our daily lives. Recent breakthroughs such as large language models (LLMs) are being increasingly used globally to enhance their work methods and boost productivity. However, the advent of these technologies has also brought forth new challenges in the critical area of social cybersecurity. While AI has broadened new frontiers in addressing social issues, such as cyberharassment and cyberbullying, it has also worsened existing social issues such as the generation of hateful content, bias, and demographic prejudices. Although the interplay between AI and social cybersecurity has gained much attention from the research community, very few educational materials have been designed to engage students by integrating AI and socially relevant cybersecurity through an interdisciplinary approach. In this paper, we present our newly designed open-learning platform, which can be used to meet the ever-increasing demand for advanced training in the intersection of AI and social cybersecurity. The designed platform, which consists of hands-on labs and education materials, incorporates the latest research results in AI-based social cybersecurity, such as cyberharassment detection, AI bias and prejudice, and adversarial attacks on AI-powered systems, are implemented using Jupyter Notebook, an open-source interactive computing platform for effective hands-on learning. Through a user study of 201 students from two universities, we demonstrate that students have a better understanding of AI-based social cybersecurity issues and mitigation after doing the labs, and they are enthusiastic about learning to use AI algorithms in addressing social cybersecurity challenges for social good. 
    more » « less
  3. ; (, ACM)
    Much reporting on research-through-design (RtD) is vague about markers of time and temporal qualities. This lack of temporal attunement risks obscuring important contextual knowledge, hidden labour, material agencies and potential knowledge contributions. We turn to the notion of the event to articulate the granularities and nuances of RtD processes with an expanded vocabulary. We draw on prior calls from RtD practitioners, the philosophical roots of events, and our previous work with the term in our own research. We describe seven terms to expand the temporal vocabulary of RtD, which can be used to build narratives that emphasize knowledge created along the way, and relieve pressure from the ‘final’ artifact. Our contributions are 1) design events as an ontological shift and analytical tool and 2) a vocabulary that scaffolds design events as a sensitizing tool. We end with a call for more experimentation of non-chronological narratives of RtD. 
    more » « less
  4. ; ; (, ACM Collective Intelligence Conference)
    This paper studies the design of an AI tool that supports gig knowledge workers, rather than displacing them, focusing on text-based generative AI technologies. Through a formative study involving interviews and design activities, gig workers shared their views on text-based generative AI and envisioned applications where AI acts as managers, secretaries, and communication aids. Leveraging these insights, we created a generative-AI enhanced tool, Office-Mind AI, to aid gig workers. Our research advances the conversation around algorithmic labor by designing a worker-focused intelligent tool. This tool harness collective intelligence among workers and AI, fostering productive human-AI partnerships. We conclude by discussing the future prospects of collective intelligence tools designed for worker-AI collaborations. 
    more » « less
  5. ; ; ; ; ; ; ; (, Urban Informatics)
    Abstract This study examines the role of human dynamics within Geospatial Artificial Intelligence (GeoAI), highlighting its potential to reshape the geospatial research field. GeoAI, emerging from the confluence of geospatial technologies and artificial intelligence, is revolutionizing our comprehension of human-environmental interactions. This revolution is powered by large-scale models trained on extensive geospatial datasets, employing deep learning to analyze complex geospatial phenomena. Our findings highlight the synergy between human intelligence and AI. Particularly, the humans-as-sensors approach enhances the accuracy of geospatial data analysis by leveraging human-centric AI, while the evolving GeoAI landscape underscores the significance of human–robot interaction and the customization of GeoAI services to meet individual needs. The concept of mixed-experts GeoAI, integrating human expertise with AI, plays a crucial role in conducting sophisticated data analyses, ensuring that human insights remain at the forefront of this field. This paper also tackles ethical issues such as privacy and bias, which are pivotal for the ethical application of GeoAI. By exploring these human-centric considerations, we discuss how the collaborations between humans and AI transform the future of work at the human-technology frontier and redefine the role of AI in geospatial contexts. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email