An official website of the United States government
Patent applications provide insight into how inventors imagine and legitimize uses of their imagined technologies; as part of this imagining they envision social worlds and produce sociotechnical imaginaries. Examining sociotechnical imaginaries is important for emerging technologies in high-stakes contexts such as the case of emotion AI to address mental health care. We analyzed emotion AI patent applications (N=58) filed in the U.S. concerned with monitoring and detecting emotions and/or mental health. We examined the described technologies' imagined uses and the problems they were positioned to address. We found that inventors justified emotion AI inventions as solutions to issues surrounding data accuracy, care provision and experience, patient-provider communication, emotion regulation, and preventing harms attributed to mental health causes. We then applied an ethical speculation lens to anticipate the potential implications of the promissory emotion AI-enabled futures described in patent applications. We argue that such a future is one filled with mental health conditions' (or 'non-expected' emotions') stigmatization, equating mental health with propensity for crime, and lack of data subjects' agency. By framing individuals with mental health conditions as unpredictable and not capable of exercising their own agency, emotion AI mental health patent applications propose solutions that intervene in this imagined future: intensive surveillance, an emphasis on individual responsibility over structural barriers, and decontextualized behavioral change interventions. Using ethical speculation, we articulate the consequences of these discourses, raising questions about the role of emotion AI as positive, inherent, or inevitable in health and care-related contexts. We discuss our findings' implications for patent review processes, and advocate for policy makers, researchers and technologists to refer to patent (applications) to access, evaluate and (re)consider potentially harmful sociotechnical imaginaries before they become our reality.
more »
« less
This content will become publicly available on June 23, 2026
Understanding experiences with compulsory immigration surveillance in the U.S.
People attempting to immigrate to the U.S. (through a port of entry or other means) may be required to accept various forms of surveillance technologies after interacting with immigration officials. In March 2025, around 160,000 people in the U.S. were required to use a smartphone application—BI SmartLINK—that uses facial recognition, voice recognition, and location tracking; others were assigned an ankle monitor or a smartwatch. These compulsory surveillance technologies exist under Immigration and Custom Enforcement (ICE)’s Alternatives to Detention (ATD) program, a combination of surveillance technologies, home visits, and in-person meetings with ICE officials and third-party “case specialists.” For migrants in the U.S. who are already facing multiple other challenges, such as securing housing, work, or healthcare, the surveillance technologies administered under ATD introduce new challenges. To understand the challenges facing migrants using BI SmartLINK under ATD, their questions about the app, and what role technologists might play (if any) in addressing these challenges, we conducted an interview study (n=9) with immigrant rights advocates. These advocates have collectively supported thousands of migrants over their careers and witnessed firsthand their struggles with surveillance tech under ATD. Among other things, our findings highlight how surveillance tech exacerbates the power imbalance between migrants and ICE officials (or their proxies), how these technologies (negatively) impact migrants, and how migrants and their advocates struggle to understand how the technologies that surveil them function. Our findings regarding the harms experienced by migrants lead us to believe that BI SmartLINK should not be used, and these harms fundamentally cannot be addressed by improvements to the app’s functionality or design. However, as this technology is currently deployed, we end by highlighting intervention opportunities for technologists to use our findings to make these high-stakes technologies less opaque for migrants and their advocates.
more »
« less
- PAR ID:
- 10627245
- Publisher / Repository:
- ACM
- Date Published:
- ISBN:
- 9798400714825
- Page Range / eLocation ID:
- 887 to 899
- Format(s):
- Medium: X
- Location:
- Athens Greece
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
While much of the transgender health literature has focused on poor health outcomes, less research has examined how trans people find reliable information on, and actually go about accessing, gender-affirming healthcare. Through qualitative interviews with creators of trans technologies, that is, technologies designed to address problems that trans people face, we found that digital technologies have become important tools for proliferating access to gender-affirming care and related health information. We found that technologists often employed different processes for creating their technologies, but they coalesced around the goal of enabling and increasing access to gender-affirming care. Creators of trans health technologies also encountered precarious conditions for creating and maintaining their technologies, including regional gaps left by national resources focused on the US east and west coasts. Findings demonstrated that trans tech creators were motivated to create and maintain these technologies as a means of caring for one another and forming trans communities in spite of the precarious conditions trans people face living under systemic oppression.more » « less
-
Increased use of technology in schools raises new privacy and security challenges for K-12 students---and harms such as commercialization of student data, exposure of student data in security breaches, and expanded tracking of students---but the extent of these challenges is unclear. In this paper, first, we interviewed 18 school officials and IT personnel to understand what educational technologies districts use and how they manage student privacy and security around these technologies. Second, to determine if these educational technologies are frequently endorsed across United States (US) public schools, we compiled a list of linked educational technology websites scraped from 15,573 K-12 public school/district domains and analyzed them for privacy risks. Our findings suggest that administrators lack resources to properly assess privacy and security issues around educational technologies even though they do pose potential privacy issues. Based on these findings, we make recommendations for policymakers, educators, and the CHI research community.more » « less
-
Past research shows that crises reveal the sensitive spots of established ideologies and practices, thereby providing opportunities for social change. We investigated immigration control amid the pandemic crisis, focusing on potential openings for both challengers and proponents of immigration detention. We asked: How have these groups responded to the pandemic crisis? Have they called for transformative change? We analyzed an original data set of primary content derived from immigrant advocates and stakeholders of the immigration detention industry. We found as the pandemic ravaged the world, it did not appear to result in significant cracks in the industry, as evidenced by the consistency of narratives dating back to pre-pandemic times. The American Civil Liberties Union’s (ACLU) criticisms of inhumane conditions in immigration detention resembled those from its pre-pandemic advocacy. Private prison companies, including CoreCivic and GEO Group, emphasized their roles as ordinary businesses rather than detention managers during the pandemic, just as they had before the crisis. U.S. Immigration and Customs Enforcement (ICE), however, manufactured an alternative storyline, emphasizing “COVID fraud” as the real threat to the “Homeland.” Although it did not call for radical change, it radically shifted its rhetoric in response to the pandemic. We discuss how these organizations’ indifference towards structural racism contributes to racial apathy and how the obliviousness and irresponsibility of industry stakeholders resembles white ignorance.more » « less
-
There is a rich literature on technology’s role in facilitating employee monitoring in the workplace. The COVID-19 pandemic created many challenges for employers, and many companies turned to new forms of monitoring to ensure remote workers remained productive; however, these technologies raise important privacy concerns as the boundaries between work and home are further blurred. In this paper, we present findings from a study of 645 US workers who spent at least part of 2020 working remotely due to the pandemic. We explore how their work experiences (job satisfaction, stress, and security) changed between January and November 2020, as well as their attitudes toward and concerns about being monitored. Findings support anecdotal evidence that the pandemic has had an uneven effect on workers, with women reporting more negative effects on their work experiences. In addition, while nearly 40% of workers reported their employer began using new surveillance tools during the pandemic, a significant percentage were unsure, suggesting there is confusion or a lack of transparency regarding how new policies are communicated to staff. We consider these findings in light of prior research and discuss the benefits and drawbacks of various approaches to minimize surveillance-related worker harms.more » « less
