skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Multi-Person Activity Recognition in Continuously Monitored Smart Homes
Activity recognizers are challenging to design for continuous, in-home settings. However, they are notoriously difficult to create when there is more than one resident in the home. Despite recent efforts, there remains a need for an algorithm that can estimate the number of residents in the house, split a time series stream into separate substreams, and accurately identify each resident's activities. To address this challenge, we introduce Gamut . This novel unsupervised method jointly estimates the number of residents and associates sensor readings with those residents, based on a multi-target Gaussian mixture probability hypothesis density filter. We hypothesize that the proposed method will offer robust recognition for homes with two or more residents. In experiments with labeled data collected from 50 single-resident and 11 multi-resident homes, we observe that Gamut outperforms previous unsupervised and supervised methods, offering a robust strategy to track behavioral routines in complex settings.  more » « less
Award ID(s):
1954372
PAR ID:
10418203
Author(s) / Creator(s):
;
Date Published:
Journal Name:
IEEE Transactions on Emerging Topics in Computing
Volume:
10
Issue:
2
ISSN:
2376-4562
Page Range / eLocation ID:
1130-1141
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Smart homes are gaining popularity due to their convenience and efficiency, both of which come at the expense of increased complexity of Internet of Things (IoT) devices. Due to the number and heterogeneity of IoT devices, technologically inexperienced or time-burdened residents are unlikely to manage the setup and maintenance of IoT apps and devices. We highlight the need for a "HandyTech": a technically skilled contractor who can set up, repair, debug, monitor, and troubleshoot home IoT systems. In this paper, we consider the potential privacy challenges posed by the HandyTech, who has the ability to access IoT devices and private data. We do so in the context of single and multi-user smart homes, including rental units, condominiums, and temporary guests or workers. We examine the privacy harms that can arise when a HandyTech has legitimate access to information, but uses it in unintended ways. By providing insights for the development of privacy control policies and measures in-home IoT environments in the presence of the HandyTech, we capture the privacy concerns raised by other visitors to the home, including temporary residents, part-time workers, etc. This helps lay a foundation for the broad set of privacy concerns raised by home IoT systems. 
    more » « less
  2. Communities near the wildland urban interface (WUI) are exposed to a mix of three interconnected hazards (wildfire, flood, and mudslide), and understanding multi-hazard perceptions is critically important for emergency preparation and hazard mitigation—particularly given the WUI’s rapid expansion and intensifying environmental hazards. Based on a survey of residents living near recent burn scars in Southern California, we document cross-over effects in hazard perceptions, where resident experience with one hazard was associated with greater hazard rankings for other hazards. Additionally, for all three hazards analyzed we document perceptions of increasing hazard levels with increasing spatial scales (home, near-home, neighborhood, and community), providing evidence of spatial optimism, or the tendency to discount proximate hazards. This study stresses the importance of using a multi-hazard and multi-scale approach for understanding and responding to local level environmental hazards. 
    more » « less
  3. Sherr, Micah; Shafiq, Zubair (Ed.)
    As smart home devices proliferate, protecting the privacy of those who encounter the devices is of the utmost importance both within their own home and in other people's homes. In this study, we conducted a large-scale survey (N=1459) with primary users of and bystanders to smart home devices. While previous work has studied people's privacy experiences and preferences either as smart home primary users or as bystanders, there is a need for a deeper understanding of privacy experiences and preferences in different contexts and across different countries. Instead of classifying people as either primary users or bystanders, we surveyed the same participants across different contexts. We deployed our survey in four countries (Germany, Mexico, the United Kingdom, and the United States) and in two languages (English and Spanish). We found that participants were generally more concerned about devices in their own homes, but perceived video cameras—especially unknown ones—and usability as more concerning in other people's homes. Compared to male participants, female and non-binary participants had less control over configuration of devices and privacy settings—regardless of whether they were the most frequent user. Comparing countries, participants in Mexico were more likely to be comfortable with devices, but also more likely to take privacy precautions around them. We also make cross-contextual recommendations for device designers and policymakers, such as nudges to facilitate social interactions. 
    more » « less
  4. Smart-home technology is now pervasive, demanding increased attention to the security of the devices and the privacy of the home's residents. To assist residents in making security and privacy decisions - e.g., whether to allow a new device to connect to the network, or whether to be alarmed when an unknown device is discovered - it helps to know whether the device is inside the home, or outside. In this paper we present MOAT, a system that leverages Wi-Fi sniffers to analyze the physical properties of a device's wireless transmissions to infer whether that device is located inside or outside of a home. MOAT can adaptively self-update to accommodate changes in the home indoor environment to ensure robust long-term performance. Notably, MOAT does not require prior knowledge of the home's layout or cooperation from target devices, and is easy to install and configure. We evaluated MOAT in four different homes with 21 diverse commercial smart devices and achieved an overall balanced accuracy rate of up to 95.6%. Our novel periodic adaptation technique allowed our approach to maintain high accuracy even after rearranging furniture in the home. MOAT is a practical and efficient first step for monitoring and managing devices in a smart home. 
    more » « less
  5. Despite significant evidence that housing quality plays a key role in the overall health of the population, health risks that originate at home have failed to garner direct policy attention or intervention commensurate with their impact. Drawing on the sociology of social problems, we identify how causal and political responsibility for risks in the United States context is complicated when these environmental health risks are embedded in private homes. We argue that changing how home health is addressed by health and building practitioners requires a reconceptualization of home health whereby the multiple responsible parties and sources of exposure become leverage points for future research and interventions. This reframing includes identifying housing as an arena of health, representing a class of risks tied to place. We also contend that health is an essential element of homes as systems and must be embedded in how those in building science, construction, property management, and code design approach housing. Finally, we suggest the need for specialists to navigate home health issues, drawing on the hospitalist model of health provision. These proposals illustrate multiple points at which residents, researchers, and health and building professionals may intervene and home health risks can be addressed. 
    more » « less