skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Multi-Person Activity Recognition in Continuously Monitored Smart Homes
Activity recognizers are challenging to design for continuous, in-home settings. However, they are notoriously difficult to create when there is more than one resident in the home. Despite recent efforts, there remains a need for an algorithm that can estimate the number of residents in the house, split a time series stream into separate substreams, and accurately identify each resident's activities. To address this challenge, we introduce Gamut . This novel unsupervised method jointly estimates the number of residents and associates sensor readings with those residents, based on a multi-target Gaussian mixture probability hypothesis density filter. We hypothesize that the proposed method will offer robust recognition for homes with two or more residents. In experiments with labeled data collected from 50 single-resident and 11 multi-resident homes, we observe that Gamut outperforms previous unsupervised and supervised methods, offering a robust strategy to track behavioral routines in complex settings.  more » « less
Award ID(s):
1954372
PAR ID:
10418203
Author(s) / Creator(s):
;
Date Published:
Journal Name:
IEEE Transactions on Emerging Topics in Computing
Volume:
10
Issue:
2
ISSN:
2376-4562
Page Range / eLocation ID:
1130-1141
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; (, ACM)
    Smart homes are gaining popularity due to their convenience and efficiency, both of which come at the expense of increased complexity of Internet of Things (IoT) devices. Due to the number and heterogeneity of IoT devices, technologically inexperienced or time-burdened residents are unlikely to manage the setup and maintenance of IoT apps and devices. We highlight the need for a "HandyTech": a technically skilled contractor who can set up, repair, debug, monitor, and troubleshoot home IoT systems. In this paper, we consider the potential privacy challenges posed by the HandyTech, who has the ability to access IoT devices and private data. We do so in the context of single and multi-user smart homes, including rental units, condominiums, and temporary guests or workers. We examine the privacy harms that can arise when a HandyTech has legitimate access to information, but uses it in unintended ways. By providing insights for the development of privacy control policies and measures in-home IoT environments in the presence of the HandyTech, we capture the privacy concerns raised by other visitors to the home, including temporary residents, part-time workers, etc. This helps lay a foundation for the broad set of privacy concerns raised by home IoT systems. 
    more » « less
  2. ; ; ; ; ; ; ; ; ; (, Proceedings on Privacy Enhancing Technologies)
    Sherr, Micah; Shafiq, Zubair (Ed.)
    As smart home devices proliferate, protecting the privacy of those who encounter the devices is of the utmost importance both within their own home and in other people's homes. In this study, we conducted a large-scale survey (N=1459) with primary users of and bystanders to smart home devices. While previous work has studied people's privacy experiences and preferences either as smart home primary users or as bystanders, there is a need for a deeper understanding of privacy experiences and preferences in different contexts and across different countries. Instead of classifying people as either primary users or bystanders, we surveyed the same participants across different contexts. We deployed our survey in four countries (Germany, Mexico, the United Kingdom, and the United States) and in two languages (English and Spanish). We found that participants were generally more concerned about devices in their own homes, but perceived video cameras—especially unknown ones—and usability as more concerning in other people's homes. Compared to male participants, female and non-binary participants had less control over configuration of devices and privacy settings—regardless of whether they were the most frequent user. Comparing countries, participants in Mexico were more likely to be comfortable with devices, but also more likely to take privacy precautions around them. We also make cross-contextual recommendations for device designers and policymakers, such as nudges to facilitate social interactions. 
    more » « less
  3. (, CASE 2020)
    In this paper, we study a nursing home staff schedule optimization problem under resident demand uncertainty. We formulate a two-stage stochastic binary program accordingly, with objective to minimize the total labor cost (linearly related to work time) incurred by both regular registered nurses (RRNs) and part-time nurses (PTNs). As a significant constraint, we balance RRNs’ total amount of work time with residents’ total service need for every considered shift. Besides, we restrict feasible shift schedules based on common scheduling practice. We conduct a series of computational experiments to validate the proposed model. We discuss our optimal solutions under different compositions of residents in terms of their disabilities. In addition, we compare the total labor costs and an RRN scheduling flexibility index with the given optimal solution under different combinations of RRNs and PTNs. Our analysis offers an operational approach to set the minimum number of nurses on flexible shift schedules to cover uncertain the service needs while maintaining a minimum labor cost. 
    more » « less
  4. ; ; ; ; ; ; ; (, Urban Ecosystems)
    Reduced human activity to mitigate the spread of the COVID-19 pandemic was accompanied by reports of unusual wildlife sightings in highly developed areas. Such experiences with urban nature may have helped residents cope with the stress of the pandemic and increased public interest in urban wildlife; however, this may depend on the species residents encountered. In this study, we surveyed Chicago, Illinois, USA residents during a stay-at-home order to understand if residents in more affluent or greener neighborhoods saw more wildlife species. We also evaluated whether encounters with pest and non-pest species were associated with residents’ values about wildlife. Of 593 responses included in our analyses, respondents in higher-income and greener neighborhoods were more likely to perceive increased wildlife sightings and respondents in higher-income areas reported observing a higher number common birds and mammals. Support for seeing wildlife in residential areas was associated with seeing passerine birds and not seeing rats during the stay-at-home order. Our results suggest that perceived increases in wildlife sightings were common during a stay-at-home order, especially for affluent residents, and that residents’ perceptions depended on the species encountered. Understanding how changes in human behavior modifies human-wildlife interactions can help mitigate human-wildlife conflict and foster positive engagement with local wildlife. 
    more » « less
  5. ; ; ; (, Proceedings of the ... AAAI Conference on Artificial Intelligence)
    Homes constitute a large fraction of the total energy consumption. Producing an energy breakdown for a home has been shown to reduce household energy consumption by up to 15%, among other benefits. However, existing approaches to produce an energy breakdown require hardware to be installed in each home and are thus prohibitively expensive. In this paper, we propose a novel application of feature-based matrix factorisation that does not require any additional hardware installation. The basic premise of our approach is that common design and construction patterns for homes create a repeating structure in their energy data. Thus, a sparse basis can be used to represent energy data from a broad range of homes. We evaluate our approach on 516 homes from a publicly available data set and find it to be better than five baseline approaches that either require sensing in each home, or a very rigorous survey across a large number of homes coupled with complex modelling. We also present a deployment of our system as a live web application that can potentially provide energy breakdown to millions of homes. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email