Predicting the occupancy related information in an environment has been investigated to satisfy the myriad requirements of various evolving pervasive, ubiquitous, opportunistic and participatory sensing applications. Infrastructure and ambient sensors based techniques have been leveraged largely to determine the occupancy of an environment incurring a significant deployment and retrofitting costs. In this paper, we advocate an infrastructure-less zero-configuration multimodal smartphone sensor-based techniques to detect fine-grained occupancy information. We propose to exploit opportunistically smartphones' acoustic sensors in presence of human conversation and motion sensors in absence of any conversational data. We develop a novel speaker estimation algorithm based on unsupervised clustering of overlapped and non-overlapped conversational data to determine the number of occupants in a crowded environment. We also design a hybrid approach combining acoustic sensing opportunistically with locomotive model to further improve the occupancy detection accuracy. We evaluate our algorithms in different contexts, conversational, silence and mixed in presence of 10 domestic users. Our experimental results on real-life data traces collected from 10 occupants in natural setting show that using this hybrid approach we can achieve approximately 0.76 error count distance for occupancy detection accuracy on average.
more »
« less
Infrastructure-less Occupancy Detection and Semantic Localization in Smart Environments
Accurate estimation of localized occupancy related information in real time enables a broad range of intelligent smart environment applications. A large number of studies using
heterogeneous sensor arrays reflect the myriad requirements of various emerging pervasive, ubiquitous and participatory sensing applications. In this paper, we introduce a zero-configuration and infrastructure-less smartphone based location specific occupancy estimation model. We opportunistically exploit smartphone’s acoustic sensors in a conversing environment and motion sensors in absence of any conversational data. We demonstrate a novel speaker estimation algorithm based on unsupervised clustering of overlapped and non-overlapped conversational data and a change point detection algorithm for locomotive motion of the users to infer the occupancy. We augment our occupancy detection model with a fingerprinting based methodology using smartphone’s magnetometer sensor to accurately assimilate location information of any gathering. We postulate a novel crowdsourcing-based approach to annotate the semantic location of the occupancy. We evaluate our algorithms in different contexts; conversational, silence and mixed in presence of 10 domestic users. Our experimental results on real-life data traces in natural settings show that using this hybrid approach, we can achieve approximately 0.76 error count distance for occupancy detection accuracy on average.
more »
« less
- Award ID(s):
- 1344990
- PAR ID:
- 10073266
- Date Published:
- Journal Name:
- MOBIQUITOUS'15 proceedings of the 12th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services on 12th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Occupancy detection helps enable various emerging smart environment applications ranging from opportunistic HVAC (heating, ventilation, and air-conditioning) control, effective meeting management, healthy social gathering, and public event planning and organization. Ubiquitous availability of smartphones and wearable sensors with the users for almost 24 hours helps revitalize a multitude of novel applications. The inbuilt microphone sensor in smartphones plays as an inevitable enabler to help detect the number of people conversing with each other in an event or gathering. A large number of other sensors such as accelerometer and gyroscope help count the number of people based on other signals such as locomotive motion. In this work, we propose multimodal data fusion and deep learning approach relying on the smartphone’s microphone and accelerometer sensors to estimate occupancy. We first demonstrate a novel speaker estimation algorithm for people counting and extend the proposed model using deep nets for handling large-scale fluid scenarios with unlabeled acoustic signals. We augment our occupancy detection model with a magnetometer-dependent fingerprinting-based localization scheme to assimilate the volume of location-specific gathering. We also propose crowdsourcing techniques to annotate the semantic location of the occupant. We evaluate our approach in different contexts: conversational, silence, and mixed scenarios in the presence of 10 people. Our experimental results on real-life data traces in natural settings show that our cross-modal approach can achieve approximately 0.53 error count distance for occupancy detection accuracy on average.more » « less
-
Abstract Cognitive buildings use data on how occupants respond to the built environment to proactively make occupant-centric adjustments to lighting, temperature, ventilation, and other environmental parameters. However, sensors that unobtrusively and ubiquitously measure occupant responses are lacking. Here we show that Doppler-radar based sensors, which can sense small physiological motions, provide accurate occupancy detection and estimation of vital signs in challenging, realistic circumstances. Occupancy was differentiated from an empty room over 93% of the time in a 3.4 m × 8.5 m conference room with a single sensor in both wall and ceiling-mounted configurations. Occupancy was successfully detected while an occupant was under the table, visibly blocked from the sensor, a scenario where infrared, ultrasound, and video-based occupancy sensors would fail. Heart and respiratory rates were detected in all seats in the conference room with a single ceiling-mounted sensor. The occupancy sensor can be used to control HVAC and lighting with a short, 1–2 min delay and to provide information for space utilization optimization. Heart and respiratory rate sensing could provide additional feedback to future human-building interactive systems that use vital signs to determine how occupant comfort and wellness is changing with time.more » « less
-
Occupancy sensors are electronic devices used to detect the presence of people in monitored areas, and the output of these sensors can be used to optimize lighting control, heating and ventilation control, and real-estate utilization. Testing methods already exist for certain types of occupancy sensors (e.g., passive infrared) to evaluate their relative performance, allowing manufacturers to report coverage patterns for different types of motion. However, the existing published techniques are mostly tailored for passive-infrared sensors and therefore limited to evaluation of large motions, such as walking and hand movement. Here we define a characterization technique for a Doppler radar occupancy sensor based on detecting a small motion representing human breathing, using a well-defined readily reproducible target. The presented technique specifically provides a robust testing method for a single-channel continuous wave Doppler-radar based occupancy sensor, which has variation in sensitivity within each wavelength of range. By comparison with test data taken from a human subject, we demonstrate that the mobile target provides a reproducible alternative for a human target that better accounts for the impact of sensor placement. This characterization technique enables generation of coverage patterns for breathing motion for single-channel continuous wave Doppler radar-based occupancy sensors.more » « less
-
Building occupancy information is significant for a variety of reasons, from allocation of resources in smart buildings to responding during emergency situations. As most people spend more than 90% of their time indoors, a comfortable indoor environment is crucial. To ensure comfort, traditional HVAC systems condition rooms assuming maximum occupancy, accounting for more than 50% of buildings’ energy budgets in the US. Occupancy level is a key factor in ensuring energy efficiency, as occupancy-controlled HVAC systems can reduce energy waste by conditioning rooms based on actual usage. Numerous studies have focused on developing occupancy estimation models leveraging existing sensors, with camera-based methods gaining popularity due to their high precision and widespread availability. However, the main concern with using cameras for occupancy estimation is the potential violation of occupants’ privacy. Unlike previous video-/image-based occupancy estimation methods, we addressed the issue of occupants’ privacy in this work by proposing and investigating both motion-based and motion-independent occupancy counting methods on intentionally blurred video frames. Our proposed approach included the development of a motion-based technique that inherently preserves privacy, as well as motion-independent techniques such as detection-based and density-estimation-based methods. To improve the accuracy of the motion-independent approaches, we utilized deblurring methods: an iterative statistical technique and a deep-learning-based method. Furthermore, we conducted an analysis of the privacy implications of our motion-independent occupancy counting system by comparing the original, blurred, and deblurred frames using different image quality assessment metrics. This analysis provided insights into the trade-off between occupancy estimation accuracy and the preservation of occupants’ visual privacy. The combination of iterative statistical deblurring and density estimation achieved a 16.29% counting error, outperforming our other proposed approaches while preserving occupants’ visual privacy to a certain extent. Our multifaceted approach aims to contribute to the field of occupancy estimation by proposing a solution that seeks to balance the trade-off between accuracy and privacy. While further research is needed to fully address this complex issue, our work provides insights and a step towards a more privacy-aware occupancy estimation system.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.4108/eai.22-7-2015.2260062
