skip to main content


Title: Vision-based Thermal Comfort Quantification for HVAC Control
This study presents a vision-based approach that employs RGB video images as the sole source for inferring thermoregulation states in the human body in response to thermal condition variations in indoor environments. The primary objective is to contribute to our envisioned thermoregulation-based HVAC control that leverages actual thermal demands from end-users’ thermoregulation states for increased energy efficiency. Given that the envisioned control system calls for measurement techniques under four constraints of non-intrusiveness, applicability, sensitivity, and ubiquity (i.e., feasibility and scalability), this study investigated the potentials of ubiquitously obtainable RGB video images (through webcams or smartphones). Using photoplethysmography(PPG), a well-known optical technique for measuring blood volume changes in the microvascular bed of skin, we have leveraged the mechanism of blood flow control to the skin surface (blood vessels' dilation and constriction)for heat dissipation regulations, reflected in PPG signal's amplitude. Given the subtle variations of PPG signals and their susceptibility to noise, we proposed a framework that uses a combination of independent component analysis and adaptive filtering to reduce unwanted and in-band artifacts while preserving the amplitude information of PPG signals that indicates thermophysiological states. The framework was experimentally evaluated using transient thermal conditions to account for applicability and sensitivity attributes. Therefore, without considering an acclimation time for stabilized thermoregulation states, human subjects were exposed to varying temperatures (∼20–30 °C) while reporting their thermal sensations. In total, for 10 human subjects out of 15, a positive correlation between vision-based indicators, skin temperature, and thermal sensations were observed demonstrating promising potential in inferring thermal sensations of occupants with sufficient sensitivity  more » « less
Award ID(s):
1663513
NSF-PAR ID:
10066325
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Building and environment
Volume:
142
ISSN:
0360-1323
Page Range / eLocation ID:
513-523
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. It is well established that thermal comfort is an influential factor in human health and wellbeing. Uncomfortable thermal environments can reduce occupants’ comfort and productivity, and cause symptoms of sick building syndrome. To harness the built environment as a medium to support human health, well-being, and engagement, it is significantly important to understand occupants’ thermal comfort in real time. To this end, this study proposes a non-intrusive method to collect occupants’ facial skin temperature and interpret their thermal comfort conditions by fusing the thermal and RGB-D images collected from multiple low-cost thermographic and Kinect sensors. This study distinguishes from existing methods of thermal comfort assessment in three ways: 1) it is a truly non-intrusive data collection approach which has a minimal interruption or participation of building occupants; 2) the proposed approach can simultaneously identify and interpret multiple occupants’ thermal comfort; 3) it uses low-cost thermographic and RGB-D cameras which can be rapidly deployed and reconfigured to adapt to various settings. This approach was experimentally evaluated in a transient heating environment (room temperature increased from 23 to 27 °C) to verify its applicability in real operational built environments. In total, all 6 subjects observed moderate to strong positive correlations between the ambient room temperature and subjects’ facial skin temperature collected using the proposed approach. Additionally, all 6 subjects have voted different thermal sensations at the beginning (the first 5 minutes) and at the end (the last 5 minutes) of the heating experiment, which can be reflected by the significant differences in the mean skin temperature of these two periods (p < .001). Results of this pilot study demonstrate the feasibility of applying the proposed non-intrusive approach to real multi-occupancy environments to dynamically interpret occupants’ thermal comfort and optimize the operation of building heating, ventilation and air conditioning (HVAC) systems. 
    more » « less
  2. About 40% of the energy produced globally is consumed within buildings, primarily for providing occupants with comfortable work and living spaces. However, despite the significant impacts of such energy consumption on the environment, the lack of thermal comfort among occupants is a common problem that can lead to health complications and reduced productivity. To address this problem, it is particularly important to understand occupants’ thermal comfort in real-time to dynamically control the environment. This study investigates an infrared thermal camera network to extract skin temperature features and predict occupants’ thermal preferences at flexible distances and angles. This study distinguishes from existing methods in two ways: (1) the proposed method is a non-intrusive data collection approach which does not require human participation or personal devices; (2) it uses low-cost thermal cameras and RGB-D sensors which can be rapidly reconfigured to adapt to various settings and has little or no hardware infrastructure dependency. The proposed camera network is verified using the facial skin temperature collected from 16 subjects in a multi-occupancy experiment. The results show that all 16 subjects observed a statistically higher skin temperature as the room temperature increases. The variations in skin temperature also correspond to the distinct comfort states reported by the subjects. The post-experiment evaluation suggests that the networked thermal cameras have a minimal interruption of building occupants. The proposed approach demonstrates the potential to transition the human physiological data collection from an intrusive and wearable device-based approach to a truly non-intrusive and scalable approach. 
    more » « less
  3. Heating, ventilation and air-conditioning (HVAC) systems have been adopted to create comfortable, healthy and safe indoor environments. In the control loop, the technical feature of the human demand-oriented supply can help operate HVAC effectively. Among many technical options, real time monitoring based on feedback signals from end users has been frequently reported as a critical technology to confirm optimizing building performance. Recent studies have incorporated human thermal physiology signals and thermal comfort/discomfort status as real-time feedback signals. A series of human subject experiments used to be conducted by primarily adopting subjective questionnaire surveys in a lab-setting study, which is limited in the application for reality. With the help of advanced technologies, physiological signals have been detected, measured and processed by using multiple technical formats, such as wearable sensors. Nevertheless, they mostly require physical contacts with the skin surface in spite of the small physical dimension and compatibility with other wearable accessories, such as goggles, and intelligent bracelets. Most recently, a low cost small infrared camera has been adopted for monitoring human facial images, which could detect the facial skin temperature and blood perfusion in a contactless way. Also, according to latest pilot studies, a conventional digital camera can generate infrared images with the help of new methods, such as the Euler video magnification technology. Human thermal comfort/discomfort poses can also be detected by video methods without contacting human bodies and be analyzed by the skeleton keypoints model. In this review, new sensing technologies were summarized, their cons and pros were discussed, and extended applications for the demand-oriented ventilation were also reviewed as potential development and applications. 
    more » « less
  4. null (Ed.)
    Heating, ventilation and air-conditioning (HVAC) systems have been adopted to create comfortable, healthy and safe indoor environments. In the control loop, the technical feature of the human demand-oriented supply can help operate HVAC effectively. Among many technical options, real time monitoring based on feedback signals from end users has been frequently reported as a critical technology to confirm optimizing building performance. Recent studies have incorporated human thermal physiologysignals and thermal comfort/discomfort status as real-time feedback signals. A series of human subject experiments used to be conducted by primarily adopting subjective questionnaire surveys in a lab-setting study, which is limited in the application for reality. With the help of advanced technologies, physiological signals have been detected, measured and processed by using multiple technical formats, such as wearable sensors. Nevertheless, they mostly require physical contacts with the skin surface in spite of the small physical dimension and compatibility with other wearable accessories, such as goggles, and intelligent bracelets. Most recently, a low cost small infrared camera has been adopted for monitoring human facial images, which could detect the facial skin temperature and blood perfusion in a contactless way. Also, according to latest pilot studies, a conventional digital camera can generate infrared images with the help of new methods, such as the Euler video magnification technology. Human thermal comfort/discomfort poses can also be detected by video methods without contacting human bodies and be analyzed by the skeleton keypoints model. In this review, new sensing technologies were summarized, their cons and pros were discussed, and extended applications for the demand-oriented ventilation were also reviewed as potential development and applications. 
    more » « less
  5. Identification and quantitative understanding of factors that influence occupant energy behavior and thermal state during the design phase are critical in supporting effective energy-efficient design. To achieve this, immersive virtual environments (IVEs) have recently shown potential as a tool to simulate occupant energy behaviors and collect context-dependent behavior data for buildings under design. On the other hand, prior models of occupant energy behaviors and thermal states used correlation-based approaches, which failed to capture the underlying causal interactions between the influencing factors and hence were unable to uncover the true causing factors. Therefore, in this study, the authors investigate the applicability of causal inference for identifying the causing factors of occupant/participant energy behavioral intentions and their thermal states in IVE condition and compare those results with the baseline in-situ condition. The energy behavioral intentions here are a proximal antecedent of actual energy behaviors. A set of experiments involving 72 human subjects were performed through the use of a head-mounted device (HMD) in a climate chamber. The subjects were exposed to three different step temperatures (cool, neutral, warm) under an IVE and a baseline in-situ condition. Participants' individual factors, behavioral factors, skin temperatures, virtual experience factors, thermal states (sensation, acceptability, comfort), and energy behavioral intentions were collected during the experiments. Structural causal models were learnt from data using the elicitation method in conjunction with the PC-Stable algorithm. The findings show that the causal inference framework is a potentially effective method for identifying causing factors of thermal states and energy behavioral intentions as well as quantifying their causal effects. In addition, the study shows that in IVE experiments, the participants' virtual experience factors such as their immersion, presence, and cybersickness were not the causing factors of thermal states and energy behavioral intentions. Furthermore, the study suggests that participants' behavioral factors such as their attitudes toward energy conservation and perceived behavioral control to conserve energy were the causing factors of their energy behavioral intentions. Also, the indoor temperature was a causing factor of general thermal sensation and overall skin temperature. The paper also discusses other findings, including discrepancies, limitations of the study, and recommendations for future studies. 
    more » « less