skip to main content


Title: Data-Driven Approach to Control Air Temperature Based on Facial Skin Temperature
Thermal comfort is a significant factor in the indoor building environment because it influences both human productivity and health. A currently popular method for predicting thermal comfort levels, the Predicted Mean Vote (PMV) and Predicted Percent Dissatisfied (PPD) model, unfortunately, has certain limitations. Consequently, the development of a better method for making accurate predictions (especially for individuals) is needed. Our goal was to develop a tool to predict individual thermal comfort preferences and automatically control the heating, ventilation, and air conditioning (HVAC) systems. This study adopted a series of human-subject experiments to collect essential data. All collected data was analyzed by adopting different machine learning algorithms. The machine learning algorithms predicted individual thermal comfort levels and thermal sensations, based on facial skin temperatures of participants in the experiments. These predictions were input data for the HVAC system control model, and results supported the potential for using facial skin temperatures to predict thermal comfort and thermal sensation levels. Moreover, this tool provided automatic control of the HVAC systems that can help improve the indoor environment of a building.  more » « less
Award ID(s):
1707068
NSF-PAR ID:
10183459
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Environmental engineering
Volume:
1
Issue:
1
ISSN:
1431-2492
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    In recent years, physiological features have gained more attention in developing models of personal thermal comfort for improved and accurate adaptive operation of Human-In-The-Loop (HITL) Heating, Ventilation, and Air-Conditioning (HVAC) systems. Pursuing the identification of effective physiological sensing systems for enhancing flexibility of human-centered and distributed control, using machine learning algorithms, we have investigated how heat flux sensing could improve personal thermal comfort inference under transient ambient conditions. We have explored the variations of heat exchange rates of facial and wrist skin. These areas are often exposed in indoor environments and contribute to the thermoregulation mechanism through skin heat exchange, which we have coupled with variations of skin and ambient temperatures for inference of personal thermal preferences. Adopting an experimental and data analysis methodology, we have evaluated the modeling of personal thermal preference of 18 human subjects for well-known classifiers using different scenarios of learning. The experimental measurements have revealed the differences in personal thermal preferences and how they are reflected in physiological variables. Further, we have shown that heat exchange rates have high potential in improving the performance of personal inference models even compared to the use of skin temperature. 
    more » « less
  2. Understanding occupants’ thermal sensation and comfort is essential to defining the operational settings for Heating, Ventilation and Air Conditioning (HVAC) systems in buildings. Due to the continuous impact of human and environmental factors, occupants’ thermal sensation and comfort level can change over time. Thus, to dynamically control the environment, thermal comfort should be monitored in real time. This paper presents a novel non-intrusive infrared thermography framework to estimate an occupant’s thermal comfort level by measuring skin temperature collected from different facial regions using low- cost thermal cameras. Unlike existing methods that rely on placing sensors directly on humans for skin temperature measurement, the proposed framework is able to detect the presence of occupants, extract facial regions, measure skin temperature features, and interpret thermal comfort conditions with minimal interruption of the building occupants. The method is validated by collecting thermal comfort data from a total of twelve subjects under cooling, heating and steady-state experiments. The results demonstrate that ears, nose and cheeks are most indicative of thermal comfort and the proposed framework can be used to assess occupants’ thermal comfort with an average accuracy of 85%. 
    more » « less
  3. Heating, ventilation and air-conditioning (HVAC) systems have been adopted to create comfortable, healthy and safe indoor environments. In the control loop, the technical feature of the human demand-oriented supply can help operate HVAC effectively. Among many technical options, real time monitoring based on feedback signals from end users has been frequently reported as a critical technology to confirm optimizing building performance. Recent studies have incorporated human thermal physiology signals and thermal comfort/discomfort status as real-time feedback signals. A series of human subject experiments used to be conducted by primarily adopting subjective questionnaire surveys in a lab-setting study, which is limited in the application for reality. With the help of advanced technologies, physiological signals have been detected, measured and processed by using multiple technical formats, such as wearable sensors. Nevertheless, they mostly require physical contacts with the skin surface in spite of the small physical dimension and compatibility with other wearable accessories, such as goggles, and intelligent bracelets. Most recently, a low cost small infrared camera has been adopted for monitoring human facial images, which could detect the facial skin temperature and blood perfusion in a contactless way. Also, according to latest pilot studies, a conventional digital camera can generate infrared images with the help of new methods, such as the Euler video magnification technology. Human thermal comfort/discomfort poses can also be detected by video methods without contacting human bodies and be analyzed by the skeleton keypoints model. In this review, new sensing technologies were summarized, their cons and pros were discussed, and extended applications for the demand-oriented ventilation were also reviewed as potential development and applications. 
    more » « less
  4. null (Ed.)
    Heating, ventilation and air-conditioning (HVAC) systems have been adopted to create comfortable, healthy and safe indoor environments. In the control loop, the technical feature of the human demand-oriented supply can help operate HVAC effectively. Among many technical options, real time monitoring based on feedback signals from end users has been frequently reported as a critical technology to confirm optimizing building performance. Recent studies have incorporated human thermal physiologysignals and thermal comfort/discomfort status as real-time feedback signals. A series of human subject experiments used to be conducted by primarily adopting subjective questionnaire surveys in a lab-setting study, which is limited in the application for reality. With the help of advanced technologies, physiological signals have been detected, measured and processed by using multiple technical formats, such as wearable sensors. Nevertheless, they mostly require physical contacts with the skin surface in spite of the small physical dimension and compatibility with other wearable accessories, such as goggles, and intelligent bracelets. Most recently, a low cost small infrared camera has been adopted for monitoring human facial images, which could detect the facial skin temperature and blood perfusion in a contactless way. Also, according to latest pilot studies, a conventional digital camera can generate infrared images with the help of new methods, such as the Euler video magnification technology. Human thermal comfort/discomfort poses can also be detected by video methods without contacting human bodies and be analyzed by the skeleton keypoints model. In this review, new sensing technologies were summarized, their cons and pros were discussed, and extended applications for the demand-oriented ventilation were also reviewed as potential development and applications. 
    more » « less
  5. Understanding occupants’ thermal comfort is essential for the effective operation of Heating, Ventilation, and Air Conditioning (HVAC) systems. Existing studies of the “human-in-the-loop” HVAC control generally suffer from: (1) excessive reliance on cumbersome human feedback; and (2) intrusiveness caused by conventional data collection methods. To address these limitations, this paper investigates the low-cost thermal camera as a non-intrusive approach to assess thermal comfort in real time using facial skin temperature. The framework developed can automatically detect occupants, extract facial regions, measure skin temperature, and interpret thermal comfort with minimal interruption or participation of occupants. The framework is validated using the facial skin temperature collected from twelve occupants. Personal comfort models trained from different machine learning algorithms are compared and results show that Random Forest model can achieve an accuracy of 85% and also suggest that the skin temperature of ears, nose, and cheeks are most indicative of thermal comfort. 
    more » « less