Home energy management system (HEMS) enables residents to actively participate in demand response (DR) programs. It can autonomously optimize the electricity usage of home appliances to reduce the electricity cost based on time-varying electricity prices. However, due to the existence of randomness in the pricing process of the utility and resident's activities, developing an efficient HEMS is challenging. To address this issue, we propose a novel home energy management method for optimal scheduling of different kinds of home appliances based on deep reinforcement learning (DRL). Specifically, we formulate the home energy management problem as an MDP considering the randomness of real-time electricity prices and resident's activities. A DRL approach based on proximal policy optimization (PPO) is developed to determine the optimal DR scheduling strategy. The proposed approach does not need any information on the appliances' models and distribution knowledge of the randomness. Simulation results verify the effectiveness of our proposed approach.
more »
« less
This content will become publicly available on October 26, 2026
Home Energy Management for Uninterruptible Operation of Electricity-Dependent Durable Medical Equipment
Those who rely on electricity-dependent durable medical equipment (DME) often struggle to use their medical devices during prolonged power outages. With the increasing frequency of natural disasters and the growing use of electricity-dependent home medical devices, in addition to the continued integration of home-level renewable energy and mobile storage systems such as electric vehicles with vehicle-to-home (V2H) capabilities, home energy management systems (HEMS) must prioritize life-essential medical loads during extended power outages. This work integrates electricity-dependent DME into home energy management optimization. An oxygen concentrator and a hemodialysis machine are used as examples of medical devices with high power demands and distinct usage patterns. The HEMS model is formulated as a mixed-integer linear program (MILP) to minimize the total weighted load curtailment and thermal discomfort during extended outage scenarios. The results demonstrate that the HEMS is effective in sustaining DME operation.
more »
« less
- PAR ID:
- 10656337
- Publisher / Repository:
- IEEE
- Date Published:
- Page Range / eLocation ID:
- 1 to 6
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Abstract Objectives: To determine if solar-powered battery systems could be successfully used for electricity-dependent medical devices by families during a power outage. Methods: We assessed the use of and satisfaction with solar-powered battery systems distributed to 15 families following Hurricane Maria in rural Puerto Rico. Interviews were conducted in July 2018, 3 mo following distribution of the systems. Results: The solar-powered battery systems powered refrigeration for medications and prescribed diets, asthma therapy, inflatable mattresses to prevent bedsores, and continuous positive airway pressure machines for sleep apnea. Despite some system problems, such as inadequate power, defective cables, and blown fuses, families successfully dealt with these issues with some outside help. Almost all families were pleased with the systems and a majority would recommend solar-powered battery systems to a neighbor. Conclusions: Families accepted and successfully used solar-powered battery systems to power medical devices. Solar-powered battery systems should be considered as alternatives to generators for power outages after hurricanes and other disasters. Additional research and analysis are needed to inform policy on increasing access to such systems.more » « less
-
This paper proposes a home energy management system (HEMS) while considering the residential occupant’s clothing integrated thermal comfort and electrical vehicles (EV) state-of-charge (SOC) concern. An adaptive dynamic program- ming (ADP) based HEMS model is proposed to optimally determine the setpoints of heating, ventilation, air conditioning (HVAC), the donning/doffing decisions for the clothing conditions and charging/discharging of EV while taking into account the uncertainties in outside temperature and EV arrival SOC. We use model predictive control (MPC) to simulate a multi-day energy management of a residential house equipped with the proposed HEMS. The proposed HEMS is compared with a baseline case without the HEMS. The simulation results show that a 47.5% of energy cost saving can be achieved by the proposed HEMS while maintaining satisfactory occupant thermal comfort and negligible EV SOC concerns.more » « less
-
Abstract Major disasters such as wildfire, tornado, hurricane, tropical storm, and flooding cause disruptions in infrastructure systems such as power and water supply, wastewater management, telecommunication, and transportation facilities. Disruptions in electricity infrastructure have negative impacts on sectors throughout a region, including education, medical services, financial services, and recreation. In this study, we introduced a novel approach to investigate the factors that can be associated with longer restoration time of power service after a hurricane. Considering restoration time as the dependent variable and using a comprehensive set of county-level data, we estimated a generalized accelerated failure time (GAFT) model that accounts for spatial dependence among observations for time to event data. The model fit improved by 12% after considering the effects of spatial correlation in time to event data. Using the GAFT model and Hurricane Irma’s impact on Florida as a case study, we examined: (1) differences in electric power outages and restoration rates among different types of power companies—investor-owned power companies, rural and municipal cooperatives; (2) the relationship between the duration of power outage and power system variables; and (3) the relationship between the duration of power outage and socioeconomic attributes. The findings of this study indicate that counties with a higher percentage of customers served by investor-owned electric companies and lower median household income faced power outage for a longer time. This study identified the key factors to predict restoration time of hurricane-induced power outages, allowing disaster management agencies to adopt strategies required for restoration process.more » « less
-
Rooftop photovoltaics (PV) and electrical vehicles (EV) have become more economically viable to residential customers. Most existing home energy management systems (HEMS) only focus on the residential occupants’ thermal comfort in terms of indoor temperature and humidity while neglecting their other behaviors or concerns. This paper aims to integrate residential PV and EVs into the HEMS in an occupant-centric manner while taking into account the occupants’ thermal comfort, clothing behaviors, and concerns on the state-of-charge (SOC) of EVs. A stochastic adaptive dynamic programming (ADP) model was proposed to optimally determine the setpoints of heating, ventilation, air conditioning (HVAC), occupant’s clothing decisions, and the EV’s charge/discharge schedule while considering uncertainties in the outside temperature, PV generation, and EV’s arrival SOC. The nonlinear and nonconvex thermal comfort model, EV SOC concern model, and clothing behavior model were holistically embedded in the ADP-HEMS model. A model predictive control framework was further proposed to simulate a residential house under the time of use tariff, such that it continually updates with optimal appliance schedules decisions passed to the house model. Cosimulations were carried out to compare the proposed HEMS with a baseline model that represents the current operational practice. The result shows that the proposed HEMS can reduce the energy cost by 68.5% while retaining the most comfortable thermal level and negligible EV SOC concerns considering the occupant’s behaviors.more » « less
An official website of the United States government
