skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Delighting Palates with AI: Reinforcement Learning’s Triumph in Crafting Personalized Meal Plans with High User Acceptance
Eating, central to human existence, is influenced by a myriad of factors, including nutrition, health, personal taste, cultural background, and flavor preferences. The challenge of devising personalized meal plans that effectively encompass these dimensions is formidable. A crucial shortfall in many existing meal-planning systems is poor user adherence, often stemming from a disconnect between the plan and the user’s lifestyle, preferences, or unseen eating patterns. Our study introduces a pioneering algorithm, CFRL, which melds reinforcement learning (RL) with collaborative filtering (CF) in a unique synergy. This algorithm not only addresses nutritional and health considerations but also dynamically adapts to and uncovers latent user eating habits, thereby significantly enhancing user acceptance and adherence. CFRL utilizes Markov decision processes (MDPs) for interactive meal recommendations and incorporates a CF-based MDP framework to align with broader user preferences, translated into a shared latent vector space. Central to CFRL is its innovative reward-shaping mechanism, rooted in multi-criteria decision-making that includes user ratings, preferences, and nutritional data. This results in versatile, user-specific meal plans. Our comparative analysis with four baseline methods showcases CFRL’s superior performance in key metrics like user satisfaction and nutritional adequacy. This research underscores the effectiveness of combining RL and CF in personalized meal planning, marking a substantial advancement over traditional approaches.  more » « less
Award ID(s):
2218046 1722913
PAR ID:
10524597
Author(s) / Creator(s):
; ;
Publisher / Repository:
Nutrients
Date Published:
Journal Name:
Nutrients
Volume:
16
Issue:
3
ISSN:
2072-6643
Page Range / eLocation ID:
346
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. BackgroundChronic diseases such as heart disease, stroke, diabetes, and hypertension are major global health challenges. Healthy eating can help people with chronic diseases manage their condition and prevent complications. However, making healthy meal plans is not easy, as it requires the consideration of various factors such as health concerns, nutritional requirements, tastes, economic status, and time limits. Therefore, there is a need for effective, affordable, and personalized meal planning that can assist people in choosing food that suits their individual needs and preferences. ObjectiveThis study aimed to design an artificial intelligence (AI)–powered meal planner that can generate personalized healthy meal plans based on the user’s specific health conditions, personal preferences, and status. MethodsWe proposed a system that integrates semantic reasoning, fuzzy logic, heuristic search, and multicriteria analysis to produce flexible, optimized meal plans based on the user’s health concerns, nutrition needs, as well as food restrictions or constraints, along with other personal preferences. Specifically, we constructed an ontology-based knowledge base to model knowledge about food and nutrition. We defined semantic rules to represent dietary guidelines for different health concerns and built a fuzzy membership of food nutrition based on the experience of experts to handle vague and uncertain nutritional data. We applied a semantic rule-based filtering mechanism to filter out food that violate mandatory health guidelines and constraints, such as allergies and religion. We designed a novel, heuristic search method that identifies the best meals among several candidates and evaluates them based on their fuzzy nutritional score. To select nutritious meals that also satisfy the user’s other preferences, we proposed a multicriteria decision-making approach. ResultsWe implemented a mobile app prototype system and evaluated its effectiveness through a use case study and user study. The results showed that the system generated healthy and personalized meal plans that considered the user’s health concerns, optimized nutrition values, respected dietary restrictions and constraints, and met the user’s preferences. The users were generally satisfied with the system and its features. ConclusionsWe designed an AI-powered meal planner that helps people create healthy and personalized meal plans based on their health conditions, preferences, and status. Our system uses multiple techniques to create optimized meal plans that consider multiple factors that affect food choice. Our evaluation tests confirmed the usability and feasibility of the proposed system. However, some limitations such as the lack of dynamic and real-time updates should be addressed in future studies. This study contributes to the development of AI-powered personalized meal planning systems that can support people’s health and nutrition goals. 
    more » « less
  2. Background/Objective: Nutritionists play a crucial role in guiding individuals toward healthier lifestyles through personalized meal planning; however, this task involves navigating a complex web of factors, including health conditions, dietary restrictions, cultural preferences, and socioeconomic constraints. The Analytic Hierarchy Process (AHP) offers a valuable framework for structuring these multi-faceted decisions but inconsistencies can hinder its effectiveness in pairwise comparisons. Methods: This paper proposes a novel hybrid Particle Swarm Optimization–Simulated Annealing (PSO-SA) algorithm to refine inconsistent AHP weight matrices, ensuring a consistent and accurate representation of the nutritionist’s expertise and client preferences. Our approach merges PSO’s global search capabilities with SA’s local search precision, striking an optimal balance between exploration and exploitation. Results: We demonstrate the practical utility of our algorithm through real-world use cases involving personalized meal planning for individuals with specific dietary needs and preferences. Results showcase the algorithm’s efficiency in achieving consistency and surpassing standard PSO accuracy. Conclusion: By integrating the PSO-SA algorithm into a mobile app, we empower nutritionists with an advanced decision-making tool for creating tailored meal plans that promote healthier dietary choices and improved client outcomes. This research represents a significant advancement in multi-criteria decision-making for nutrition, offering a robust solution to the inconsistency challenge in AHP and paving the way for more effective and personalized dietary interventions. 
    more » « less
  3. null (Ed.)
    Detecting when eating occurs is an essential step toward automatic dietary monitoring, medication adherence assessment, and diet-related health interventions. Wearable technologies play a central role in designing unobtrusive diet monitoring solutions by leveraging machine learning algorithms that work on time-series sensor data to detect eating moments. While much research has been done on developing activity recognition and eating moment detection algorithms, the performance of the detection algorithms drops substantially when the model is utilized by a new user. To facilitate the development of personalized models, we propose PALS, Proximity-based Active Learning on Streaming data, a novel proximity-based model for recognizing eating gestures to significantly decrease the need for labeled data with new users. Our extensive analysis in both controlled and uncontrolled settings indicates F-score of PALS ranges from 22% to 39% for a budget that varies from 10 to 60 queries. Furthermore, compared to the state-of-the-art approaches, off-line PALS achieves up to 40% higher recall and 12% higher F-score in detecting eating gestures. 
    more » « less
  4. As healthy diets and nutrition are crucial for people with Alzheimer's disease (AD), caregivers of patients with AD need to provide a balanced diet with the correct nutrients to boost the health and well-being of patients. However, this is challenging as they are likely to suffer from aging-related problems (such as teeth or gum problems) that make eating more uncomfortable; the planners, who are usually patients' family members, generally face high pressure, a busy schedule, and little experience. To help unprofessional caregivers of AD plan meals with the right nutrition and flavors, in this paper, the authors propose a meal planning mechanism that uses a multiple criteria decision-making approach to integrate various factors that affect a caregiver's choice of meals for AD patients. Ontology-based knowledge has been used to model personal preferences and characteristics and customize general diet recommendations. Case studies have demonstrated the feasibility and usability of the proposed approach. 
    more » « less
  5. Reinforcement learning (RL) methods can be used to develop a controller for the heating, ventilation, and air conditioning (HVAC) systems that both saves energy and ensures high occupants’ thermal comfort levels. However, the existing works typically require on-policy data to train an RL agent, and the occupants’ personalized thermal preferences are not considered, which is limited in the real-world scenarios. This paper designs a high-performance model-based offline RL algorithm for personalized HVAC systems. The proposed algorithm can quickly adapt to different occupants’ thermal preferences with a few thermal feedbacks, guaranteeing the high occupants’ personalized thermal comfort levels efficiently. First, we use a meta-supervised learning algorithm to train an occupant's thermal preference model. Then, we train an ensemble neural network to predict the thermal states of the considered zone. In addition, the obtained ensemble networks can indicate the regions in the state and action spaces covered by the offline dataset. With the personalized thermal preference model updated via meta-testing, model-based RL is used to derive the optimal HVAC controller. Since the proposed algorithm only requires offline datasets and a few online thermal feedbacks for training, it contributes to a more practical deployment of the RL algorithm to HVAC systems. We use the ASHRAE database II to verify the effectiveness and advantage of the meta-learning algorithm for modeling different occupants’ thermal preferences. Numerical simulations on the EnergyPlus environment demonstrate that the proposed algorithm can guarantee personalized thermal preferences with a slight increase of power consumption of 1.91% compared with the model-based RL algorithm with on-policy data aggregation. 
    more » « less