skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • Pharmacogenomic augmented machine learning in electronic health record alerts: A health system‐wide usability survey of clinicians
Title: Pharmacogenomic augmented machine learning in electronic health record alerts: A health system‐wide usability survey of clinicians
Abstract Pharmacogenomic (PGx) biomarkers integrated using machine learning can be embedded within the electronic health record (EHR) to provide clinicians with individualized predictions of drug treatment outcomes. Currently, however, drug alerts in the EHR are largely generic (not patient‐specific) and contribute to increased clinician stress and burnout. Improving the usability of PGx alerts is an urgent need. Therefore, this work aimed to identify principles for optimal PGx alert design through a health‐system‐wide, mixed‐methods study. Clinicians representing multiple practices and care settings (N = 1062) in urban, rural, and underserved regions were invited to complete an electronic survey comparing the usability of three drug alerts for citalopram, as a case study. Alert 1 contained a generic warning of pharmacogenomic effects on citalopram metabolism. Alerts 2 and 3 provided patient‐specific predictions of citalopram efficacy with varying depth of information. Primary outcomes included the System's Usability Scale score (0–100 points) of each alert, the perceived impact of each alert on stress and decision‐making, and clinicians' suggestions for alert improvement. Secondary outcomes included the assessment of alert preference by clinician age, practice type, and geographic setting. Qualitative information was captured to provide context to quantitative information. The final cohort comprised 305 geographically and clinically diverse clinicians. A simplified, individualized alert (Alert 2) was perceived as beneficial for decision‐making and stress compared with a more detailed version (Alert 3) and the generic alert (Alert 1) regardless of age, practice type, or geographic setting. Findings emphasize the need for clinician‐guided design of PGx alerts in the era of digital medicine.  more » « less
Award ID(s):
2041339
PAR ID:
10634182
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
Publisher / Repository:
Wiley
Date Published:
Journal Name:
Clinical and Translational Science
Volume:
17
Issue:
10
ISSN:
1752-8054
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; (, Machine Learning for Healthcare 2023 conference)
    The large amount of time clinicians spend sifting through patient notes and documenting in electronic health records (EHRs) is a leading cause of clinician burnout. By proactively and dynamically retrieving relevant notes during the documentation process, we can reduce the effort required to find relevant patient history. In this work, we conceptualize the use of EHR audit logs for machine learning as a source of supervision of note relevance in a specific clinical context, at a particular point in time. Our evaluation focuses on the dynamic retrieval in the emergency department, a high acuity setting with unique patterns of information retrieval and note writing. We show that our methods can achieve an AUC of 0.963 for predicting which notes will be read in an individual note writing session. We additionally conduct a user study with several clinicians and find that our framework can help clinicians retrieve relevant information more efficiently. Demonstrating that our framework and methods can perform well in this demanding setting is a promising proof of concept that they will translate to other clinical settings and data modalities (e.g., labs, medications, imaging). 
    more » « less
  2. ; ; ; ; ; (, Applied Clinical Informatics)
    Objective Visual cohort analysis utilizing electronic health record data has become an important tool in clinical assessment of patient outcomes. In this article, we introduce Composer, a visual analysis tool for orthopedic surgeons to compare changes in physical functions of a patient cohort following various spinal procedures. The goal of our project is to help researchers analyze outcomes of procedures and facilitate informed decision-making about treatment options between patient and clinician. Methods In collaboration with orthopedic surgeons and researchers, we defined domain-specific user requirements to inform the design. We developed the tool in an iterative process with our collaborators to develop and refine functionality. With Composer, analysts can dynamically define a patient cohort using demographic information, clinical parameters, and events in patient medical histories and then analyze patient-reported outcome scores for the cohort over time, as well as compare it to other cohorts. Using Composer's current iteration, we provide a usage scenario for use of the tool in a clinical setting. Conclusion We have developed a prototype cohort analysis tool to help clinicians assess patient treatment options by analyzing prior cases with similar characteristics. Although Composer was designed using patient data specific to orthopedic research, we believe the tool is generalizable to other healthcare domains. A long-term goal for Composer is to develop the application into a shared decision-making tool that allows translation of comparison and analysis from a clinician-facing interface into visual representations to communicate treatment options to patients. 
    more » « less
  3. (, Journal of Machine Learning Research)
    There is tremendous interest in precision medicine as a means to improve patient out- comes by tailoring treatment to individual characteristics. An individualized treatment rule formalizes precision medicine as a map from patient information to a recommended treatment. A treatment rule is defined to be optimal if it maximizes the mean of a scalar outcome in a population of interest, e.g., symptom reduction. However, clinical and intervention scientists often seek to balance multiple and possibly competing outcomes, e.g., symptom reduction and the risk of an adverse event. One approach to precision medicine in this setting is to elicit a composite outcome which balances all competing outcomes; unfortunately, eliciting a composite outcome directly from patients is difficult without a high-quality instrument, and an expert-derived composite outcome may not account for heterogeneity in patient preferences. We propose a new paradigm for the study of precision medicine using observational data that relies solely on the assumption that clinicians are approximately (i.e., imperfectly) making decisions to maximize individual patient utility. Estimated composite outcomes are subsequently used to construct an estimator of an individualized treatment rule which maximizes the mean of patient-specific composite out- comes. The estimated composite outcomes and estimated optimal individualized treatment rule provide new insights into patient preference heterogeneity, clinician behavior, and the value of precision medicine in a given domain. We derive inference procedures for the pro- posed estimators under mild conditions and demonstrate their finite sample performance through a suite of simulation experiments and an illustrative application to data from a study of bipolar depression. 
    more » « less
  4. ; ; (, 2020 IEEE International Conference on E-health Networking, Application & Services (HealthCom))
    null (Ed.)
    Electronic health record (EHR) systems have been widely adopted across healthcare organizations. While there are many benefits of using EHR such as improved accessibility and secure sharing of patient data, a shortcoming is that its manual data input is time-consuming and error prone. Physicians spend as much as 49.2% of their office time on EHR. In this paper, we present the design, development, and evaluation of a voice-based assistant, DocPal, to assist healthcare practitioners to access and update EHR through their voice. User survey and experimental evaluation illustrate that DocPal has good usability, time efficiency, and accuracy. When applied in the healthcare industry, we expect it to reduce data entry time and provide better patient care. 
    more » « less
  5. ; ; (, 2018 IEEE International Conference on Healthcare Informatics)
    Patient-generated data, such as recorded Observations of Daily Living (ODL) and Patient-Reported Outcomes (PRO) data, are valued sources of information in oncology care. However, prior work largely focuses on capturing clinician-defined, patient-generated data in adult oncology care. Emerging research at the intersection of human–computer interaction and medical informatics suggests that visual narratives of patients’ observations of daily living (Visual ODLs) could better support multi-party review of patients’ everyday symptoms and quality of life, potentially improving patient–clinician communication. In this paper, we build on a prior study of Visual ODLs by describing a formative, two-phase study with 15 pediatric oncology clinicians. In Phase I, we analyzed data from ethnographic interviews in a pediatric oncology setting to capture the needs of nurses, nurse practitioners, and oncologists. In Phase II, we constructed two low-fidelity dashboard display prototypes, populated with Visual ODLs contributed by actual adolescent oncology patients, and we subsequently interviewed pediatric oncology clinicians who reviewed each dashboard design. Findings from our study contribute four key design objectives for presenting interactive Visual ODL dashboards in pediatric oncology, along with three use cases for using these dashboards for symptom tracking and communication. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email