skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Image Classification Using Deep Learning Architecture – EfficientNET for COVID-19 Medicine Consumption
The Coronavirus disease 2019 (COVID-19) pandemic has impacted the world like no other pandemic in history. COVID-19 has progressed rapidly affecting health care in the global community. In this paper, we study the Image classification approach for confirming the consumption of medicine by people. The motivation for this research is to reduce contact with the people, without having them in physical observation and help minimize the spread of COVID-19. We used EfficientNet, a Deep Learning Convolution Neural Network (CNN) [7] architecture for systematical use of model scaling and balancing network depth, width, and resolution for better performance of our model. In this paper, we used the data augmentation technique to avoid overfitting. We used image hashing to compare and remove relatively similar images as data cleaning step and demonstrate the effectiveness of this approach by observing the classification accuracy. We used cloud computation to train the model. This trained model will be helpful to achieve the goal. In this study, we developed a model that could successfully detect the image and confirm the pill consumption by patient with high accuracy rate. This study will help medical professionals, especially during COVID-19 pandemic, in remotely monitoring the patient’s dosage and determine appropriate action in case of non-compliance.  more » « less
Award ID(s):
2028612
PAR ID:
10443604
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
International Supply Chain Technology Journal
Volume:
7
Issue:
7
ISSN:
2380-5730
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The Coronavirus disease 2019 (COVID-19) pandemic has impacted the world like no other pandemic in history. COVID-19 has progressed rapidly affecting health care in the global community. In this work, we look at the web user interface for elderly patients to easily keep track of their daily temperature and their pill consumption record and see if there is a need to visit a doctor. We are going to use Efficient Net, a Deep Learning Convolution Neural Network (CNN) architecture for systematical use of model scaling and balancing network depth, width, and resolution for better performance of our model. We are using angular components to develop user interface and expressJS to write backend services and MongoDB to store user records for the application which we learn in depth throughout the paper. we have trained and developed a model that could successfully detect people from the video and confirm the pill consumption by patient with high accuracy rate connected to a THT thermal camera. This study will help medical professionals, especially during the COVID-19 pandemic, in remotely monitoring the patient’s dosage and determining appropriate action in case of non-compliance. 
    more » « less
  2. null (Ed.)
    Coronavirus Disease 2019 (COVID-19) is caused by severe acute respiratory syndrome coronavirus 2 virus (SARS-CoV-2). The virus transmits rapidly; it has a basic reproductive number (R0) of 2.2-2.7. In March 2020, the World Health Organization declared the COVID-19 outbreak a pandemic. COVID-19 is currently affecting more than 200 countries with 6M active cases. An effective testing strategy for COVID-19 is crucial to controlling the outbreak but the demand for testing surpasses the availability of test kits that use Reverse Transcription Polymerase Chain Reaction (RT-PCR). In this paper, we present a technique to screen for COVID-19 using artificial intelligence. Our technique takes only seconds to screen for the presence of the virus in a patient. We collected a dataset of chest X-ray images and trained several popular deep convolution neural network-based models (VGG, MobileNet, Xception, DenseNet, InceptionResNet) to classify the chest X-rays. Unsatisfied with these models, we then designed and built a Residual Attention Network that was able to screen COVID-19 with a testing accuracy of 98% and a validation accuracy of 100%. A feature maps visual of our model show areas in a chest X-ray which are important for classification. Our work can help to increase the adaptation of AI-assisted applications in clinical practice. The code and dataset used in this project are available at https://github.com/vishalshar/covid-19-screening-using-RAN-on-X-ray-images. 
    more » « less
  3. The class activation map (CAM) represents the neural-network-derived region of interest, which can help clarify the mechanism of the convolutional neural network’s determination of any class of interest. In medical imaging, it can help medical practitioners diagnose diseases like COVID-19 or pneumonia by highlighting the suspicious regions in Computational Tomography (CT) or chest X-ray (CXR) film. Many contemporary deep learning techniques only focus on COVID-19 classification tasks using CXRs, while few attempt to make it explainable with a saliency map. To fill this research gap, we first propose a VGG-16-architecture-based deep learning approach in combination with image enhancement, segmentation-based region of interest (ROI) cropping, and data augmentation steps to enhance classification accuracy. Later, a multi-layer Gradient CAM (ML-Grad-CAM) algorithm is integrated to generate a class-specific saliency map for improved visualization in CXR images. We also define and calculate a Severity Assessment Index (SAI) from the saliency map to quantitatively measure infection severity. The trained model achieved an accuracy score of 96.44% for the three-class CXR classification task, i.e., COVID-19, pneumonia, and normal (healthy patients), outperforming many existing techniques in the literature. The saliency maps generated from the proposed ML-GRAD-CAM algorithm are compared with the original Gran-CAM algorithm. 
    more » « less
  4. Beginning in early 2020, the novel coronavirus was the subject of frequent and sustained news coverage. Building on prior literature on the stress-inducing effects of consuming news during a large-scale crisis, we used network analysis to investigate the association between coronavirus disease 2019 (COVID-19) news consumption, COVID-19-related psychological stress, worries about oneself and one’s loved ones getting COVID-19, and sleep quality. Data were collected in March 2020 from 586 adults (45.2% female; 72.9% White) recruited via Amazon Mechanical Turk in the U.S. Participants completed online surveys assessing attitudes and behaviors related to COVID-19 and a questionnaire assessing seven domains of sleep quality. Networks were constructed using partial regularized correlation matrices. As hypothesized, COVID-19 news consumption was positively associated with COVID-19-related psychological stress and concerns about one’s loved ones getting COVID-19. However, there were very few associations between COVID-19 news consumption and sleep quality indices, and gender did not moderate any of the observed relationships. This study replicates and extends previous findings that COVID-19-news consumption is linked with psychological stress related to the pandemic, but even under such conditions, sleep quality can be spared due to the pandemic allowing for flexibility in morning work/school schedules. 
    more » « less
  5. null (Ed.)
    The new coronavirus (now named SARS-CoV-2) causing the disease pandemic in 2019 (COVID-19), has so far infected over 35 million people worldwide and killed more than 1 million. Most people with COVID-19 have no symptoms or only mild symptoms. But some become seriously ill and need hospitalization. The sickest are admitted to an Intensive Care Unit (ICU) and may need mechanical ventilation to help them breath. Being able to predict which patients with COVID-19 will become severely ill could help hospitals around the world manage the huge influx of patients caused by the pandemic and save lives. Now, Hao, Sotudian, Wang, Xu et al. show that computer models using artificial intelligence technology can help predict which COVID-19 patients will be hospitalized, admitted to the ICU, or need mechanical ventilation. Using data of 2,566 COVID-19 patients from five Massachusetts hospitals, Hao et al. created three separate models that can predict hospitalization, ICU admission, and the need for mechanical ventilation with more than 86% accuracy, based on patient characteristics, clinical symptoms, laboratory results and chest x-rays. Hao et al. found that the patients’ vital signs, age, obesity, difficulty breathing, and underlying diseases like diabetes, were the strongest predictors of the need for hospitalization. Being male, having diabetes, cloudy chest x-rays, and certain laboratory results were the most important risk factors for intensive care treatment and mechanical ventilation. Laboratory results suggesting tissue damage, severe inflammation or oxygen deprivation in the body's tissues were important warning signs of severe disease. The results provide a more detailed picture of the patients who are likely to suffer from severe forms of COVID-19. Using the predictive models may help physicians identify patients who appear okay but need closer monitoring and more aggressive treatment. The models may also help policy makers decide who needs workplace accommodations such as being allowed to work from home, which individuals may benefit from more frequent testing, and who should be prioritized for vaccination when a vaccine becomes available. 
    more » « less