skip to main content


Title: A Mobile-Based System for Detecting Plant Leaf Diseases Using Deep Learning
Plant diseases are one of the grand challenges that face the agriculture sector worldwide. In the United States, crop diseases cause losses of one-third of crop production annually. Despite the importance, crop disease diagnosis is challenging for limited-resources farmers if performed through optical observation of plant leaves’ symptoms. Therefore, there is an urgent need for markedly improved detection, monitoring, and prediction of crop diseases to reduce crop agriculture losses. Computer vision empowered with Machine Learning (ML) has tremendous promise for improving crop monitoring at scale in this context. This paper presents an ML-powered mobile-based system to automate the plant leaf disease diagnosis process. The developed system uses Convolutional Neural networks (CNN) as an underlying deep learning engine for classifying 38 disease categories. We collected an imagery dataset containing 96,206 images of plant leaves of healthy and infected plants for training, validating, and testing the CNN model. The user interface is developed as an Android mobile app, allowing farmers to capture a photo of the infected plant leaves. It then displays the disease category along with the confidence percentage. It is expected that this system would create a better opportunity for farmers to keep their crops healthy and eliminate the use of wrong fertilizers that could stress the plants. Finally, we evaluated our system using various performance metrics such as classification accuracy and processing time. We found that our model achieves an overall classification accuracy of 94% in recognizing the most common 38 disease classes in 14 crop species.  more » « less
Award ID(s):
2011330
NSF-PAR ID:
10330673
Author(s) / Creator(s):
;
Date Published:
Journal Name:
AgriEngineering
Volume:
3
Issue:
3
ISSN:
2624-7402
Page Range / eLocation ID:
478 to 493
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. During the 1950s, the Gros Michel species of bananas were nearly wiped out by the incurable Fusarium Wilt, also known as Panama Disease. Originating in Southeast Asia, Fusarium Wilt is a banana pandemic that has been threatening the multi-billion-dollar banana industry worldwide. The disease is caused by a fungus that spreads rapidly throughout the soil and into the roots of banana plants. Currently, the only way to stop the spread of this disease is for farmers to manually inspect and remove infected plants as quickly as possible, which is a time-consuming process. The main purpose of this study is to build a deep Convolutional Neural Network (CNN) using a transfer learning approach to rapidly identify Fusarium wilt infections on banana crop leaves. We chose to use the ResNet50 architecture as the base CNN model for our transfer learning approach owing to its remarkable performance in image classification, which was demonstrated through its victory in the ImageNet competition. After its initial training and fine-tuning on a data set consisting of 600 healthy and diseased images, the CNN model achieved near-perfect accuracy of 0.99 along with a loss of 0.46 and was fine-tuned to adapt the ResNet base model. ResNet50’s distinctive residual block structure could be the reason behind these results. To evaluate this CNN model, 500 test images, consisting of 250 diseased and healthy banana leaf images, were classified by the model. The deep CNN model was able to achieve an accuracy of 0.98 and an F-1 score of 0.98 by correctly identifying the class of 492 of the 500 images. These results show that this DCNN model outperforms existing models such as Sangeetha et al., 2023’s deep CNN model by at least 0.07 in accuracy and is a viable option for identifying Fusarium Wilt in banana crops.

     
    more » « less
  2. The food production system is vulnerable to diseases more than ever, and the threat is increasing in an era of climate change that creates more favorable conditions for emerging diseases. Fortunately, scientists and engineers are making great strides to introduce farming innovations to tackle the challenge. Unmanned aerial vehicle (UAV) remote sensing is among the innovations and thus is widely applied for crop health monitoring and phenotyping. This study demonstrated the versatility of aerial remote sensing in diagnosing yellow rust infection in spring wheats in a timely manner and determining an intervenable period to prevent yield loss. A small UAV equipped with an aerial multispectral sensor periodically flew over, and collected remotely sensed images of, an experimental field in Chacabuco (−34.64; −60.46), Argentina during the 2021 growing season. Post-collection images at the plot level were engaged in a thorough feature-engineering process by handcrafting disease-centric vegetation indices (VIs) from the spectral dimension, and grey-level co-occurrence matrix (GLCM) texture features from the spatial dimension. A machine learning pipeline entailing a support vector machine (SVM), random forest (RF), and multilayer perceptron (MLP) was constructed to identify locations of healthy, mild infection, and severe infection plots in the field. A custom 3-dimensional convolutional neural network (3D-CNN) relying on the feature learning mechanism was an alternative prediction method. The study found red-edge (690–740 nm) and near infrared (NIR) (740–1000 nm) as vital spectral bands for distinguishing healthy and severely infected wheats. The carotenoid reflectance index 2 (CRI2), soil-adjusted vegetation index 2 (SAVI2), and GLCM contrast texture at an optimal distance d = 5 and angular direction θ = 135° were the most correlated features. The 3D-CNN-based wheat disease monitoring performed at 60% detection accuracy as early as 40 days after sowing (DAS), when crops were tillering, increasing to 71% and 77% at the later booting and flowering stages (100–120 DAS), and reaching a peak accuracy of 79% for the spectral-spatio-temporal fused data model. The success of early disease diagnosis from low-cost multispectral UAVs not only shed new light on crop breeding and pathology but also aided crop growers by informing them of a prevention period that could potentially preserve 3–7% of the yield at the confidence level of 95%. 
    more » « less
  3. Agriculture is facing new challenges, with global warming modifying the survival chances for crops, and new pests on the horizon. To keep up with these challenges, gene delivery provides tools to increase crop yields. On the other hand, gene delivery also opens the door for molecular farming of pharmaceuticals in plants. However, towards increased food production and scalable molecular farming, there remain technical difficulties and regulatory hurdles to overcome. The industry-standard is transformation of plants via Agrobacterium tumefaciens , but this method is limited to certain plants, requires set up of plant growth facilities and fermentation of bacteria, and introduces lipopolysaccharides contaminants into the system. Therefore, alternate methods are needed. Mechanical inoculation and spray methods have already been discussed in the literature – and here, we compare these methods with a newly introduced petiole injection technique. Because our interest lies in the development of plant viruses as immunotherapies targeting human health as well as gene delivery vectors for agriculture applications, we turned toward tobacco mosaic virus as a model system. We studied the effectiveness of three inoculation techniques: mechanical inoculation, Silwet-77 foliar spray and petiole injections. The foliar spray method was optimized, and we used 0.03% Silwet L-77 to induce infection using either TMV or a lysine-added mutant TMV-Lys. We developed a method using a needle-laden syringe to target and inject the plant virus directly into the vasculature of the plant – we tested injection into the stem and petiole. Stem inoculation resulted in toxicity, but the petiole injection technique was established as a viable strategy. TMV and TMV-Lys were purified from single plants and pooled leaf samples – overall there was little variation between the techniques, as measured by TMV or TMV-Lys yields, highlighting the feasibility of the syringe injection technique to produce virus nanoparticles. There was variation between yields from preparation to preparation with mechanical, spray and syringe inoculation yielding 40–141 mg, 36–56 mg, 18–56 mg TMV per 100 grams of leaves. Similar yields were obtained using TMV-Lys, with 24–38 mg, 17–28, 7–36 mg TMV-Lys per 100 grams of leaves for mechanical, spray and syringe inoculation, respectively. Each method has its advantages: spray inoculation is highly scalable and therefore may find application for farming, the syringe inoculation could provide a clean, aseptic, and controlled approach for molecular farming of pharmaceuticals under good manufacturing protocols (GMP) and would even be applicable for gene delivery to plants in space. 
    more » « less
  4. null (Ed.)
    In recent decades, computer vision has proven remarkably effective in addressing diverse issues in public health, from determining the diagnosis, prognosis, and treatment of diseases in humans to predicting infectious disease outbreaks. Here, we investigate whether convolutional neural networks (CNNs) can also demonstrate effectiveness in classifying the environmental stages of parasites of public health importance and their invertebrate hosts. We used schistosomiasis as a reference model. Schistosomiasis is a debilitating parasitic disease transmitted to humans via snail intermediate hosts. The parasite affects more than 200 million people in tropical and subtropical regions. We trained our CNN, a feed-forward neural network, on a limited dataset of 5,500 images of snails and 5,100 images of cercariae obtained from schistosomiasis transmission sites in the Senegal River Basin, a region in western Africa that is hyper-endemic for the disease. The image set included both images of two snail genera that are relevant to schistosomiasis transmission – that is, Bulinus spp. and Biomphalaria pfeifferi – as well as snail images that are non-component hosts for human schistosomiasis. Cercariae shed from Bi. pfeifferi and Bulinus spp. snails were classified into 11 categories, of which only two, S. haematobium and S. mansoni , are major etiological agents of human schistosomiasis. The algorithms, trained on 80% of the snail and parasite dataset, achieved 99% and 91% accuracy for snail and parasite classification, respectively, when used on the hold-out validation dataset – a performance comparable to that of experienced parasitologists. The promising results of this proof-of-concept study suggests that this CNN model, and potentially similar replicable models, have the potential to support the classification of snails and parasite of medical importance. In remote field settings where machine learning algorithms can be deployed on cost-effective and widely used mobile devices, such as smartphones, these models can be a valuable complement to laboratory identification by trained technicians. Future efforts must be dedicated to increasing dataset sizes for model training and validation, as well as testing these algorithms in diverse transmission settings and geographies. 
    more » « less
  5. Abstract

    Legumes are used in crop rotations by both large‐scale and smallholder farmers alike to increase soil fertility, especially before high‐nitrogen‐demanding crops such as corn (maize). Legume crop residues and green manures are rich in nitrogen due to mutualistic rhizobia, bacteria that live in their roots and convert atmospheric nitrogen into a biologically available form. Growers can obtain recommendations from local extension offices about how much less inorganic nitrogen fertilizer needs to be added to a subsequent crop following different legume break crops for the predominant soil type (the nitrogen fertilizer replacement value, or NFRV). Due to the intimate relationship between legumes and rhizobia, conditions that affect plant health can also affect the rhizobia and how much nitrogen they provide. We use a combination of empirical data and previously published values to estimate reductions in nitrogen inputs under outbreaks of plant viruses of varying severity. We also use historical fertilizer prices to examine the economic impacts of this lost fertilizer for farmers. We find that fertilizer losses are greatest for crops that fix large amounts of nitrogen, such as clover and alfalfa as opposed to common bean. The economic impact on farmers is controlled by the proportion of plants with viral infections and the price of synthetic fertilizer. In a year of high disease prevalence, attention is normally focused on the yield of the diseased crops. We suggest that farmers growing legumes as break crops should be concerned about yields of subsequent crops as well. Viral diseases can be difficult to diagnose in the field, so the easiest way for farmers to prevent unexpected yield losses in subsequent crops is to test their soil when it is feasible to do so.

     
    more » « less