skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Modified Mosquito Programs’ Surveillance Needs and An Image-Based Identification Tool to Address Them
Effective mosquito surveillance and control relies on rapid and accurate identification of mosquito vectors and confounding sympatric species. As adoption of modified mosquito (MM) control techniques has increased, the value of monitoring the success of interventions has gained recognition and has pushed the field away from traditional ‘spray and pray’ approaches. Field evaluation and monitoring of MM control techniques that target specific species require massive volumes of surveillance data involving species-level identifications. However, traditional surveillance methods remain time and labor-intensive, requiring highly trained, experienced personnel. Health districts often lack the resources needed to collect essential data, and conventional entomological species identification involves a significant learning curve to produce consistent high accuracy data. These needs led us to develop MosID: a device that allows for high-accuracy mosquito species identification to enhance capability and capacity of mosquito surveillance programs. The device features high-resolution optics and enables batch image capture and species identification of mosquito specimens using computer vision. While development is ongoing, we share an update on key metrics of the MosID system. The identification algorithm, tested internally across 16 species, achieved 98.4 ± 0.6% % macro F1-score on a dataset of known species, unknown species used in training, and species reserved for testing (species, specimens respectively: 12, 1302; 12, 603; 7, 222). Preliminary user testing showed specimens were processed with MosID at a rate ranging from 181-600 specimens per hour. We also discuss other metrics within technical scope, such as mosquito sex and fluorescence detection, that may further support MM programs.  more » « less
Award ID(s):
2039534
PAR ID:
10385835
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Frontiers in Tropical Diseases
Volume:
2
ISSN:
2673-7515
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract BackgroundMosquitoes and the diseases they transmit pose a significant public health threat worldwide, causing more fatalities than any other animal. To effectively combat this issue, there is a need for increased public awareness and mosquito control. However, traditional surveillance programs are time-consuming, expensive, and lack scalability. Fortunately, the widespread availability of mobile devices with high-resolution cameras presents a unique opportunity for mosquito surveillance. In response to this, the Global Mosquito Observations Dashboard (GMOD) was developed as a free, public platform to improve the detection and monitoring of invasive and vector mosquitoes through citizen science participation worldwide. MethodsGMOD is an interactive web interface that collects and displays mosquito observation and habitat data supplied by four datastreams with data generated by citizen scientists worldwide. By providing information on the locations and times of observations, the platform enables the visualization of mosquito population trends and ranges. It also serves as an educational resource, encouraging collaboration and data sharing. The data acquired and displayed on GMOD is freely available in multiple formats and can be accessed from any device with an internet connection. ResultsSince its launch less than a year ago, GMOD has already proven its value. It has successfully integrated and processed large volumes of real-time data (~ 300,000 observations), offering valuable and actionable insights into mosquito species prevalence, abundance, and potential distributions, as well as engaging citizens in community-based surveillance programs. ConclusionsGMOD is a cloud-based platform that provides open access to mosquito vector data obtained from citizen science programs. Its user-friendly interface and data filters make it valuable for researchers, mosquito control personnel, and other stakeholders. With its expanding data resources and the potential for machine learning integration, GMOD is poised to support public health initiatives aimed at reducing the spread of mosquito-borne diseases in a cost-effective manner, particularly in regions where traditional surveillance methods are limited. GMOD is continually evolving, with ongoing development of powerful artificial intelligence algorithms to identify mosquito species and other features from submitted data. The future of citizen science holds great promise, and GMOD stands as an exciting initiative in this field. 
    more » « less
  2. Mosquito-borne diseases continue to pose a great threat to global public health systems due to increased insecticide resistance and climate change. Accurate vector identification is crucial for effective control, yet it presents significant challenges. IDX - an automated computer vision-based device capable of capturing mosquito images and outputting mosquito species ID has been deployed globally resulting in algorithms currently capable of identifying 53 mosquito species. In this study, we evaluate deployed performance of the IDX mosquito species identification algorithms using data from partners in the Southeastern United States (SE US) and Papua New Guinea (PNG) in 2023 and 2024. This preliminary assessment indicates continued improvement of the IDX mosquito species identification algorithms over the study period for individual species as well as average regional accuracy with macro average recall improving from 55.3 % [Confidence Interval (CI) 48.9, 61.7] to 80.2 % [CI 77.3, 84.9] for SE US, and 84.1 % [CI 75.1, 93.1] to 93.6 % [CI 91.6, 95.6] for PNG using a CI of 90 %. This study underscores the importance of algorithm refinement and dataset expansion covering more species and regions to enhance identification systems thereby reducing the workload for human experts, addressing taxonomic expertise gaps, and improving vector control efforts. 
    more » « less
  3. Abstract With over 3500 mosquito species described, accurate species identification of the few implicated in disease transmission is critical to mosquito borne disease mitigation. Yet this task is hindered by limited global taxonomic expertise and specimen damage consistent across common capture methods. Convolutional neural networks (CNNs) are promising with limited sets of species, but image database requirements restrict practical implementation. Using an image database of 2696 specimens from 67 mosquito species, we address the practical open-set problem with a detection algorithm for novel species. Closed-set classification of 16 known species achieved 97.04 ± 0.87% accuracy independently, and 89.07 ± 5.58% when cascaded with novelty detection. Closed-set classification of 39 species produces a macro F1-score of 86.07 ± 1.81%. This demonstrates an accurate, scalable, and practical computer vision solution to identify wild-caught mosquitoes for implementation in biosurveillance and targeted vector control programs, without the need for extensive image database development for each new target region. 
    more » « less
  4. Abstract The ability to distinguish between the abdominal conditions of adult female mosquitoes has important utility for the surveillance and control of mosquito-borne diseases. However, doing so requires entomological training and time-consuming manual effort. Here, we design computer vision techniques to determine stages in the gonotrophic cycle of female mosquitoes from images. Our dataset was collected from 139 adult female mosquitoes across three medically important species—Aedes aegypti,Anopheles stephensi, andCulex quinquefasciatus—and all four gonotrophic stages of the cycle (unfed, fully fed, semi-gravid, and gravid). From these mosquitoes and stages, a total of 1959 images were captured on a plain background via multiple smartphones. Subsequently, we trained four distinct AI model architectures (ResNet50,MobileNetV2,EfficientNet-B0, andConvNeXtTiny), validated them using unseen data, and compared their overall classification accuracies. Additionally, we analyzed t-SNE plots to visualize the formation of decision boundaries in a lower-dimensional space. Notably,ResNet50andEfficientNet-B0demonstrated outstanding performance with an overall accuracy of 97.44% and 93.59%, respectively.EfficientNet-B0demonstrated the best overall performance considering computational efficiency, model size, training speed, and t-SNE decision boundaries. We also assessed the explainability of thisEfficientNet-B0model, by implementing Grad-CAMs—a technique that highlights pixels in an image that were prioritized for classification. We observed that the highest weight was for those pixels representing the mosquito abdomen, demonstrating that our AI model has indeed learned correctly. Our work has significant practical impact. First, image datasets for gonotrophic stages of mosquitoes are not yet available. Second, our algorithms can be integrated with existing citizen science platforms that enable the public to record and upload biological observations. With such integration, our algorithms will enable the public to contribute to mosquito surveillance and gonotrophic stage identification. Finally, we are aware of work today that uses computer vision techniques for automated mosquito species identification, and our algorithms in this paper can augment these efforts by enabling the automated detection of gonotrophic stages of mosquitoes as well. 
    more » « less
  5. Mosquito-borne diseases continue to ravage humankind with >700 million infections and nearly one million deaths every year. Yet only a small percentage of the >3500 mosquito species transmit diseases, necessitating both extensive surveillance and precise identification. Unfortunately, such efforts are costly, time-consuming, and require entomological expertise. As envisioned by the Global Mosquito Alert Consortium, citizen science can provide a scalable solution. However, disparate data standards across existing platforms have thus far precluded truly global integration. Here, utilizing Open Geospatial Consortium standards, we harmonized four data streams from three established mobile apps—Mosquito Alert, iNaturalist, and GLOBE Observer’s Mosquito Habitat Mapper and Land Cover—to facilitate interoperability and utility for researchers, mosquito control personnel, and policymakers. We also launched coordinated media campaigns that generated unprecedented numbers and types of observations, including successfully capturing the first images of targeted invasive and vector species. Additionally, we leveraged pooled image data to develop a toolset of artificial intelligence algorithms for future deployment in taxonomic and anatomical identification. Ultimately, by harnessing the combined powers of citizen science and artificial intelligence, we establish a next-generation surveillance framework to serve as a united front to combat the ongoing threat of mosquito-borne diseases worldwide. 
    more » « less