skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Mosquito species identification accuracy of early deployed algorithms in IDX, A vector identification tool
Mosquito-borne diseases continue to pose a great threat to global public health systems due to increased insecticide resistance and climate change. Accurate vector identification is crucial for effective control, yet it presents significant challenges. IDX - an automated computer vision-based device capable of capturing mosquito images and outputting mosquito species ID has been deployed globally resulting in algorithms currently capable of identifying 53 mosquito species. In this study, we evaluate deployed performance of the IDX mosquito species identification algorithms using data from partners in the Southeastern United States (SE US) and Papua New Guinea (PNG) in 2023 and 2024. This preliminary assessment indicates continued improvement of the IDX mosquito species identification algorithms over the study period for individual species as well as average regional accuracy with macro average recall improving from 55.3 % [Confidence Interval (CI) 48.9, 61.7] to 80.2 % [CI 77.3, 84.9] for SE US, and 84.1 % [CI 75.1, 93.1] to 93.6 % [CI 91.6, 95.6] for PNG using a CI of 90 %. This study underscores the importance of algorithm refinement and dataset expansion covering more species and regions to enhance identification systems thereby reducing the workload for human experts, addressing taxonomic expertise gaps, and improving vector control efforts.  more » « less
Award ID(s):
2322335
PAR ID:
10556069
Author(s) / Creator(s):
; ; ; ; ; ; ;
Publisher / Repository:
Acta Tropica, Elsevier, Science Direct
Date Published:
Journal Name:
Acta Tropica
Volume:
260
Issue:
C
ISSN:
0001-706X
Page Range / eLocation ID:
107392
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Effective mosquito surveillance and control relies on rapid and accurate identification of mosquito vectors and confounding sympatric species. As adoption of modified mosquito (MM) control techniques has increased, the value of monitoring the success of interventions has gained recognition and has pushed the field away from traditional ‘spray and pray’ approaches. Field evaluation and monitoring of MM control techniques that target specific species require massive volumes of surveillance data involving species-level identifications. However, traditional surveillance methods remain time and labor-intensive, requiring highly trained, experienced personnel. Health districts often lack the resources needed to collect essential data, and conventional entomological species identification involves a significant learning curve to produce consistent high accuracy data. These needs led us to develop MosID: a device that allows for high-accuracy mosquito species identification to enhance capability and capacity of mosquito surveillance programs. The device features high-resolution optics and enables batch image capture and species identification of mosquito specimens using computer vision. While development is ongoing, we share an update on key metrics of the MosID system. The identification algorithm, tested internally across 16 species, achieved 98.4 ± 0.6% % macro F1-score on a dataset of known species, unknown species used in training, and species reserved for testing (species, specimens respectively: 12, 1302; 12, 603; 7, 222). Preliminary user testing showed specimens were processed with MosID at a rate ranging from 181-600 specimens per hour. We also discuss other metrics within technical scope, such as mosquito sex and fluorescence detection, that may further support MM programs. 
    more » « less
  2. Abstract With over 3500 mosquito species described, accurate species identification of the few implicated in disease transmission is critical to mosquito borne disease mitigation. Yet this task is hindered by limited global taxonomic expertise and specimen damage consistent across common capture methods. Convolutional neural networks (CNNs) are promising with limited sets of species, but image database requirements restrict practical implementation. Using an image database of 2696 specimens from 67 mosquito species, we address the practical open-set problem with a detection algorithm for novel species. Closed-set classification of 16 known species achieved 97.04 ± 0.87% accuracy independently, and 89.07 ± 5.58% when cascaded with novelty detection. Closed-set classification of 39 species produces a macro F1-score of 86.07 ± 1.81%. This demonstrates an accurate, scalable, and practical computer vision solution to identify wild-caught mosquitoes for implementation in biosurveillance and targeted vector control programs, without the need for extensive image database development for each new target region. 
    more » « less
  3. Wolfner, Mariana Federica (Ed.)
    The rising interest and success in deploying inherited microorganisms and cytoplasmic incompatibility (CI) for vector control strategies necessitate an explanation of the CI mechanism. Wolbachia-induced CI manifests in the form of embryonic lethality when sperm from Wolbachia-bearing testes fertilize eggs from uninfected females. Embryos from infected females however survive to sustain the maternally inherited symbiont. Previously in Drosophila melanogaster flies, we demonstrated that CI modifies chromatin integrity in developing sperm to bestow the embryonic lethality. Here, we validate these findings using wMel-transinfected Aedes aegypti mosquitoes released to control vector-borne diseases. Once again, the prophage WO CI proteins, CifA and CifB, target male gametic nuclei to modify chromatin integrity via an aberrant histone-to-protamine transition. Cifs are not detected in the embryo, and thus elicit CI via the nucleoprotein modifications established pre-fertilization. The rescue protein CifA in oogenesis localizes to stem cell, nurse cell, and oocyte nuclei, as well as embryonic DNA during embryogenesis. Discovery of the nuclear targeting Cifs and altered histone-to-protamine transition in both Aedes aegypti mosquitoes and D. melanogaster flies affirm the Host Modification Model of CI is conserved across these host species. The study also newly uncovers the cell biology of Cif proteins in the ovaries, CifA localization in the embryos, and an impaired histone-to-protamine transition during spermiogenesis of any mosquito species. Overall, these sperm modification findings may enable future optimization of CI efficacy in vectors or pests that are refractory to Wolbachia transinfections. 
    more » « less
  4. Mosquito-borne diseases continue to ravage humankind with >700 million infections and nearly one million deaths every year. Yet only a small percentage of the >3500 mosquito species transmit diseases, necessitating both extensive surveillance and precise identification. Unfortunately, such efforts are costly, time-consuming, and require entomological expertise. As envisioned by the Global Mosquito Alert Consortium, citizen science can provide a scalable solution. However, disparate data standards across existing platforms have thus far precluded truly global integration. Here, utilizing Open Geospatial Consortium standards, we harmonized four data streams from three established mobile apps—Mosquito Alert, iNaturalist, and GLOBE Observer’s Mosquito Habitat Mapper and Land Cover—to facilitate interoperability and utility for researchers, mosquito control personnel, and policymakers. We also launched coordinated media campaigns that generated unprecedented numbers and types of observations, including successfully capturing the first images of targeted invasive and vector species. Additionally, we leveraged pooled image data to develop a toolset of artificial intelligence algorithms for future deployment in taxonomic and anatomical identification. Ultimately, by harnessing the combined powers of citizen science and artificial intelligence, we establish a next-generation surveillance framework to serve as a united front to combat the ongoing threat of mosquito-borne diseases worldwide. 
    more » « less
  5. Abstract Mosquito abundance and distribution are related to environmental variables like rainfall and land cover which shape available aquatic habitat for oviposition and juvenile development. Many mosquito species rely on natural water sources for oviposition and juvenile development. However, others have evolved to occupy urban niches and artificial habitats associated with urbanization and human-dominated environments, like tires or storm drains. Additionally, as land cover changes over rural–urban gradients, mosquito species richness decreases via reduced habitat heterogeneity. Human exposure to mosquitoes is a product of environmental processes, and human behaviors related to mosquito control and personal protection. To understand mosquito distribution from both perspectives, we conducted a study with paired entomological and behavioral science data collection. We collected mosquitoes at 40 sites across a rural–urban gradient of 30 residential properties and 10 recreational forest sites in Bangor, Maine, and conducted a juvenile habitat assessment on the residential properties. Additionally, a Knowledge, Attitudes and Practice survey was administered among property owners to understand factors that affect engagement in mosquito control and protective behaviors. Mosquito abundance was highest in forested and rural residential sites. Nuisance species abundance was highest at rural residential sites, while vector species abundance was highest in urban residential sites. Despite 54% respondents reporting mosquitoes as a nuisance, only 10.5% and 5.3% reported frequent engagement in preventative behaviors such as wearing mosquito repellent or protective clothing, respectively. This study builds on literature demonstrating patterns of vector mosquito abundance in residential areas and exploration of resident mosquito control practices. 
    more » « less