skip to main content


Title: Automated Video Monitoring of Unmarked and Marked Honey Bees at the Hive Entrance
We present a novel system for the automatic video monitoring of honey bee foraging activity at the hive entrance. This monitoring system is built upon convolutional neural networks that perform multiple animal pose estimation without the need for marking. This precise detection of honey bee body parts is a key element of the system to provide detection of entrance and exit events at the entrance of the hive including accurate pollen detection. A detailed evaluation of the quality of the detection and a study of the effect of the parameters are presented. The complete system also integrates identification of barcode marked bees, which enables the monitoring at both aggregate and individual levels. The results obtained on multiple days of video recordings show the applicability of the approach for large-scale deployment. This is an important step forward for the understanding of complex behaviors exhibited by honey bees and the automatic assessment of colony health.  more » « less
Award ID(s):
1736019
NSF-PAR ID:
10428008
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
Frontiers in Computer Science
Volume:
3
ISSN:
2624-9898
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Honey bees are social insects that live in large groups called colonies, within structures known as hives. The young adult bees stay within the hive to build nests and care for the young, while the older bees leave the hive to forage for food. Honey bees store food and other valuable resources in their hives, so they are often targeted by predators, parasites and ‘robber’ bees from other colonies. Therefore, it is important for bees to determine whether individuals trying to enter the nest are group members or intruders. While it is known that social insects use blends of waxy chemicals called cuticular hydrocarbons to identify group members at the entrance to the colony, it is not clear how members of the same colony acquire a similar blend of cuticular hydrocarbons. Some previous work suggested that in some ant species (which are also social insects), colony members exchange cuticular hydrocarbons with each other so that all members of the colony are covered with a similar blend of chemicals. However, it was not known whether honey bees also share cuticular hydrocarbons between colony members in order to identify members of a hive. Vernier et al. used chemical, molecular and behavioral approaches to study the cuticular hydrocarbons found on honey bees. The results show that, rather than exchanging chemicals with other members of their colony, individual bees make their own blends of cuticular hydrocarbons. As a bee ages it makes different blends of cuticular hydrocarbons, and by the time it starts to leave the hive to forage it makes a blend that is specific to the colony it belongs to. The production of this final blend is influenced by the environment within the hive. Thus, the findings of Vernier et al. indicate that honey bees guarding the entrance to a hive can only identify non-colony-member forager bees as intruders, rather than any non-colony-member bee that happens upon the hive entrance. Honey bees play an essential role in pollinating many crop plants so understanding how these insects maintain their social groups may help to improve agriculture in the future. Furthermore, this work may aid our understanding of how other social insects interact in a variety of biological situations. 
    more » « less
  2. Males in Hymenopteran societies are understudied in many aspects and it is assumed that they only have a reproductive function. We studied the time budget of male honey bees, drones, using multiple methods. Changes in the activities of animals provide important information on biological clocks and their health. Yet, in nature, these changes are subtle and often unobservable without the development and use of modern technology. During the spring and summer mating season, drones emerge from the hive, perform orientation flights, and search for drone congregation areas for mating. This search may lead drones to return to their colony, drift to other colonies (vectoring diseases and parasites), or simply get lost to predation. In a low percentage of cases, the search is successful, and drones mate and die. Our objective was to describe the activity of Apis mellifera drones during the mating season in Northwestern Argentina using three methods: direct observation, video recording, and radio frequency identification (RFID). The use of RFID tagging allows the tracking of a bee for 24 h but does not reveal the detailed activity of drones. We quantified the average number of drones’ departure and arrival flights and the time outside the hive. All three methods confirmed that drones were mostly active in the afternoon. We found no differences in results between those obtained by direct observation and by video recording. RFID technology enabled us to discover previously unknown drone behavior such as activity at dawn and during the morning. We also discovered that drones may stay inside the hive for many days, even after initiation of search flights (up to four days). Likewise, we observed drones to leave the hive for several days to return later (up to three days). The three methods were complementary and should be considered for the study of bee drone activity, which may be associated with the diverse factors influencing hive health. 
    more » « less
  3. Daniel, Sloan (Ed.)
    Abstract Recent declines in the health of the honey bee have startled researchers and lay people alike as honey bees are agriculture’s most important pollinator. Honey bees are important pollinators of many major crops and add billions of dollars annually to the US economy through their services. One factor that may influence colony health is the microbial community. Indeed, the honey bee worker digestive tract harbors a characteristic community of bee-specific microbes, and the composition of this community is known to impact honey bee health. However, the honey bee is a superorganism, a colony of eusocial insects with overlapping generations where nestmates cooperate, building a hive, gathering and storing food, and raising brood. In contrast to what is known regarding the honey bee worker gut microbiome, less is known of the microbes associated with developing brood, with food stores, and with the rest of the built hive environment. More recently, the microbe Bombella apis was identified as associated with nectar, with developing larvae, and with honey bee queens. This bacterium is related to flower-associated microbes such as Saccharibacter floricola and other species in the genus Saccharibacter, and initial phylogenetic analyses placed it as sister to these environmental bacteria. Here, we used comparative genomics of multiple honey bee-associated strains and the nectar-associated Saccharibacter to identify genomic changes that may be associated with the ecological transition to honey bee association. We identified several genomic differences in the honey bee-associated strains, including a complete CRISPR/Cas system. Many of the changes we note here are predicted to confer upon Bombella the ability to survive in royal jelly and defend themselves against mobile elements, including phages. Our results are a first step toward identifying potential function of this microbe in the honey bee superorganism. 
    more » « less
  4. In this paper, the recognition of pollen bearing honey bees from videos of the entrance of the hive is presented. This computer vision task is a key component for the automatic monitoring of honeybees in order to obtain large scale data of their foraging behavior and task specialization. Several approaches are considered for this task, including baseline classifiers, shallow Convolutional Neural Networks, and deeper networks from the literature. The experimental comparison is based on a new dataset of images of honeybees that was manually annotated for the presence of pollen. The proposed approach, based on Convolutional Neural Networks is shown to outperform the other approaches in terms of accuracy. Detailed analysis of the results and the influence of the architectural parameters, such as the impact of dedicated color based data augmentation, provide insights into how to apply the approach to the target application. 
    more » « less
  5. Abstract

    Introduced species can have cascading effects on ecological communities, but indirect effects of species introductions are rarely the focus of ecological studies. For example, managed honey bees (Apis mellifera) have been widely introduced outside their native range and are increasingly dominant floral visitors. Multiple studies have documented how honey bees impact native bee communities through floral resource competition, but few have quantified how these competitive interactions indirectly affect pollination and plant reproduction. Such indirect effects are hard to detect because honey bees are themselves pollinators and may directly impact pollination through their own floral visits. The potentially huge but poorly understood impacts that non‐native honey bees have on native plant populations combined with increased pressure from beekeepers to place hives in U.S. National Parks and Forests makes exploring impacts of honey bee introductions on native plant pollination of pressing concern. In this study, we used experimental hive additions, field observations, as well as single‐visit and multiple‐visit pollination effectiveness trials across multiple years to untangle the direct and indirect impacts of increasing honey bee abundance on the pollination of an ecologically important wildflower,Camassia quamash. We found compelling evidence that honey bee introductions indirectly decrease pollination by reducing nectar and pollen availability and competitively excluding visits from more effective native bees. In contrast, the direct impact of honey bee visits on pollination was negligible, and, if anything, negative. Honey bees were ineffective pollinators, and increasing visit quantity could not compensate for inferior visit quality. Indeed, although the effect was not statistically significant, increased honey bee visits had a marginally negative impact on seed production. Thus, honey bee introductions may erode longstanding plant‐pollinator mutualisms, with negative consequences for plant reproduction. Our study calls for a more thorough understanding of the indirect effects of species introductions and more careful coordination of hive placements.

     
    more » « less