skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: On Developing a Machine Learning-Based Approach for the Automatic Characterization of Behavioral Phenotypes for Dairy Cows Relevant to Thermotolerance
The United States is predicted to experience an annual decline in milk production due to heat stress of 1.4 and 1.9 kg/day by the 2050s and 2080s, with economic losses of USD 1.7 billion and USD 2.2 billion, respectively, despite current cooling efforts implemented by the dairy industry. The ability of cattle to withstand heat (i.e., thermotolerance) can be influenced by physiological and behavioral factors, even though the factors contributing to thermoregulation are heritable, and cows vary in their behavioral repertoire. The current methods to gauge cow behaviors are lacking in precision and scalability. This paper presents an approach leveraging various machine learning (ML) (e.g., CNN and YOLOv8) and computer vision (e.g., Video Processing and Annotation) techniques aimed at quantifying key behavioral indicators, specifically drinking frequency and brush use- behaviors. These behaviors, while challenging to quantify using traditional methods, offer profound insights into the autonomic nervous system function and an individual cow’s coping mechanisms under heat stress. The developed approach provides an opportunity to quantify these difficult-to-measure drinking and brush use behaviors of dairy cows milked in a robotic milking system. This approach will open up a better opportunity for ranchers to make informed decisions that could mitigate the adverse effects of heat stress. It will also expedite data collection regarding dairy cow behavioral phenotypes. Finally, the developed system is evaluated using different performance metrics, including classification accuracy. It is found that the YoloV8 and CNN models achieved a classification accuracy of 93% and 96% for object detection and classification, respectively.  more » « less
Award ID(s):
2200377 2011330
PAR ID:
10583386
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
MDPI
Date Published:
Journal Name:
MDPI AgriEngineering
Volume:
6
Issue:
3
ISSN:
2624-7402
Page Range / eLocation ID:
2656 to 2677
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The objective of this study was to evaluate the performance of an XGBoost model trained with behavioral, physiological, performance, environmental, and cow feature data for classifying cow health status (HS). The model predicted HS based on physical activity, resting, reticulo-rumen temperature, rumination and eating behavior, milk yield, conductivity and components, temperature and humidity index, parity, calving features, and stocking density. Daily at 5 a.m., the model generated a HS prediction [0 = no health disorder (HD); 1 = health disorder]. At 7 a.m., technicians blind to the prediction conducted clinical exams on cows from 3 to 11 DIM to classify cows (n = 625) as affected (HD = 1) or not (HD = 0) by metritis, mastitis, ketosis, indigestion, displaced abomasum, and pneumonia. Using each day a cow presented clinical signs of HD as a positive case (i.e., HD = 1), metrics of performance (%; 95% CI) were: sensitivity (Se) = 57 [52, 62], specificity = 81 [80, 82]; positive predictive value (PPV) = 20 [18, 22], negative predictive value = 96 [95, 96], accuracy = 79 [78, 80], balanced accuracy = 69 [66, 72], F-1 Score = 29 [26, 32]. Sensitivity was also evaluated using fixed time intervals around clinical diagnosis of disease as a positive case (Table 1). Our findings suggest that the ability of an XGBoost algorithm trained on diverse sensor and nonsensor data to identify cows with HD was moderate when only days when cows presented clinical signs of disease were considered a positive case. Sensitivity and PPV can be improved substantially when all days within fixed intervals before and after clinical diagnosis are used as positive cases. Table 1 (Abstr. 2614). Sensitivity and PPV for an XGBoost algorithm trained to predict cow health status using fixed intervals before and after clinical diagnosis as positive cases Day relative to CD Se (%) 95% CI PPV (%) 95% CI −5 to 0 58 49, 67 21 16, 25 −3 to 0 55 46, 64 19 15, 24 −5 to 1 69 61, 78 24 20, 29 −5 to 3 81 73, 88 28 23, 33 −5 to 5 86 80, 92 30 25, 34 −3 to 1 67 58, 75 23 18, 27 −3 to 3 78 70, 86 27 22, 31 −3 to 5 83 76, 90 28 24, 33 0 to 3 75 68, 83 24 20, 29 0 to 5 81 73, 88 26 21, 31 −1 to 0 54 44, 63 18 14, 22 0 to 1 63 54, 72 20 16, 25 −1 to 1 66 57, 75 21 17, 26 
    more » « less
  2. Precision livestock farming (PLF) has been transformed by machine learning (ML), enabling more precise and timely interventions that enhance overall farm productivity, animal welfare, and environmental sustainability. However, despite the availability of various sensing technologies, few datasets leverage multiple modalities, which are crucial for developing more accurate and efficient monitoring devices and ML models. To address this gap, we present MMCOWS, a multimodal dataset for dairy cattle monitoring. This dataset comprises a large amount of synchronized, high-quality measurement data on behavioral, physiological, and environmental factors. It includes two weeks of data collected using wearable and implantable sensors deployed on ten milking Holstein cows, such as ultra-wideband (UWB) sensors, inertial sensors, and body temperature sensors. In addition, it features 4.8 million frames of high-resolution image sequences from four isometric view cameras, as well as temperature and humidity data from environmental sensors. We also gathered milk yield data and outdoor weather conditions. One full day’s worth of image data is annotated as ground truth, totaling 20,000 frames with 213,000 bounding boxes of 16 cows, along with their 3D locations and behavior labels. An extensive analysis of MMCOWS is provided to evaluate the modalities individually and their complementary benefits. The release of MMCOWS and its benchmarks will facilitate research on multimodal monitoring of dairy cattle, thereby promoting sustainable dairy farming. The dataset and the code for benchmarks are available at https://github.com/neis-lab/mmcows. 
    more » « less
  3. Large and densely sampled sensor datasets can contain a range of complex stochastic structures that are difficult to accommodate in conventional linear models. This can confound attempts to build a more complete picture of an animal’s behavior by aggregating information across multiple asynchronous sensor platforms. The Livestock Informatics Toolkit (LIT) has been developed in R to better facilitate knowledge discovery of complex behavioral patterns across Precision Livestock Farming (PLF) data streams using novel unsupervised machine learning and information theoretic approaches. The utility of this analytical pipeline is demonstrated using data from a 6-month feed trial conducted on a closed herd of 185 mix-parity organic dairy cows. Insights into the tradeoffs between behaviors in time budgets acquired from ear tag accelerometer records were improved by augmenting conventional hierarchical clustering techniques with a novel simulation-based approach designed to mimic the complex error structures of sensor data. These simulations were then repurposed to compress the information in this data stream into robust empirically-determined encodings using a novel pruning algorithm. Nonparametric and semiparametric tests using mutual and pointwise information subsequently revealed complex nonlinear associations between encodings of overall time budgets and the order that cows entered the parlor to be milked. 
    more » « less
  4. Global Positioning Systems (GPSs) can collect tracking data to remotely monitor livestock well-being and pasture use. Supervised machine learning requires behavioral observations of monitored animals to identify changes in behavior, which is labor-intensive. Our goal was to identify animal behaviors automatically without using human observations. We designed a novel framework using unsupervised learning techniques. The framework contains two steps. The first step segments cattle tracking data using state-of-the-art time series segmentation algorithms, and the second step groups segments into clusters and then labels the clusters. To evaluate the applicability of our proposed framework, we utilized GPS tracking data collected from five cows in a 1096 ha rangeland pasture. Cow movement pathways were grouped into six behavior clusters based on velocity (m/min) and distance from water. Again, using velocity, these six clusters were classified into walking, grazing, and resting behaviors. The mean velocity for predicted walking and grazing and resting behavior was 44, 13 and 2 min/min, respectively, which is similar to other research. Predicted diurnal behavior patterns showed two primary grazing bouts during early morning and evening, like in other studies. Our study demonstrates that the proposed two-step framework can use unlabeled GPS tracking data to predict cattle behavior without human observations. 
    more » « less
  5. Highly pathogenic avian influenza (HPAI) H5N1 haemagglutinin clade 2.3.4.4b was detected in the USA in 2021. These HPAI viruses caused mortality events in poultry, wild birds and wild mammals. On 25 March 2024, HPAI H5N1 clade 2.3.4.4b was confirmed in a dairy cow in Texas in response to a multistate investigation into milk production losses1. More than 200 positive herds were identified in 14 US states. The case description included reduced feed intake and rumen motility in lactating cows, decreased milk production and thick yellow milk2,3. The diagnostic investigation revealed viral RNA in milk and alveolar epithelial degeneration and necrosis and positive immunoreactivity of glandular epithelium in mammary tissue. A single transmission event, probably from birds, was followed by limited local transmission and onward horizontal transmission of H5N1 clade 2.3.4.4b genotype B3.13 (ref. 4). Here we sought to experimentally reproduce infection with genotype B3.13 in Holstein yearling heifers and lactating cows. Heifers were inoculated by an aerosol respiratory route and cows by an intramammary route. Clinical disease was mild in heifers, but infection was confirmed by virus detection, lesions and seroconversion. Clinical disease in lactating cows included decreased rumen motility, changes to milk appearance and production losses. Infection was confirmed by high levels of viral RNA detected in milk, virus isolation, lesions in mammary tissue and seroconversion. This study provides the foundation to investigate additional routes of infection, pathogenesis, transmission and intervention strategies. 
    more » « less