An official website of the United States government
In recent times, AI and deep learning have witnessed explosive growth in almost every subject involving data. Complex data analyses problems that took prolonged periods, or required laborious manual effort, are now being tackled through AI and deep-learning techniques with unprecedented accuracy. Machine learning (ML) using Convolutional Neural Networks (CNNs) has shown great promise for such applications. However, traditional CPU-based sequential computing no longer can meet the requirements of mission-critical applications which are compute-intensive and require low latency. Heterogeneous computing (HGC), with CPUs integrated with accelerators such as GPUs and FPGAs, offers unique capabilities to accelerate CNNs. In this presentation, we will focus on using FPGA-based reconfigurable computing to accelerate various aspects of CNN. We will begin with the current state of the art in using FPGAs for CNN acceleration, followed by the related R&D activities (outlined below) in the SHREC* Center at the University of Florida, based on which we will discuss the opportunities in heterogeneous computing for machine learning.
more »
« less
Applications of artificial intelligence technologies in water environments: From basic techniques to novel tiny machine learning systems
Artificial intelligence (AI) and machine learning (ML) are novel techniques to detect hidden patterns in environmental data. Despite their capabilities, these novel technologies have not been seriously used for real-world problems, such as real-time environmental monitoring. This survey established a framework to advance the novel applications of AI and ML techniques such as Tiny Machine Learning (TinyML) in water environments. The survey covered deep learning models and their advantages over classical ML models. The deep learning algorithms are the heart of TinyML models and are of paramount importance for practical uses in water environments. This survey highlighted the capabilities and discussed the possible applications of the TinyML models in water environments. This study indicated that the TinyML models on microcontrollers are useful for a number of cutting-edge problems in water environments, especially for monitoring purposes. The TinyML models on microcontrollers allow for in situ real-time environmental monitoring without transferring data to the cloud. It is concluded that monitoring systems based on TinyML models offer cheap tools to autonomously track pollutants in water and can replace traditional monitoring methods.
more »
« less
- Award ID(s):
- 2300369
- PAR ID:
- 10512347
- Editor(s):
- Chen, Guohua; Khan, Faisal
- Publisher / Repository:
- Elservier
- Date Published:
- Journal Name:
- Process Safety and Environmental Protection
- Volume:
- 180
- ISSN:
- 0957-5820
- Page Range / eLocation ID:
- 10 to 22
- Subject(s) / Keyword(s):
- Artificial intelligence Deep learning TinyML Microcontrollers Monitoring
- Format(s):
- Medium: X Size: 1MB Other: pdf
- Size(s):
- 1MB
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Advances in computing and machine learning (ML) methods have led to a rapid rise in artificial intelligence (AI) research and applications in many fields. AI research benefitted from advances in computation hardware, collection and distribution of large data sets, and proliferation of software techniques. AI techniques include ML for provable results, deep learning for data exploration, reinforcement learning for control, and active learning for adaptive systems. Likewise, AI algorithms can handle large amounts of data, construct unknown representations, and provide a direct link between data and classification for decision making. These unmatched capabilities have been seen as a path to solving hard engineering problems, including that of structural health monitoring (SHM). SHM consists of automating the condition assessment task of civil, health, mechanical, and aerospace systems using measurements obtained from temporary or permanently installed sensors. Often, the systems of interest are geometrically large and/or technically complex, which complicates the development and application of physics-based methods. It follows that AI is seen as a key potential contributor enabling SHM in field applications for data-driven analysis. As with many research endeavors, many concepts using AI for SHM have been explored in the literature. Nevertheless, very few AI methods have been deployed in the context of SHM, which may be due to the lack of available data supporting their capabilities, limited integrated AI-SHM systems capable of providing results to users and operators with decision-making capabilities, or certification of AI methods for safety-critical applications. The objective of this Roadmap publication is to discuss the integration of AI at the system level enabling SHM, including associated challenges and opportunities such as those found in common metrics of concern (e.g. transparency, interpretability, explainability, security, certifiability, etc), with a particular focus on providing a path to research and development efforts that could yield impactful field applications. The overview of available methods and directions will provide the readers with applicability of AI for certain SHM designs (software), availability of common data sets for further AI comparisons (data), and lessons learned in implementation (hardware).more » « less
-
The accurate and timely diagnosis of neurodegenerative disorders such as Parkinson’s disease, Alzheimer’s disease, and major depressive disorder critically depends on real-time monitoring and precise interpretation of authentic neurotransmitter (NT) signal dynamics in complex biological fluids (CBFs), including cerebrospinal fluid. These NT dynamics are governed by both the type and concentration of NTs present in the CBFs. However, current biosensors face significant limitations in sensitivity and selectivity, thereby hindering reliable estimation (detection and quantification) of NTs. Though nanomaterials and bioenzymes have been utilized to modify sensor interfaces for enhanced performance, issues like signal convolution, electrode fouling, and inter-NT crosstalk persist. Objectives: This review aims to evaluate and synthesize current research on the use of artificial intelligence (AI), particularly machine learning (ML), pattern recognition (PR), and deep learning (DL), to improve the automated detection and quantification of neurotransmitters from complex biological fluids. Design: A systematic review of 33 peer-reviewed studies was conducted, focusing on the integration of AI methods in neurotransmitter estimation. The review includes an analysis of commonly studied NTs, the methodologies for their detection, data acquisition techniques, and the AI algorithms applied for signal processing and interpretation. Results: The studies reviewed demonstrate that AI-based approaches have shown considerable potential in overcoming traditional biosensor limitations by effectively deconvoluting complex, multiplexed NT signals. These techniques allow for more accurate NT estimation in real-time monitoring scenarios. The review categorizes AI methodologies by their application and performance in NT signal analysis. Conclusions: AI-enhanced NT monitoring represents a promising direction for advancing diagnostic and therapeutic capabilities in neurodegenerative diseases. Despite current challenges, such as sensor stability and NT interaction complexity, AI integration, particularly in applications like closed-loop deep brain stimulation (CLDBS), offers significant potential for more effective and personalized treatments.more » « less
-
Abstract Prediction of dynamic environmental variables in unmonitored sites remains a long-standing challenge for water resources science. The majority of the world’s freshwater resources have inadequate monitoring of critical environmental variables needed for management. Yet, the need to have widespread predictions of hydrological variables such as river flow and water quality has become increasingly urgent due to climate and land use change over the past decades, and their associated impacts on water resources. Modern machine learning methods increasingly outperform their process-based and empirical model counterparts for hydrologic time series prediction with their ability to extract information from large, diverse data sets. We review relevant state-of-the art applications of machine learning for streamflow, water quality, and other water resources prediction and discuss opportunities to improve the use of machine learning with emerging methods for incorporating watershed characteristics and process knowledge into classical, deep learning, and transfer learning methodologies. The analysis here suggests most prior efforts have been focused on deep learning frameworks built on many sites for predictions at daily time scales in the United States, but that comparisons between different classes of machine learning methods are few and inadequate. We identify several open questions for time series predictions in unmonitored sites that include incorporating dynamic inputs and site characteristics, mechanistic understanding and spatial context, and explainable AI techniques in modern machine learning frameworks.more » « less
-
Decision-focused learning (DFL) is an emerging paradigm that integrates machine learning (ML) and constrained optimization to enhance decision quality by training ML models in an end-to-end system. This approach shows significant potential to revolutionize combinatorial decision-making in real-world applications that operate under uncertainty, where estimating unknown parameters within decision models is a major challenge. This paper presents a comprehensive review of DFL, providing an in-depth analysis of both gradient-based and gradient-free techniques used to combine ML and constrained optimization. It evaluates the strengths and limitations of these techniques and includes an extensive empirical evaluation of eleven methods across seven problems. The survey also offers insights into recent advancements and future research directions in DFL.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript
- Journal Article:
- https://doi.org/10.1016/j.psep.2023.09.072
