skip to main content


Title: Data-Driven Modeling of Smartphone-Based Electrochemiluminescence Sensor Data Using Artificial Intelligence
Understanding relationships among multimodal data extracted from a smartphone-based electrochemiluminescence (ECL) sensor is crucial for the development of low-cost point-of-care diagnostic devices. In this work, artificial intelligence (AI) algorithms such as random forest (RF) and feedforward neural network (FNN) are used to quantitatively investigate the relationships between the concentration of   Ru ( bpy ) 3 2 + luminophore and its experimentally measured ECL and electrochemical data. A smartphone-based ECL sensor with   Ru ( bpy ) 3 2 + /TPrA was developed using disposable screen-printed carbon electrodes. ECL images and amperograms were simultaneously obtained following 1.2-V voltage application. These multimodal data were analyzed by RF and FNN algorithms, which allowed the prediction of   Ru ( bpy ) 3 2 + concentration using multiple key features. High correlation (0.99 and 0.96 for RF and FNN, respectively) between actual and predicted values was achieved in the detection range between 0.02 µM and 2.5 µM. The AI approaches using RF and FNN were capable of directly inferring the concentration of   Ru ( bpy ) 3 2 + using easily observable key features. The results demonstrate that data-driven AI algorithms are effective in analyzing the multimodal ECL sensor data. Therefore, these AI algorithms can be an essential part of the modeling arsenal with successful application in ECL sensor data modeling.  more » « less
Award ID(s):
1706597
NSF-PAR ID:
10167174
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
Sensors
Volume:
20
Issue:
3
ISSN:
1424-8220
Page Range / eLocation ID:
625
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Machine learning (ML) can be an appropriate approach to overcoming common problems associated with sensors for low-cost, point-of-care diagnostics, such as non-linearity, multidimensionality, sensor-to-sensor variations, presence of anomalies, and ambiguity in key features. This study proposes a novel approach based on ML algorithms (neural nets, Gaussian Process Regression, among others) to model the electrochemiluminescence (ECL) quenching mechanism of the [Ru(bpy)3]2+/TPrA system by phenolic compounds, thus allowing their detection and quantification. The relationships between the concentration of phenolic compounds and their effect on the ECL intensity and current data measured using a mobile phone-based ECL sensor is investigated. The ML regression tasks with a tri-layer neural net using minimally processed time series data showed better or comparable detection performance compared to the performance using extracted key features without extra preprocessing. Combined multimodal characteristics produced an 80% more enhanced performance with multilayer neural net algorithms than a single feature based-regression analysis. The results demonstrated that the ML could provide a robust analysis framework for sensor data with noises and variability. It demonstrates that ML strategies can play a crucial role in chemical or biosensor data analysis, providing a robust model by maximizing all the obtained information and integrating nonlinearity and sensor-to-sensor variations. 
    more » « less
  2. Abstract. An ability to accurately detect convective regions isessential for initializing models for short-term precipitation forecasts.Radar data are commonly used to detect convection, but radars that providehigh-temporal-resolution data are mostly available over land, and the qualityof the data tends to degrade over mountainous regions. On the other hand,geostationary satellite data are available nearly anywhere and in near-realtime. Current operational geostationary satellites, the GeostationaryOperational Environmental Satellite-16 (GOES-16) and Satellite-17, provide high-spatial- and high-temporal-resolution data but only of cloud top properties; 1 min data, however, allow us to observe convection from visible andinfrared data even without vertical information of the convective system.Existing detection algorithms using visible and infrared data look forstatic features of convective clouds such as overshooting top or lumpy cloudtop surface or cloud growth that occurs over periods of 30 min to anhour. This study represents a proof of concept that artificial intelligence(AI) is able, when given high-spatial- and high-temporal-resolution data fromGOES-16, to learn physical properties of convective clouds and automate thedetection process. A neural network model with convolutional layers is proposed to identifyconvection from the high-temporal resolution GOES-16 data. The model takesfive temporal images from channel 2 (0.65 µm) and 14 (11.2 µm) asinputs and produces a map of convective regions. In order to provideproducts comparable to the radar products, it is trained against Multi-RadarMulti-Sensor (MRMS), which is a radar-based product that uses a rathersophisticated method to classify precipitation types. Two channels fromGOES-16, each related to cloud optical depth (channel 2) and cloud topheight (channel 14), are expected to best represent features of convectiveclouds: high reflectance, lumpy cloud top surface, and low cloud toptemperature. The model has correctly learned those features of convectiveclouds and resulted in a reasonably low false alarm ratio (FAR) and highprobability of detection (POD). However, FAR and POD can vary depending onthe threshold, and a proper threshold needs to be chosen based on thepurpose. 
    more » « less
  3. Trackers for activity and physical fitness have become ubiquitous. Although recent work has demonstrated significant relationships between mental effort and physiological data such as skin temperature, heart rate, and electrodermal activity, we have yet to demonstrate their efficacy for the forecasting of mental effort such that a useful mental effort tracker can be developed. Given prior difficulty in extracting relationships between mental effort and physiological responses that are repeatable across individuals, we make the case that fusing self-report measures with physiological data within an internet or smartphone application may provide an effective method for training a useful mental effort tracking system. In this case study, we utilized over 90 h of data from a single participant over the course of a college semester. By fusing the participant’s self-reported mental effort in different activities over the course of the semester with concurrent physiological data collected with the Empatica E4 wearable sensor, we explored questions around how much data were needed to train such a device, and which types of machine-learning algorithms worked best. We concluded that although baseline models such as logistic regression and Markov models provided useful explanatory information on how the student’s physiology changed with mental effort, deep-learning algorithms were able to generate accurate predictions using the first 28 h of data for training. A system that combines long short-term memory and convolutional neural networks is recommended in order to generate smooth predictions while also being able to capture transitions in mental effort when they occur in the individual using the device. 
    more » « less
  4. The Glimpse.3D is a body-worn camera that captures, processes, stores, and transmits 3D visual information of a real-world environment using a low cost camera-based sensor system that is constrained by its limited processing capability, storage, and battery life. The 3D content is viewed on a mobile device such as a smartphone or a virtual reality headset. This system can be used in applications such as capturing and sharing 3D content in the social media, training people in different professions, and post-facto analysis of an event. Glimpse.3D uses off-the-shelf hardware and standard computer vision algorithms. Its novelty lies in the ability to optimally control camera data acquisition and processing stages to guarantee the desired quality of captured information and battery life. The design of the controller is based on extensive measurements and modeling of the relationships between the linear and angular motion of a body-worn camera and the quality of generated 3D point clouds as well as the battery life of the system. To achieve this, we 1) devise a new metric to quantify the quality of generated 3D point clouds, 2) formulate an optimization problem to find an optimal trigger point for the camera system that prolongs its battery life while maximizing the quality of captured 3D environment, and 3) make the model adaptive so that the system evolves and its performance improves over time. 
    more » « less
  5. Neurotoxic heavy metals, such as Cd2+, pose a significant global health concern due to their increased environmental contamination and subsequent detrimental health hazards they pose to human beings. These metal ions can breach the blood-brain barrierblood–brain barrier, leading to severe and often irreversible damage to the central nervous system and other vital organs. Therefore, developing a highly sensitive, robust, and rapid in vivo detection method for these hazardous heavy metal ions is of the utmost importance for early detection, thus initiating timely therapeutics. Detecting ultra-low levels of toxic metal ions in vivo and obtaining accurate speciation information remains a challenge with conventional analytical techniques. In this study, we fabricated a novel carbon carbon-fiber microelectrode (CFM)-based sensor that can detect Cd2+ ions using fast-scan cyclic voltammetry by electrodepositing gold nanoparticles (AuNP). We optimized electrochemical parameters that generate a unique cyclic voltammogram (CV) of Cd2+ at a temporal resolution of 100 ms with our novel sensor. All our experiments were performed in tris buffer that mimics the artificial cerebellum fluid. We established a calibration curve resulting in a limit of detection (LOD) of 0.01 µM with a corresponding sensitivity of 418.02 nA/ µM. The sensor’s selectivity was evaluated in the presence of other metal ions, and it was noteworthy to observe that the sensor retained its ability to produce the distinctive Cd2+ CV, even when the concentration of other metal ions was 200 times higher than that of Cd2+. We also found that our sensor could detect free Cd2+ ions in the presence of complexing agents. Furthermore, we analyzed the solution chemistry of each of those Cd2+–ligand solutions using a geochemical model, PHREEQC. The concentrations of free Cd2+ ions determined through our electrochemical data align well with geochemical modeling data, thus validating the response of our novel sensor. Furthermore, we reassessed our sensor’s LOD in tris buffer based on the concentration of free Cd2+ ions determined through PHREEQC analysis, revealing an LOD of 0.00132 µM. We also demonstrated the capability of our sensor to detect Cd2+ ions in artificial urine samples, showcasing its potential for application in actual biological samples. To the best of our knowledge, this is the first AuNP-modified, CFM-based Cd2+ sensor capable of detecting ultra-low concentrations of free Cd2+ ions in different complex matrices, including artificial urine at a temporal resolution of 100 ms, making it an excellent analytical tool for future real-time, in vivo detection, particularly in the brain.

     
    more » « less