An official website of the United States government
Roll-to-roll printing has significantly shortened the time from design to production of sensors and IoT devices, while being cost-effective for mass production. But due to less manufacturing tolerance controls available, properties such as sensor thickness, composition, roughness, etc., cannot be precisely controlled. Since these properties likely affect the sensor behavior, roll-to-roll printed sensors require validation testing before they can be deployed in the field. In this work, we improve the testing of Nitrate sensors that need to be calibrated in a solution of known Nitrate concentration for around 1–2 days. To accelerate this process, we observe the initial behavior of the sensors for a few hours, and use a physics-informed machine learning method to predict their measurements 24 hours in the future, thus saving valuable time and testing resources. Due to the variability in roll-to-roll printing, this prediction task requires models that are robust to changes in properties of the new test sensors. We show that existing methods fail at this task and describe a physics-informed machine learning method that improves the prediction robustness to different testing conditions (≈ 1.7× lower in real-world data and ≈ 5× lower in synthetic data when compared with the current state-of-the-art physics-informed machine learning method).
more »
« less
Thin-Film Nitrate Sensor Performance Prediction Based on Image Analysis and Credibility Data to Enable a Certify As Built Framework
Abstract In the modern industrial setting, there is an increasing demand for all types of sensors. The demand for both the quantity and quality of sensors is increasing annually. Our research focuses on thin-film nitrate sensors in particular, and it seeks to provide a robust method to monitor the quality of the sensors while reducing the cost of production. We are researching an image-based machine learning method to allow for real-time quality assessment of every sensor in the manufacturing pipeline. It opens up the possibility of real-time production parameter adjustments to enhance sensor performance. This technology has the potential to significantly reduce the cost of quality control and improve sensor quality at the same time. Previous research has proven that the texture of the topical layer (ion-selective membrane (ISM) layer) of the sensor directly correlates with the performance of the sensor. Our method seeks to use the correlation so established to train a learning-based system to predict the performance of any given sensor from a still photo of the sensor active region, i.e. the ISM. This will allow for the real-time assessment of every sensor instead of sample testing. Random sample testing is both costly in time and labor, and therefore, it does not account for all of the individual sensors. Sensor measurement is a crucial portion of the data collection process. To measure the performance of the sensors, the sensors are taken to a specialized lab to be measured for performance. During the measurement process, noise and error are unavoidable; therefore, we generated credibility data based on the performance data to show the reliability of each sensor performance signal at each sample time. In this paper, we propose a machine learning based method to predict sensor performance using image features extracted from the non-contact sensor images guided by the credibility data. This will eliminate the need to test every sensor as it is manufactured, which is not practical in a high-speed roll-to-roll setting, thus truely enabling a certify as built framework.
more »
« less
- Award ID(s):
- 2134667
- PAR ID:
- 10431437
- Date Published:
- Journal Name:
- ASME 2022 17th International Manufacturing Science and Engineering Conference
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract In droplet-on-demand liquid metal jetting (DoD-LMJ) additive manufacturing, complex physical interactions govern the droplet characteristics, such as size, velocity, and shape. These droplet characteristics, in turn, determine the functional quality of the printed parts. Hence, to ensure repeatable and reliable part quality it is necessary to monitor and control the droplet characteristics. Existing approaches for in-situ monitoring of droplet behavior in DoD-LMJ rely on high-speed imaging sensors. The resulting high volume of droplet images acquired is computationally demanding to analyze and hinders real-time control of the process. To overcome this challenge, the objective of this work is to use time series data acquired from an in-process millimeter-wave sensor for predicting the size, velocity, and shape characteristics of droplets in DoD-LMJ process. As opposed to high-speed imaging, this sensor produces data-efficient time series signatures that allows rapid, real-time process monitoring. We devise machine learning models that use the millimeter-wave sensor data to predict the droplet characteristics. Specifically, we developed multilayer perceptron-based non-linear autoregressive models to predict the size and velocity of droplets. Likewise, a supervised machine learning model was trained to classify the droplet shape using the frequency spectrum information contained in the millimeter-wave sensor signatures. High-speed imaging data served as ground truth for model training and validation. These models captured the droplet characteristics with a statistical fidelity exceeding 90%, and vastly outperformed conventional statistical modeling approaches. Thus, this work achieves a practically viable sensing approach for real-time quality monitoring of the DoD-LMJ process, in lieu of the existing data-intensive image-based techniques.more » « less
-
Real-time fall detection using a wearable sensor remains a challenging problem due to high gait variability. Furthermore, finding the type of sensor to use and the optimal location of the sensors are also essential factors for real-time fall-detection systems. This work presents real-time fall-detection methods using deep learning models. Early detection of falls, followed by pneumatic protection, is one of the most effective means of ensuring the safety of the elderly. First, we developed and compared different data-segmentation techniques for sliding windows. Next, we implemented various techniques to balance the datasets because collecting fall datasets in the real-time setting has an imbalanced nature. Moreover, we designed a deep learning model that combines a convolution-based feature extractor and deep neural network blocks, the LSTM block, and the transformer encoder block, followed by a position-wise feedforward layer. We found that combining the input sequence with the convolution-learned features of different kernels tends to increase the performance of the fall-detection model. Last, we analyzed that the sensor signals collected by both accelerometer and gyroscope sensors can be leveraged to develop an effective classifier that can accurately detect falls, especially differentiating falls from near-falls. Furthermore, we also used data from sixteen different body parts and compared them to determine the better sensor position for fall-detection methods. We found that the shank is the optimal position for placing our sensors, with an F1 score of 0.97, and this could help other researchers collect high-quality fall datasets.more » « less
-
This work reports a first-of-its-kind hybrid wearable physicochemical sensor suite that we call PlantFit for simultaneous measurement of two key phytohormones, salicylic acid, and ethylene, along with vapor pressure deficit and radial growth of stem in live plants. The sensors are developed using a low-cost and roll-to-roll screen printing technology. A single integrated flexible patch that contains temperature, humidity, salicylic acid, and ethylene sensors, is installed on the leaves of live plants. The strain sensor with in-built pressure correction capability is wrapped around the plant stem to provide pressure-compensated stem diameter measurements. The sensors provide real-time information on plant health under different amounts of water stress conditions. The sensor suite is installed on bell pepper plants for 40 days and measurements of salicylic acid, ethylene, temperature, humidity, and stem diameter are recorded daily. In addition, sensors are installed on different parts of the same plant to investigate the spatiotemporal dynamics of water transport and phytohormone responses. Subsequent correlation and principal component analyses demonstrate the strong association between hormone levels, vapor pressure deficit, and water transport in the plant. Our findings suggest that the mass deployment of PlantFit in agricultural settings will aid growers in detecting water stress/deficiency early and in implementing early intervention measures to reduce stress-induced yield decline.more » « less
-
Vision processing on traditional architectures is inefficient due to energy-expensive off-chip data movement. Many researchers advocate pushing processing close to the sensor to substantially reduce data movement. However, continuous near-sensor processing raises sensor temperature, impairing imaging/vision fidelity. We characterize the thermal implications of using 3D stacked image sensors with near-sensor vision processing units. Our characterization reveals that near-sensor processing reduces system power but degrades image quality. For reasonable image fidelity, the sensor temperature needs to stay below a threshold, situationally determined by application needs. Fortunately, our characterization also identifies opportunities—unique to the needs of near-sensor processing—to regulate temperature based on dynamic visual task requirements and rapidly increase capture quality on demand. Based on our characterization, we propose and investigate two thermal management strategies—stop-capture-go and seasonal migration—for imaging-aware thermal management. For our evaluated tasks, our policies save up to 53% of system power with negligible performance impact and sustained image fidelity.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1115/MSEC2022-85638
