An official website of the United States government
This study utilises a deep convolutional neural network (CNN) implementing regularisation and batch normalisation for the removal of mixed, random, impulse, and Gaussian noise of various levels from digital images. This deep CNN achieves minimal loss of detail and yet yields an optimal estimation of structural metrics when dealing with both known and unknown noise mixtures. Moreover, a comprehensive comparison of denoising filters through the use of different structural metrics is provided to highlight the merits of the proposed approach. Optimal denoising results were obtained by using a 20‐layer network with 40 × 40 patches trained on 400 180 × 180 images from the Berkeley segmentation data set (BSD) and tested on the BSD100 data set and an additional 12 images of general interest to the research community. The comparative results provide credence to the merits of the proposed filter and the comprehensive assessment of results highlights the novelty and performance of this CNN‐based approach.
more »
« less
High Impulse Noise Intensity Removal in Natural Images Using Convolutional Neural Network
This paper introduces a new image smoothing filter based on a feed-forward convolutional neural network (CNN) in presence of impulse noise. This smoothing filter integrates a very deep architecture, a regularization method, and a batch normalization process. This fully integrated approach yields an effectively denoised and smoothed image yielding a high similarity measure with the original noise free image. Specific structural metrics are used to assess the denoising process and how effective was the removal of the impulse noise. This CNN model can also deal with other noise levels not seen during the training phase. The proposed CNN model is constructed through a 20-layer network using 400 images from the Berkeley Segmentation Dataset (BSD) in the training phase. Results are obtained using the standard testing set of 8 natural images not seen in the training phase. The merits of this proposed method are weighed in terms of high similarity measure and structural metrics that conform to the original image and compare favorably to the different results obtained using state-of-art denoising filters.
more »
« less
- PAR ID:
- 10185414
- Date Published:
- Journal Name:
- IEEE 10th Annual Computing and Communication Workshop and Conference (CCWC)
- Page Range / eLocation ID:
- 0673 to 0677
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Yap, Pew-Thian (Ed.)Diffusion weighted imaging (DWI) with multiple, high b-values is critical for extracting tissue microstructure measurements; however, high b-value DWI images contain high noise levels that can overwhelm the signal of interest and bias microstructural measurements. Here, we propose a simple denoising method that can be applied to any dataset, provided a low-noise, single-subject dataset is acquired using the same DWI sequence. The denoising method uses a one-dimensional convolutional neural network (1D-CNN) and deep learning to learn from a low-noise dataset, voxel-by-voxel. The trained model can then be applied to high-noise datasets from other subjects. We validated the 1D-CNN denoising method by first demonstrating that 1D-CNN denoising resulted in DWI images that were more similar to the noise-free ground truth than comparable denoising methods, e.g., MP-PCA, using simulated DWI data. Using the same DWI acquisition but reconstructed with two common reconstruction methods, i.e. SENSE1 and sum-of-square, to generate a pair of low-noise and high-noise datasets, we then demonstrated that 1D-CNN denoising of high-noise DWI data collected from human subjects showed promising results in three domains: DWI images, diffusion metrics, and tractography. In particular, the denoised images were very similar to a low-noise reference image of that subject, more than the similarity between repeated low-noise images (i.e. computational reproducibility). Finally, we demonstrated the use of the 1D-CNN method in two practical examples to reduce noise from parallel imaging and simultaneous multi-slice acquisition. We conclude that the 1D-CNN denoising method is a simple, effective denoising method for DWI images that overcomes some of the limitations of current state-of-the-art denoising methods, such as the need for a large number of training subjects and the need to account for the rectified noise floor.more » « less
-
Data fusion techniques have gained special interest in remote sensing due to the available capabilities to obtain measurements from the same scene using different instruments with varied resolution domains. In particular, multispectral (MS) and hyperspectral (HS) imaging fusion is used to generate high spatial and spectral images (HSEI). Deep learning data fusion models based on Long Short Term Memory (LSTM) and Convolutional Neural Networks (CNN) have been developed to achieve such task.In this work, we present a Multi-Level Propagation Learning Network (MLPLN) based on a LSTM model but that can be trained with variable data sizes in order achieve the fusion process. Moreover, the MLPLN provides an intrinsic data augmentation feature that reduces the required number of training samples. The proposed model generates a HSEI by fusing a high-spatial resolution MS image and a low spatial resolution HS image. The performance of the model is studied and compared to existing CNN and LSTM approaches by evaluating the quality of the fused image using the structural similarity metric (SSIM). The results show that an increase in the SSIM is still obtained while reducing of the number of training samples to train the MLPLN model.more » « less
-
Abstract The quality of solar images plays an important role in the analysis of small events in solar physics. Therefore, the improvement of image resolution based on super-resolution (SR) reconstruction technology has aroused the interest of many researchers. In this paper, an improved conditional denoising diffusion probability model (ICDDPM) based on the Markov chain is proposed for the SR reconstruction of solar images. This method reconstructs high-resolution (HR) images from low-resolution images by learning a reverse process that adds noise to HR images. To verify the effectiveness of the method, images from the Goode Solar Telescope at the Big Bear Solar Observatory and the Helioseismic and Magnetic Imager (HMI) on the Solar Dynamics Observatory are used to train a network, and the spatial resolution of reconstructed images is 4 times that of the original HMI images. The experimental results show that the performance based on ICDDPM is better than the previous work in subject judgment and object evaluation indexes. The reconstructed images of this method have higher subjective vision quality and better consistency with the HMI images. And the structural similarity and rms index results are also higher than the compared method, demonstrating the success of the resolution improvement using ICDDPM.more » « less
-
Deep convolutional neural networks (CNNs) for image denoising are typically trained on large datasets. These models achieve the current state of the art, but they do not generalize well to data that deviate from the training distribution. Recent work has shown that it is possible to train denoisers on a single noisy image. These models adapt to the features of the test image, but their performance is limited by the small amount of information used to train them. Here we propose "GainTuning'', a methodology by which CNN models pre-trained on large datasets can be adaptively and selectively adjusted for individual test images. To avoid overfitting, GainTuning optimizes a single multiplicative scaling parameter (the “Gain”) of each channel in the convolutional layers of the CNN. We show that GainTuning improves state-of-the-art CNNs on standard image-denoising benchmarks, boosting their denoising performance on nearly every image in a held-out test set. These adaptive improvements are even more substantial for test images differing systematically from the training data, either in noise level or image type. We illustrate the potential of adaptive GainTuning in a scientific application to transmission-electron-microscope images, using a CNN that is pre-trained on synthetic data. In contrast to the existing methodology, GainTuning is able to faithfully reconstruct the structure of catalytic nanoparticles from these data at extremely low signal-to-noise ratios.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1109/CCWC47524.2020.9031200
