skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Improving the Spatial Resolution of Solar Images Using Generative Adversarial Network and Self-attention Mechanism*
Abstract In recent years, the new physics of the Sun has been revealed using advanced data with high spatial and temporal resolutions. The Helioseismic and Magnetic Imager (HMI) on board the Solar Dynamic Observatory has accumulated abundant observation data for the study of solar activity with sufficient cadence, but their spatial resolution (about 1″) is not enough to analyze the subarcsecond structure of the Sun. On the other hand, high-resolution observation from large-aperture ground-based telescopes, such as the 1.6 m Goode Solar Telescope (GST) at the Big Bear Solar Observatory, can achieve a much higher resolution on the order of 0.″1 (about 70 km). However, these high-resolution data only became available in the past 10 yr, with a limited time period during the day and with a very limited field of view. The Generative Adversarial Network (GAN) has greatly improved the perceptual quality of images in image translation tasks, and the self-attention mechanism can retrieve rich information from images. This paper uses HMI and GST images to construct a precisely aligned data set based on the scale-invariant feature transform algorithm and t0 reconstruct the HMI continuum images with four times better resolution. Neural networks based on the conditional GAN and self-attention mechanism are trained to restore the details of solar active regions and to predict the reconstruction error. The experimental results show that the reconstructed images are in good agreement with GST images, demonstrating the success of resolution improvement using machine learning.  more » « less
Award ID(s):
1954737 1927578 1821294
PAR ID:
10314063
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
The Astrophysical Journal
Volume:
923
Issue:
1
ISSN:
0004-637X
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; (, American Institute of Physics Conference Series)
    Solar Dynamics Observatory (SDO) spacecraft as a space-based project is able to conduct continuous monitoring of the Sun. The Helioseismic and Magnetic Imager (HMI) instrument on SDO, in particular, provides continuum images and magnetograms with a cadence of under 1 minute. SDO/HMI's spatial resolution is only about 1'', which makes it impossible to perform a good analysis on the subarcsecond scale. On the other hand, larger aperture ground-based telescopes such as the Goode Solar Telescope (GST) at the Big Bear Solar Observatory are able to achieve a better resolution (16 times better than SDO/HMI). However, ground-based telescopes like GST have limitations in terms of observation time, which can only make observations during the day in clearsky condition. The purpose of this study is to make attempts in improving the spatial resolution of images captured by HMI beyond the diffraction limit of the telescope by employing the Conditional Generative Adversarial Networks algorithm (cGAN). The cGAN model was trained using 1800 pairs of HMI and GST sunspot images. This method successfully reconstruct HMI images with a spatial resolution close to GST images, this is supported by \raisebox{-0.5ex}\textasciitilde62\% increase in the peak signal-to-noise ratio (PSNR) value and \raisebox{-0.5ex}\textasciitilde90\% decrease in the mean squared error (MSE) value. The higher resolution sunspot images produced by this model can be useful for further Solar Physics studies. 
    more » « less
  2. ; ; ; ; (, Astronomy & Astrophysics)
    Context.High-resolution magnetograms are crucial for studying solar flare dynamics because they enable the precise tracking of magnetic structures and rapid field changes. The Helioseismic and Magnetic Imager on board the Solar Dynamics Observatory (SDO/HMI) has been an essential provider of vector magnetograms. However, the spatial resolution of the HMI magnetograms is limited and hence is not able to capture the fine structures that are essential for understanding flare precursors. The Near InfraRed Imaging Spectropolarimeter on the 1.6 m Goode Solar Telescope (GST/NIRIS) at Big Bear Solar Observatory (BBSO) provides a better spatial resolution and is therefore more suitable to track the fine magnetic features and their connection to flare precursors. Aims.We propose DeepHMI, a machine-learning method for solar image super-resolution, to enhance the transverse and line-of-sight magnetograms of solar active regions (ARs) collected by SDO/HMI to better capture the fine-scale magnetic structures that are crucial for understanding solar flare dynamics. The enhanced HMI magnetograms can also be used to study spicules, sunspot light bridges and magnetic outbreaks, for which high-resolution data are essential. Methods.DeepHMI employs a conditional diffusion model that is trained using ground-truth images obtained by an inversion analysis of Stokes measurements collected by GST/NIRIS. Results.Our experiments show that DeepHMI performs better than the commonly used bicubic interpolation method in terms of four evaluation metrics. In addition, we demonstrate the ability of DeepHMI through a case study of the enhancement of SDO/HMI transverse and line-of-sight magnetograms of AR 12371 to GST/NIRIS data. 
    more » « less
  3. ; ; ; ; (, The Astrophysical Journal Supplement Series)
    Abstract The quality of solar images plays an important role in the analysis of small events in solar physics. Therefore, the improvement of image resolution based on super-resolution (SR) reconstruction technology has aroused the interest of many researchers. In this paper, an improved conditional denoising diffusion probability model (ICDDPM) based on the Markov chain is proposed for the SR reconstruction of solar images. This method reconstructs high-resolution (HR) images from low-resolution images by learning a reverse process that adds noise to HR images. To verify the effectiveness of the method, images from the Goode Solar Telescope at the Big Bear Solar Observatory and the Helioseismic and Magnetic Imager (HMI) on the Solar Dynamics Observatory are used to train a network, and the spatial resolution of reconstructed images is 4 times that of the original HMI images. The experimental results show that the performance based on ICDDPM is better than the previous work in subject judgment and object evaluation indexes. The reconstructed images of this method have higher subjective vision quality and better consistency with the HMI images. And the structural similarity and rms index results are also higher than the compared method, demonstrating the success of the resolution improvement using ICDDPM. 
    more » « less
  4. ; ; ; ; ; (, Research in Astronomy and Astrophysics)
    Abstract In this paper, we report the observed temporal correlation between extreme-ultraviolet (EUV) emission and magneto-acoustic oscillations in an EUV moss region, which is the footpoint region only connected by magnetic loops with million-degree plasma. The result is obtained from a detailed multi-wavelength data analysis of the region with the purpose of resolving fine-scale mass and energy flows that come from the photosphere, pass through the chromosphere and finally heat the solar transition region or the corona. The data set covers three atmospheric levels on the Sun, consisting of high-resolution broad-band imaging at TiO 7057 Å and the line of sight magnetograms for the photosphere, high-resolution narrow-band images at helium i 10830 Å for the chromosphere and EUV images at 171 Å for the corona. The 10830 Å narrow-band images and the TiO 7057 Å broad-band images are from a much earlier observation on 2012 July 22 with the 1.6 meter aperture Goode Solar Telescope (GST) at Big Bear Solar Observatory (BBSO) and the EUV 171 Å images and the magnetograms are from observations made by Atmospheric Imaging Assembly (AIA) or Helioseismic and Magnetic Imager (HMI) onboard the Solar Dynamics Observatory (SDO). We report the following new phenomena: (1) Repeated injections of chromospheric material appearing as 10830 Å absorption are squirted out from inter-granular lanes with a period of ∼ 5 minutes. (2) EUV emissions are found to be periodically modulated with similar periods of ∼ 5 minutes. (3) Around the injection area where 10830 Å absorption is enhanced, both EUV emissions and strength of the magnetic field are remarkably stronger. (4) The peaks on the time profile of the EUV emissions are found to be in sync with oscillatory peaks of the stronger magnetic field in the region. These findings may give a series of strong evidences supporting the scenario that coronal heating is powered by magneto-acoustic waves. 
    more » « less
  5. ; ; ; ; ; ; (, The Astrophysical Journal)
    Abstract Recent high-resolution solar observations have unveiled the presence of small-scale loop-like structures in the lower solar atmosphere, often referred to as unresolved fine structures, low-lying loops, and miniature hot loops. These structures undergo rapid changes within minutes, and their formation mechanism has remained elusive. In this study, we conducted a comprehensive analysis of two small loops utilizing data from the Interface Region Imaging Spectrograph (IRIS), the Goode Solar Telescope (GST) at Big Bear Solar Observatory, and the Atmospheric Imaging Assembly and the Helioseismic Magnetic Imager on board the Solar Dynamics Observatory, aiming to elucidate the underlying process behind their formation. The GST observations revealed that these loops, with lengths of ∼3.5 Mm and heights of ∼1 Mm, manifest as bright emission structures in Hαwing images, particularly prominent in the red wing. IRIS observations showcased these loops in 1330 Å slit-jaw images, with transition region (TR) and chromospheric line spectra exhibiting significant enhancement and broadening above the loops, indicative of plasmoid-mediated reconnection during their formation. Additionally, we observed upward-erupting jets above these loops across various passbands. Furthermore, differential emission measurement analysis reveals an enhanced emission measure at the location of these loops, suggesting the presence of plasma exceeding 1 MK. Based on our observations, we propose that these loops and associated jets align with the minifilament eruption model. Our findings suggest a unified mechanism governing the formation of small-scale loops and jets akin to larger-scale X-ray jets. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email