skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Improving spatial resolution of sunspot HMI images using conditional generative adversarial networks
Solar Dynamics Observatory (SDO) spacecraft as a space-based project is able to conduct continuous monitoring of the Sun. The Helioseismic and Magnetic Imager (HMI) instrument on SDO, in particular, provides continuum images and magnetograms with a cadence of under 1 minute. SDO/HMI's spatial resolution is only about 1'', which makes it impossible to perform a good analysis on the subarcsecond scale. On the other hand, larger aperture ground-based telescopes such as the Goode Solar Telescope (GST) at the Big Bear Solar Observatory are able to achieve a better resolution (16 times better than SDO/HMI). However, ground-based telescopes like GST have limitations in terms of observation time, which can only make observations during the day in clearsky condition. The purpose of this study is to make attempts in improving the spatial resolution of images captured by HMI beyond the diffraction limit of the telescope by employing the Conditional Generative Adversarial Networks algorithm (cGAN). The cGAN model was trained using 1800 pairs of HMI and GST sunspot images. This method successfully reconstruct HMI images with a spatial resolution close to GST images, this is supported by \raisebox{-0.5ex}\textasciitilde62\% increase in the peak signal-to-noise ratio (PSNR) value and \raisebox{-0.5ex}\textasciitilde90\% decrease in the mean squared error (MSE) value. The higher resolution sunspot images produced by this model can be useful for further Solar Physics studies.  more » « less
Award ID(s):
2300341
PAR ID:
10496132
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
American Institute of Physics Conference Series
Date Published:
Journal Name:
American Institute of Physics Conference Series
Page Range / eLocation ID:
040009
Format(s):
Medium: X
Location:
Ranchi, India
Sponsoring Org:
National Science Foundation
More Like this
  1. Context.High-resolution magnetograms are crucial for studying solar flare dynamics because they enable the precise tracking of magnetic structures and rapid field changes. The Helioseismic and Magnetic Imager on board the Solar Dynamics Observatory (SDO/HMI) has been an essential provider of vector magnetograms. However, the spatial resolution of the HMI magnetograms is limited and hence is not able to capture the fine structures that are essential for understanding flare precursors. The Near InfraRed Imaging Spectropolarimeter on the 1.6 m Goode Solar Telescope (GST/NIRIS) at Big Bear Solar Observatory (BBSO) provides a better spatial resolution and is therefore more suitable to track the fine magnetic features and their connection to flare precursors. Aims.We propose DeepHMI, a machine-learning method for solar image super-resolution, to enhance the transverse and line-of-sight magnetograms of solar active regions (ARs) collected by SDO/HMI to better capture the fine-scale magnetic structures that are crucial for understanding solar flare dynamics. The enhanced HMI magnetograms can also be used to study spicules, sunspot light bridges and magnetic outbreaks, for which high-resolution data are essential. Methods.DeepHMI employs a conditional diffusion model that is trained using ground-truth images obtained by an inversion analysis of Stokes measurements collected by GST/NIRIS. Results.Our experiments show that DeepHMI performs better than the commonly used bicubic interpolation method in terms of four evaluation metrics. In addition, we demonstrate the ability of DeepHMI through a case study of the enhancement of SDO/HMI transverse and line-of-sight magnetograms of AR 12371 to GST/NIRIS data. 
    more » « less
  2. Abstract In recent years, the new physics of the Sun has been revealed using advanced data with high spatial and temporal resolutions. The Helioseismic and Magnetic Imager (HMI) on board the Solar Dynamic Observatory has accumulated abundant observation data for the study of solar activity with sufficient cadence, but their spatial resolution (about 1″) is not enough to analyze the subarcsecond structure of the Sun. On the other hand, high-resolution observation from large-aperture ground-based telescopes, such as the 1.6 m Goode Solar Telescope (GST) at the Big Bear Solar Observatory, can achieve a much higher resolution on the order of 0.″1 (about 70 km). However, these high-resolution data only became available in the past 10 yr, with a limited time period during the day and with a very limited field of view. The Generative Adversarial Network (GAN) has greatly improved the perceptual quality of images in image translation tasks, and the self-attention mechanism can retrieve rich information from images. This paper uses HMI and GST images to construct a precisely aligned data set based on the scale-invariant feature transform algorithm and t0 reconstruct the HMI continuum images with four times better resolution. Neural networks based on the conditional GAN and self-attention mechanism are trained to restore the details of solar active regions and to predict the reconstruction error. The experimental results show that the reconstructed images are in good agreement with GST images, demonstrating the success of resolution improvement using machine learning. 
    more » « less
  3. Abstract Multiple solar instrument observation campaigns are increasingly popular among the solar physics and space science communities. Scientists organize high-resolution ground-based telescopes and spacecraft to study the evolution of the complex solar atmosphere and the origin of space weather. Image registration and coalignment between different instruments are vital for accurate data product comparison. We developed a Python language package for registration of ground-based high-resolution imaging data acquired by the Goode Solar Telescope (GST) to space-based full-disk continuum intensity data provided by the Solar Dynamics Observatory (SDO) with the scale-invariant feature transform method. The package also includes tools to align data sets obtained in different wavelengths and at different times utilizing the optical flow method. We present the image registration and coalignment workflow. The aliment accuracy of each alignment method is tested with the aid of radiative magnetohydrodynamics simulation data. We update the pointing information in GST data fits headers and generate GST and SDO imaging data products as science-ready four-dimensional (x,y,λ,t) data cubes. 
    more » « less
  4. Context.The interaction between magnetic fields and convection in sunspots during their decay process remains poorly understood, whereas the formation of sunspots is relatively well studied and fully modeled. Works on the velocity scales at the solar surface have pointed to the existence of the family of granules, whose interaction with the magnetic field leads to the formation of supergranules and their networks, which are visible at the solar surface. Aims.The aim of this paper is to consider relationship between the decay of sunspots and convection via the motion of the family of granules and how the diffusion mechanism of magnetic field operates in a decaying sunspot. Methods.We report the decay of a sunspot observed by the 1.6 m Goode Solar Telescope (GST) with the TiO Broadband Filter Imager (BFI) and the Near-InfraRed Imaging Spectropolarimeter (NIRIS). The analysis was aided by the Helioseismic and Magnetic Imager (HMI) on board the Solar Dynamic Observatory (SDO). In the first step, we followed the decay of the sunspot with HMI data over three days by constructing its evolving area and total magnetic flux. In the second step, the high spatial and temporal resolution of the GST instruments allowed us to analyze the causes of the decay of the sunspot. Afterward, we followed the emergence of granules in the moat region around the sunspot over six hours. The evolution of the trees of fragmenting granules (TFGs) was derived based on their relationship with the horizontal surface flows. Results.We find that the area and total magnetic flux display an exponential decrease over the course of the sunspot decay. We identified 22 moving magnetic features (MMFs) in the moats of pores, which is a signature of sunspot decay through diffusion. We note that the MMFs were constrained to follow the borders of TFGs during their journey away from the sunspot. Conclusions.The TFGs and their development contribute to the diffusion of the magnetic field outside the sunspot. The conclusion of our analysis shows the important role of the TFGs in sunspot decay. Finally, the family of granules evacuates the magnetic field. 
    more » « less
  5. Abstract The quality of solar images plays an important role in the analysis of small events in solar physics. Therefore, the improvement of image resolution based on super-resolution (SR) reconstruction technology has aroused the interest of many researchers. In this paper, an improved conditional denoising diffusion probability model (ICDDPM) based on the Markov chain is proposed for the SR reconstruction of solar images. This method reconstructs high-resolution (HR) images from low-resolution images by learning a reverse process that adds noise to HR images. To verify the effectiveness of the method, images from the Goode Solar Telescope at the Big Bear Solar Observatory and the Helioseismic and Magnetic Imager (HMI) on the Solar Dynamics Observatory are used to train a network, and the spatial resolution of reconstructed images is 4 times that of the original HMI images. The experimental results show that the performance based on ICDDPM is better than the previous work in subject judgment and object evaluation indexes. The reconstructed images of this method have higher subjective vision quality and better consistency with the HMI images. And the structural similarity and rms index results are also higher than the compared method, demonstrating the success of the resolution improvement using ICDDPM. 
    more » « less