skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Variability-Inducing Requirements for Programs: Increasing Solution Variability for Similarity Checking
Award ID(s):
2111323
PAR ID:
10429098
Author(s) / Creator(s):
;
Date Published:
Journal Name:
ITiCSE 2023: Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education
Page Range / eLocation ID:
430 to 435
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The performance of compute hardware varies: software run repeatedly on the same server (or a different server with supposedly identical parts) can produce performance results that differ with each execution. This variation has important effects on the reproducibility of systems research and ability to quantitatively compare the performance of different systems. It also has implications for commercial computing, where agreements are often made conditioned on meeting specific performance targets. Over a period of 10 months, we conducted a large-scale study capturing nearly 900,000 data points from 835 servers. We examine this data from two perspectives: that of a service provider wishing to offer a consistent environment, and that of a systems researcher who must understand how variability impacts experimental results. From this examination, we draw a number of lessons about the types and magnitudes of performance variability and the effects on confidence in experiment results. We also create a statistical model that can be used to understand how representative an individual server is of the general population. The full dataset and our analysis tools are publicly available, and we have built a system to interactively explore the data and make recommendations for experiment parameters based on statistical analysis of historical data. 
    more » « less
  2. ABSTRACT We present new Gemini/GMOS optical spectroscopy of 16 extreme variability quasars (EVQs) that dimmed by more than 1.5 mag in the g band between the Sloan Digital Sky Survey (SDSS) and the Dark Energy Survey epochs (separated by a few years in the quasar rest frame). These EVQs are selected from quasars in the SDSS Stripe 82 region, covering a redshift range of 0.5 < z < 2.1. Nearly half of these EVQs brightened significantly (by more than 0.5 mag in the g band) in a few years after reaching their previous faintest state, and some EVQs showed rapid (non-blazar) variations of greater than 1–2 mag on time-scales of only months. To increase sample statistics, we use a supplemental sample of 33 EVQs with multi-epoch spectra from SDSS that cover the broad Mg ii λ2798 line. Leveraging on the large dynamic range in continuum variability between the multi-epoch spectra, we explore the associated variations in the broad Mg ii line, whose variability properties have not been well studied before. The broad Mg ii flux varies in the same direction as the continuum flux, albeit with a smaller amplitude, which indicates at least some portion of Mg ii is reverberating to continuum changes. However, the full width at half-maximum (FWHM) of Mg ii does not vary accordingly as continuum changes for most objects in the sample, in contrast to the case of the broad Balmer lines. Using the width of broad Mg ii to estimate the black hole mass with single epoch spectra therefore introduces a luminosity-dependent bias. 
    more » « less