An official website of the United States government
Abstract Establishing the invariance property of an instrument (e.g., a questionnaire or test) is a key step for establishing its measurement validity. Measurement invariance is typically assessed by differential item functioning (DIF) analysis, i.e., detecting DIF items whose response distribution depends not only on the latent trait measured by the instrument but also on the group membership. DIF analysis is confounded by the group difference in the latent trait distributions. Many DIF analyses require knowing several anchor items that are DIF-free in order to draw inferences on whether each of the rest is a DIF item, where the anchor items are used to identify the latent trait distributions. When no prior information on anchor items is available, or some anchor items are misspecified, item purification methods and regularized estimation methods can be used. The former iteratively purifies the anchor set by a stepwise model selection procedure, and the latter selects the DIF-free items by a LASSO-type regularization approach. Unfortunately, unlike the methods based on a correctly specified anchor set, these methods are not guaranteed to provide valid statistical inference (e.g., confidence intervals andp-values). In this paper, we propose a new method for DIF analysis under a multiple indicators and multiple causes (MIMIC) model for DIF. This method adopts a minimal$$L_1$$ norm condition for identifying the latent trait distributions. Without requiring prior knowledge about an anchor set, it can accurately estimate the DIF effects of individual items and further draw valid statistical inferences for quantifying the uncertainty. Specifically, the inference results allow us to control the type-I error for DIF detection, which may not be possible with item purification and regularized estimation methods. We conduct simulation studies to evaluate the performance of the proposed method and compare it with the anchor-set-based likelihood ratio test approach and the LASSO approach. The proposed method is applied to analysing the three personality scales of the Eysenck personality questionnaire-revised (EPQ-R).
more »
« less
Detecting Differential Item Functioning Using Response Time
This study investigated uniform differential item functioning (DIF) detection in response times. We proposed a regression analysis approach with both the working speed and the group membership as independent variables, and logarithm transformed response times as the dependent variable. Effect size measures such as Δ[Formula: see text] and percentage change in regression coefficients in conjunction with the statistical significance tests were used to flag DIF items. A simulation study was conducted to assess the performance of three DIF detection criteria: (a) significance test, (b) significance test with Δ[Formula: see text], and (c) significance test with the percentage change in regression coefficients. The simulation study considered factors such as sample sizes, proportion of the focal group in relation to total sample size, number of DIF items, and the amount of DIF. The results showed that the significance test alone was too strict; using the percentage change in regression coefficients as an effect size measure reduced the flagging rate when the sample size was large, but the effect was inconsistent across different conditions; using Δ R2with significance test reduced the flagging rate and was fairly consistent. The PISA 2018 data were used to illustrate the performance of the proposed method in a real dataset. Furthermore, we provide guidelines for conducting DIF studies with response time.
more »
« less
- Award ID(s):
- 1853166
- PAR ID:
- 10552178
- Publisher / Repository:
- SAGE Publications
- Date Published:
- Journal Name:
- Educational and Psychological Measurement
- ISSN:
- 0013-1644
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Differential item functioning (DIF) is often used to examine validity evidence of alternate form test accommodations. Unfortunately, traditional approaches for evaluating DIF are prone to selection bias. This article proposes a novel DIF framework that capitalizes on regression discontinuity design analysis to control for selection bias. A simulation study was performed to compare the new framework with traditional logistic regression, with respect to Type I error and power rates of the uniform DIF test statistics and bias and root mean square error of the corresponding effect size estimators. The new framework better controlled the Type I error rate and demonstrated minimal bias but suffered from low power and lack of precision. Implications for practice are discussed.more » « less
-
Discrete-particle simulations of bidisperse shear thickening suspensions are reported. The work considers two packing parameters, the large-to-small particle radius ratio ranging from [Formula: see text] (nearly monodisperse) to [Formula: see text], and the large particle fraction of the total solid loading with values [Formula: see text], 0.5, and 0.85. Particle-scale simulations are performed over a broad range of shear stresses using a simulation model for spherical particles accounting for short-range lubrication forces, frictional interaction, and repulsion between particles. The variation of rheological properties and the maximum packing fraction [Formula: see text] with shear stress [Formula: see text] are reported. At a fixed volume fraction [Formula: see text], bidispersity decreases the suspension relative viscosity [Formula: see text], where [Formula: see text] is the suspension viscosity and [Formula: see text] is the suspending fluid viscosity, over the entire range of shear stresses studied. However, under low shear stress conditions, the suspension exhibits an unusual rheological behavior: the minimum viscosity does not occur as expected at [Formula: see text], but instead decreases with further increase of [Formula: see text] to [Formula: see text]. The second normal stress difference [Formula: see text] acts similarly. This behavior is caused by particles ordering into a layered structure, as is also reflected by the zero slope with respect to time of the mean-square displacement in the velocity gradient direction. The relative viscosity [Formula: see text] of bidisperse rate-dependent suspensions can be predicted by a power law linking it to [Formula: see text], [Formula: see text] in both low and high shear stress regimes. The agreement between the power law and experimental data from literature demonstrates that the model captures well the effect of particle size distribution, showing that viscosity roughly collapses onto a single master curve when plotted against the reduced volume fraction [Formula: see text].more » « less
-
null (Ed.)Consider a fractional Brownian motion (fBM) [Formula: see text] with Hurst index [Formula: see text]. We construct a probability space supporting both B H and a fully simulatable process [Formula: see text] such that[Formula: see text] with probability one for any user-specified error bound [Formula: see text]. When [Formula: see text], we further enhance our error guarantee to the α-Hölder norm for any [Formula: see text]. This enables us to extend our algorithm to the simulation of fBM-driven stochastic differential equations [Formula: see text]. Under mild regularity conditions on the drift and diffusion coefficients of Y, we construct a probability space supporting both Y and a fully simulatable process [Formula: see text] such that[Formula: see text] with probability one. Our algorithms enjoy the tolerance-enforcement feature, under which the error bounds can be updated sequentially in an efficient way. Thus, the algorithms can be readily combined with other advanced simulation techniques to estimate the expectations of functionals of fBMs efficiently.more » « less
-
BaTiO 3 (BTO) is considered the most commonly used ceramic material in multilayer ceramic capacitors due to its desirable dielectric properties. Considering that the miniaturization of electronic devices represents an expanding field of research, modification of BTO has been performed to increase dielectric constant and DC bias characteristic/sensitivity. This research presents the effect of N 2 and air atmospheres on morphological and dielectric properties of BTO nanoparticles modified with organometallic salt at sintering temperatures of [Formula: see text]C, [Formula: see text]C, [Formula: see text]C, and [Formula: see text]C. Measured dielectric constants were up to 35,000, with achieved very high values in both atmospheres. Field emission scanning electron microscopy (FESEM) was used for morphological characterization, revealing a porous structure in all the samples. The software image analysis of FESEM images showed a connection between particle and pore size distribution, as well as porosity. Based on the data from the image analysis, the prediction of dielectric properties in relation to morphology indicated that yttrium-based organometallic salt reduced oxygen vacancy generation in N 2 atmosphere. DC bias sensitivity measurements showed that samples with higher dielectric constant had more pronounced sensitivity to voltage change, but most of the samples were stable up to 100 V, making our modified BTO a promising candidate for capacitors.more » « less
