An official website of the United States government
ObjectiveThe objective is to estimate the relative contributions of nonresponse, coverage, and measurement biases in survey estimates of voting. MethodsWe survey 3,000 Boston‐area households sampled from an address‐based frame matched, when possible, to telephone numbers. A two‐phase sampling design was used to follow up nonrespondents from phone interviews with personal interviews. All cases were then linked to voting records. ResultsNonresponse, coverage, and measurement‐biased survey estimates at varying stages of the study design. Coverage error linked to missing telephone numbers biased estimates that excluded nonphone households. Overall estimates including nonphone households and nonrespondent interviews include 25 percent relative bias equally attributable to measurement and nonresponse. ConclusionBias in voting measures is not limited to measurement bias. Researchers should also assess the potential for nonresponse and coverage biases.
more »
« less
Does Survey Nonresponse Bias Estimates of Religious Service Attendance? Evidence from an Address-Based Sample from the Boston Area
Abstract This study investigates what role, if any, nonresponse plays in inflating survey estimates of religious behavior, using a multimode survey designed to allow estimation of nonresponse bias. A sample of 3,000 Boston-area households drawn from an address-based frame was randomly divided into two subsamples, contacted by mail, and invited to participate in a survey. The first subsample was asked to complete an interactive voice response interview. The second subsample was asked to complete a survey by telephone if a number was available for the address or by personal interview if not. Finally, random samples of nonrespondents were recontacted for a personal interview. Comparison of attendance estimates from initial interviews with nonrespondent interviews within sample segments yields minor or minimal differences that are not statistically significant. Findings suggest that the mechanism generating survey nonresponse is unlikely to be a major cause of bias in religious service attendance estimates in this study.
more »
« less
- Award ID(s):
- 1424433
- PAR ID:
- 10253111
- Date Published:
- Journal Name:
- Sociology of Religion
- Volume:
- 80
- Issue:
- 2
- ISSN:
- 1069-4404
- Page Range / eLocation ID:
- 247 to 262
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Adaptive survey designs are increasingly used by survey practitioners to counteract ongoing declines in household survey response rates and manage rising fieldwork costs. This paper reports findings from an evaluation of an early-bird incentive (EBI) experiment targeting high-effort respondents who participate in the 2019 wave of the US Panel Study of Income Dynamics. We identified a subgroup of high-effort respondents at risk of nonresponse based on their prior wave fieldwork effort and randomized them to a treatment offering an extra time-delimited monetary incentive for completing their interview within the first month of data collection (treatment group; N = 800) or the standard study incentive (control group; N = 400). In recent waves, we have found that the costs of the protracted fieldwork needed to complete interviews with high-effort cases in the form of interviewer contact attempts plus an increased incentive near the close of data collection are extremely high. By incentivizing early participation and reducing the number of interviewer contact attempts and fieldwork days to complete the interview, our goal was to manage both nonresponse and survey costs. We found that the EBI treatment increased response rates and reduced fieldwork effort and costs compared to a control group. We review several key findings and limitations, discuss their implications, and identify the next steps for future research.more » « less
-
ObjectiveThe objective of this study was to assess nonresponse error in telephone health survey data based on an address‐based sample. Data SourcesTelephone and in‐person interviews in Greater Boston. Study Design/Data CollectionInterviewers attempted telephone interviews at addresses that were matched to telephone numbers using questions drawn from federal health surveys. In‐person household interviews were carried out with telephone nonrespondents and at addresses without matching telephone numbers. Principal FindingsAfter adjusting for demographic differences, only eight of 15 estimates based on the telephone interviews lay within two standard errors of the estimates when data from all three groups were included. ConclusionsFor health surveys of address‐based samples, many estimates based on telephone respondents differ from the total population in ways that cannot be corrected with simple demographic adjustments.more » « less
-
Nehm, Ross (Ed.)Although many scientists agree that evolution does not make claims about God/god(s), students might assume that evolution is atheistic, and this may lead to lower evolution acceptance. In study 1, we surveyed 1081 college biology students at one university about their religiosity and evolution acceptance and asked what religious ideas someone would have to reject if that person were to accept evolution. Approximately half of students wrote that a person cannot believe in God/religion and accept evolution, indicating that these students may have atheistic perceptions of evolution. Religiosity was not related to whether a student wrote that evolution is atheistic, but writing that evolution is atheistic was associated with lower evolution acceptance among the more religious students. In study 2, we collected data from 1898 students in eight states in the United States using a closed-ended survey. We found that 56.5% of students perceived that evolution is atheistic even when they were given the option to choose an agnostic perception of evolution. Further, among the most religious students, those who thought evolution is atheistic were less accepting of evolution, less comfortable learning evolution, and perceived greater conflict between their personal religious beliefs and evolution than those who thought evolution is agnostic.more » « less
-
null (Ed.)Abstract With declining response rates and challenges of using RDD sampling for telephone surveys, collecting data from address-based samples has become more attractive. Two approaches are doing telephone interviews at telephone numbers matched to addresses and asking those at sampled addresses to call into an Interactive Voice Response (IVR) system to answer questions. This study used in-person interviewing to evaluate the effects of nonresponse and problems matching telephone numbers when telephone and IVR were used as the initial modes of data collection. The survey questions were selected from major US federal surveys covering a variety of topics. Both nonresponse and, for telephone, inability to find matches result in important nonresponse error for nearly half the measures across all topics, even after adjustments to fit the known demographic characteristics of the residents. Producing credible estimates requires using supplemental data collection strategies to reduce error from nonresponse.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1093/socrel/sry031
