skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Telephone health survey estimates: Effects of nonresponse and sample limitations
ObjectiveThe objective of this study was to assess nonresponse error in telephone health survey data based on an address‐based sample. Data SourcesTelephone and in‐person interviews in Greater Boston. Study Design/Data CollectionInterviewers attempted telephone interviews at addresses that were matched to telephone numbers using questions drawn from federal health surveys. In‐person household interviews were carried out with telephone nonrespondents and at addresses without matching telephone numbers. Principal FindingsAfter adjusting for demographic differences, only eight of 15 estimates based on the telephone interviews lay within two standard errors of the estimates when data from all three groups were included. ConclusionsFor health surveys of address‐based samples, many estimates based on telephone respondents differ from the total population in ways that cannot be corrected with simple demographic adjustments.  more » « less
Award ID(s):
1424433
PAR ID:
10460952
Author(s) / Creator(s):
 ;  ;  ;  
Publisher / Repository:
Wiley-Blackwell
Date Published:
Journal Name:
Health Services Research
Volume:
54
Issue:
3
ISSN:
0017-9124
Page Range / eLocation ID:
p. 700-706
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Abstract With declining response rates and challenges of using RDD sampling for telephone surveys, collecting data from address-based samples has become more attractive. Two approaches are doing telephone interviews at telephone numbers matched to addresses and asking those at sampled addresses to call into an Interactive Voice Response (IVR) system to answer questions. This study used in-person interviewing to evaluate the effects of nonresponse and problems matching telephone numbers when telephone and IVR were used as the initial modes of data collection. The survey questions were selected from major US federal surveys covering a variety of topics. Both nonresponse and, for telephone, inability to find matches result in important nonresponse error for nearly half the measures across all topics, even after adjustments to fit the known demographic characteristics of the residents. Producing credible estimates requires using supplemental data collection strategies to reduce error from nonresponse. 
    more » « less
  2. ObjectiveThe objective is to estimate the relative contributions of nonresponse, coverage, and measurement biases in survey estimates of voting. MethodsWe survey 3,000 Boston‐area households sampled from an address‐based frame matched, when possible, to telephone numbers. A two‐phase sampling design was used to follow up nonrespondents from phone interviews with personal interviews. All cases were then linked to voting records. ResultsNonresponse, coverage, and measurement‐biased survey estimates at varying stages of the study design. Coverage error linked to missing telephone numbers biased estimates that excluded nonphone households. Overall estimates including nonphone households and nonrespondent interviews include 25 percent relative bias equally attributable to measurement and nonresponse. ConclusionBias in voting measures is not limited to measurement bias. Researchers should also assess the potential for nonresponse and coverage biases. 
    more » « less
  3. We conducted an experiment to evaluate the effects on fieldwork outcomes and interview mode of switching to a web-first mixed-mode data collection design (self-administered web interview and interviewer-administered telephone interview) from a telephone-only design. We examine whether the mixed-mode option leads to better survey outcomes, based on response rates, fieldwork outcomes, interview quality and costs. We also examine respondent characteristics associated with completing a web interview rather than a telephone interview. Our mode experiment study was conducted in the 2019 wave of the Transition into Adulthood Supplement (TAS) to the US Panel Study of Income Dynamics (PSID). TAS collects information biennially from approximately 3,000 young adults in PSID families. The shift to a mixed-mode design for TAS was aimed at reducing costs and increasing respondent cooperation. We found that for mixed-mode cases compared to telephone only cases, response rates were higher, interviews were completed faster and with lower effort, the quality of the interview data appeared better, and fieldwork costs were lower. A clear set of respondent characteristics reflecting demographic and socioeconomic characteristics, technology availability and use, time use, and psychological health were associated with completing a web interview rather than a telephone interview. 
    more » « less
  4. Abstract ObjectiveOnline patient portals become important during disruptions to in-person health care, like when cases of coronavirus disease 2019 (COVID-19) and other respiratory viruses rise, yet underlying structural inequalities associated with race, socio-economic status, and other socio-demographic characteristics may affect their use. We analyzed a population-based survey to identify disparities within the United States in access to online portals during the early period of COVID-19 in 2020. Materials and MethodsThe National Cancer Institute fielded the 2020 Health and Information National Trends Survey from February to June 2020. We conducted multivariable analysis to identify socio-demographic characteristics of US patients who were offered and accessed online portals, and reasons for nonuse. ResultsLess than half of insured adult patients reported accessing an online portal in the prior 12 months, and this was less common among patients who are male, are Hispanic, have less than a college degree, have Medicaid insurance, have no regular provider, or have no internet. Reasons for nonuse include: wanting to speak directly to a provider, not having an online record, concerns about privacy, and discomfort with technology. DiscussionDespite the rapid expansion of digital health technologies due to COVID-19, we found persistent socio-demographic disparities in access to patient portals. Ensuring that digital health tools are secure, private, and trustworthy would address some patient concerns that are barriers to portal access. ConclusionExpanding the use of online portals requires explicitly addressing fundamental inequities to prevent exacerbating existing disparities, particularly during surges in cases of COVID-19 and other respiratory viruses that tax health care resources. 
    more » « less
  5. Abstract ObjectiveTo understand the perspectives of home health aides (HHAs) toward their own health and health behaviors, and how their job impacts both. Data Sources and Study SettingInterviews were conducted with 28 HHAs from 16 unique home care agencies from August 2021 to January 2022. The study was conducted in partnership with the 1199SEIU Training and Employment Fund, a labor‐management fund of the largest health care union in the US. Study DesignA qualitative study with English and Spanish‐speaking HHAs. Interviews were conducted using a semi‐structured topic guide, informed by Pender's Health Promotion Model and the National Institute for Occupational Safety and Health's Total Worker Health Model. To be eligible, HHAs had to be currently employed by a home care agency in New York, NY. Data Collection/Extraction MethodsInterviews were recorded, professionally transcribed, and analyzed thematically. Principal FindingsThe 28 HHAs had a mean age of 47.6 years (SD 11.1), 39% were non‐Hispanic Black, 43% were Hispanic, and they had a mean of 14.1 years (SD 7.8) of job experience. Five themes emerged; HHAs were: (1) Healthy enough to work, but were managing their own chronic conditions while working; (2) Motivated to be healthy, in part driven by their desire to care for others; (3) Worked closely with sick patients, which influenced their perceptions of health; (4) Experienced occupational and patient‐level barriers to practicing healthy behaviors; (5) Sought support and resources to improve their health and wellbeing. ConclusionsHHAs have numerous health challenges, many of which are influenced by their job. Culturally and occupationally tailored interventions may mitigate the barriers that HHAs experience to achieve optimal health. 
    more » « less