skip to main content


Title: Comparison of In-Situ and Retrospective Self-Reports on Assessing Hearing Aid Outcomes
Abstract Background Ecological momentary assessment (EMA) is a methodology involving repeated surveys to collect in-situ self-reports that describe respondents' current or recent experiences. Audiology literature comparing in-situ and retrospective self-reports is scarce. Purpose To compare the sensitivity of in-situ and retrospective self-reports in detecting the outcome difference between hearing aid technologies, and to determine the association between in-situ and retrospective self-reports. Research Design An observational study. Study Sample Thirty-nine older adults with hearing loss. Data Collection and Analysis The study was part of a larger clinical trial that compared the outcomes of a prototype hearing aid (denoted as HA1) and a commercially available device (HA2). In each trial condition, participants wore hearing aids for 4 weeks. Outcomes were measured using EMA and retrospective questionnaires. To ensure that the outcome data could be directly compared, the Glasgow Hearing Aid Benefit Profile was administered as an in-situ self-report (denoted as EMA-GHABP) and as a retrospective questionnaire (retro-GHABP). Linear mixed models were used to determine if the EMA- and retro-GHABP could detect the outcome difference between HA1 and HA2. Correlation analyses were used to examine the association between EMA- and retro-GHABP. Results For the EMA-GHABP, HA2 had significantly higher (better) scores than HA1 in the GHABP subscales of benefit, residual disability, and satisfaction (p = 0.029–0.0015). In contrast, the difference in the retro-GHABP score between HA1 and HA2 was significant only in the satisfaction subscale (p = 0.0004). The correlations between the EMA- and retro-GHABP were significant in all subscales (p = 0.0004 to <0.0001). The strength of the association ranged from weak to moderate (r = 0.28–0.58). Finally, the exit interview indicated that 29 participants (74.4%) preferred HA2 over HA1. Conclusion The study suggests that in-situ self-reports collected using EMA could have a higher sensitivity than retrospective questionnaires. Therefore, EMA is worth considering in clinical trials that aim to compare the outcomes of different hearing aid technologies. The weak to moderate association between in-situ and retrospective self-reports suggests that these two types of measures assess different aspects of hearing aid outcomes.  more » « less
Award ID(s):
1838830
NSF-PAR ID:
10309713
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Journal of the American Academy of Audiology
Volume:
31
Issue:
10
ISSN:
1050-0545
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Abstract Background Ecological momentary assessment (EMA) is a methodology involving repeated surveys to collect in situ data that describe respondents' current or recent experiences and related contexts in their natural environments. Audiology literature investigating the test-retest reliability of EMA is scarce. Purpose This article examines the test-retest reliability of EMA in measuring the characteristics of listening contexts and listening experiences. Research Design An observational study. Study Sample Fifty-one older adults with hearing loss. Data Collection and Analysis The study was part of a larger study that examined the effect of hearing aid technologies. The larger study had four trial conditions and outcome was measured using a smartphone-based EMA system. After completing the four trial conditions, participants repeated one of the conditions to examine the EMA test-retest reliability. The EMA surveys contained questions that assessed listening context characteristics including talker familiarity, talker location, and noise location, as well as listening experiences including speech understanding, listening effort, loudness satisfaction, and hearing aid satisfaction. The data from multiple EMA surveys collected by each participant were aggregated in each of the test and retest conditions. Test-retest correlation on the aggregated data was then calculated for each EMA survey question to determine the reliability of EMA. Results At the group level, listening context characteristics and listening experience did not change between the test and retest conditions. The test-retest correlation varied across the EMA questions, with the highest being the questions that assessed talker location (median r = 1.0), reverberation (r = 0.89), and speech understanding (r = 0.85), and the lowest being the items that quantified noise location (median r = 0.63), talker familiarity (r = 0.46), listening effort (r = 0.61), loudness satisfaction (r = 0.60), and hearing aid satisfaction (r = 0.61). Conclusion Several EMA questions yielded appropriate test-retest reliability results. The lower test-retest correlations for some EMA survey questions were likely due to fewer surveys completed by participants and poorly designed questions. Therefore, the present study stresses the importance of using validated questions in EMA. With sufficient numbers of surveys completed by respondents and with appropriately designed survey questions, EMA could have reasonable test-retest reliability in audiology research. 
    more » « less
  2. Abstract Background Ecological momentary assessment (EMA) often requires respondents to complete surveys in the moment to report real-time experiences. Because EMA may seem disruptive or intrusive, respondents may not complete surveys as directed in certain circumstances. Purpose This article aims to determine the effect of environmental characteristics on the likelihood of instances where respondents do not complete EMA surveys (referred to as survey incompletion), and to estimate the impact of survey incompletion on EMA self-report data. Research Design An observational study. Study Sample Ten adults hearing aid (HA) users. Data Collection and Analysis Experienced, bilateral HA users were recruited and fit with study HAs. The study HAs were equipped with real-time data loggers, an algorithm that logged the data generated by HAs (e.g., overall sound level, environment classification, and feature status including microphone mode and amount of gain reduction). The study HAs were also connected via Bluetooth to a smartphone app, which collected the real-time data logging data as well as presented the participants with EMA surveys about their listening environments and experiences. The participants were sent out to wear the HAs and complete surveys for 1 week. Real-time data logging was triggered when participants completed surveys and when participants ignored or snoozed surveys. Data logging data were used to estimate the effect of environmental characteristics on the likelihood of survey incompletion, and to predict participants' responses to survey questions in the instances of survey incompletion. Results Across the 10 participants, 715 surveys were completed and survey incompletion occurred 228 times. Mixed effects logistic regression models indicated that survey incompletion was more likely to happen in the environments that were less quiet and contained more speech, noise, and machine sounds, and in the environments wherein directional microphones and noise reduction algorithms were enabled. The results of survey response prediction further indicated that the participants could have reported more challenging environments and more listening difficulty in the instances of survey incompletion. However, the difference in the distribution of survey responses between the observed responses and the combined observed and predicted responses was small. Conclusion The present study indicates that EMA survey incompletion occurs systematically. Although survey incompletion could bias EMA self-report data, the impact is likely to be small. 
    more » « less
  3. Introduction Using data collected from hearing aid users’ own hearing aids could improve the customization of hearing aid processing for different users based on the auditory environments they encounter in daily life. Prior studies characterizing hearing aid users’ auditory environments have focused on mean sound pressure levels and proportions of environments based on classifications. In this study, we extend these approaches by introducing entropy to quantify the diversity of auditory environments hearing aid users encounter. Materials and Methods Participants from 4 groups (younger listeners with normal hearing and older listeners with hearing loss from an urban or rural area) wore research hearing aids and completed ecological momentary assessments on a smartphone for 1 week. The smartphone was programmed to sample the processing state (input sound pressure level and environment classification) of the hearing aids every 10 min and deliver an ecological momentary assessment every 40 min. Entropy values for sound pressure levels, environment classifications, and ecological momentary assessment responses were calculated for each participant to quantify the diversity of auditory environments encountered over the course of the week. Entropy values between groups were compared. Group differences in entropy were compared to prior work reporting differences in mean sound pressure levels and proportions of environment classifications. Group differences in entropy measured objectively from the hearing aid data were also compared to differences in entropy measured from the self-report ecological momentary assessment data. Results Auditory environment diversity, quantified using entropy from the hearing aid data, was significantly higher for younger listeners than older listeners. Entropy measured using ecological momentary assessment was also significantly higher for younger listeners than older listeners. Discussion Using entropy, we show that younger listeners experience a greater diversity of auditory environments than older listeners. Alignment of group entropy differences with differences in sound pressure levels and hearing aid feature activation previously reported, along with alignment with ecological momentary response entropy, suggests that entropy is a valid and useful metric. We conclude that entropy is a simple and intuitive way to measure auditory environment diversity using hearing aid data. 
    more » « less
  4. We pooled data from 10 longitudinal studies of 1,104 married couples to test the Vulnerability-Stress-Adaptation (VSA) model of change in relationship satisfaction. Studies contained both spouses’ self-reports of neuroticism, attachment anxiety, and attachment avoidance; observational measures of engagement and opposition during problem-solving discussions at baseline; and repeated reports of both spouses’ stress and marital satisfaction over several years. Consistent with the VSA model, all three individual and partner qualities predicted changes in marital satisfaction that were mediated by observations of behavior and moderated by both partners’ experiences with stress. In contrast to the VSA model, however, rather than accentuating the association between individual differences and behavior, both partners’ stress moderated the strength, and even direction, of the association between behavior and changes in marital satisfaction over time. Taken together, these findings indicate that 1) qualities of both couple members shape their behavioral exchanges, 2) these behaviors explain how individuals and their partners’ enduring qualities predict relationship satisfaction, and 3) stress experienced by both couple members strongly determines how enduring qualities and behavior predict changes in relationship satisfaction over time. The complex interplay among both partners’ enduring qualities, stress, and behavior helps explain why studies may fail to document direct main effects of own and partner enduring qualities and behavior on changes in relationship satisfaction over time.

     
    more » « less
  5. null (Ed.)
    Background: Research studies often rely on self-reported weight to calculate body mass index. The present study investigated how the accuracy of self-reported body weight in adolescent girls is affected by overweight/obesity, race/ethnicity, and mental health factors. Methods: In a cohort of girls who participated in the Trial of Activity for Adolescent Girls at ages 11 and 17 (n = 588), self-reported and measured weight were compared, and linear regression models were fitted to model the over- or underreporting. The Center for Epidemiological Studies-Depression Scale (CES-D) was used to calculate depressive symptom subscales for negative affect, anhedonia and somatic symptoms. Results: Allowing 3% difference between self-reported and measured weight for the correct reporting of body weight, 59.2% of girls reported their weight correctly, 30.3% underreported (−5.8 ± 4.8 kg), and 10.5% overreported (4.3 ± 3.5 kg). The average difference between self-reported and measured body weight was −1.5 ± 4.3 kg (p < 0.001). Factors for misreporting body weight were overweight (β ± SE − 2.60 ± 0.66%), obesity (β ± SE − 2.41 ± 0.71%), weight change between ages 11 and 17 (β ± SE − 0.35 ± 0.04% for each kg), height change between ages 11 and 17 (β ± SE 0.29 ± 0.10% for each cm), and negative affect (β ± SE − 0.18 ± 0.08% for each score unit). Conclusions: The difference between self-reported and measured body weight in adolescent girls is relatively small. However, the accuracy of self-reported body weight may be lower in girls with overweight or obesity, recent weight and height change, and higher negative affect. 
    more » « less