Search for: All records

Current approaches in automatic readability assessment have found success with the use of large language models and transformer architectures. These techniques lead to accuracy improvement, but they do not offer the interpretability that is uniquely required by the audience most often employing readability assessment tools: teachers and educators. Recent work that employs more traditional machine learning methods has highlighted the linguistic importance of considering semantic and syntactic characteristics of text in readability assessment by utilizing handcrafted feature sets. Research in Education suggests that, in addition to semantics and syntax, phonetic and orthographic instruction are necessary for children to progress through the stages of reading and spelling development; children must first learn to decode the letters and symbols on a page to recognize words and phonemes and their connection to speech sounds. Here, we incorporate this word-level phonemic decoding process into readability assessment by crafting a phonetically-based feature set for grade-level classification for English. Our resulting feature set shows comparable performance to much larger, semantically- and syntactically-based feature sets, supporting the linguistic value of orthographic and phonetic considerations in readability assessment. 

Children often interact with search engines within a classroom context to complete assignments or discover new information. To successfully identify relevant resources among those presented on a search engine results page (SERP), users must first be able to comprehend the text included in SERP snippets. While this task may be straightforward for an adult user, children may encounter obstacles in terms of readability and comprehension when attempting to navigate a SERP. Previous research has demonstrated the positive impact of including visual cues on a SERP as relevance signals to guide children toward appropriate resources. In this work, we explore the effect of supplying visual cues related to readability and text difficulty on children's (ages 6-12) navigation of a SERP. Using quantitative data collected from user-interface interactions and qualitative data gathered from participant interviews, we analyze the impact of these visual cues on children's selection of results on a SERP when carrying out information discovery tasks. 

Children often interact with search engines within a classroom context to complete assignments or discover new information. To successfully identify relevant resources among those presented on a search engine results page (SERP), users must first be able to comprehend the text included in SERP snippets. While this task may be straightforward for an adult user, children may encounter obstacles in terms of readability and comprehension when attempting to navigate a SERP. Previous research has demonstrated the positive impact of including visual cues on a SERP as relevance signals to guide children toward appropriate resources. In this work, we explore the effect of supplying visual cues related to readability and text difficulty on children’s (ages 6-12) navigation of a SERP. Using quantitative data collected from user-interface interactions and qualitative data gathered from participant interviews, we analyze the impact of these visual cues on children’s selection of results on a SERP when carrying out information discovery tasks. 

Information access research (and development) sometimes makes use of gender, whether to report on the demographics of participants in a user study, as inputs to personalized results or recommendations, or to make systems gender-fair, amongst other purposes. This work makes a variety of assumptions about gender, however, that are not necessarily aligned with current understandings of what gender is, how it should be encoded, and how a gender variable should be ethically used. In this work, we present a systematic review of papers on information retrieval and recommender systems that mention gender in order to document how gender is currently being used in this field. We find that most papers mentioning gender do not use an explicit gender variable, but most of those that do either focus on contextualizing results of model performance, personalizing a system based on assumptions of user gender, or auditing a model’s behavior for fairness or other privacy-related issues. Moreover, most of the papers we review rely on a binary notion of gender, even if they acknowledge that gender cannot be split into two categories. We connect these findings with scholarship on gender theory and recent work on gender in human-computer interaction and natural language processing. We conclude by making recommendations for ethical and well-grounded use of gender in building and researching information access systems.