Search for: All records

Current approaches in automatic readability assessment have found success with the use of large language models and transformer architectures. These techniques lead to accuracy improvement, but they do not offer the interpretability that is uniquely required by the audience most often employing readability assessment tools: teachers and educators. Recent work that employs more traditional machine learning methods has highlighted the linguistic importance of considering semantic and syntactic characteristics of text in readability assessment by utilizing handcrafted feature sets. Research in Education suggests that, in addition to semantics and syntax, phonetic and orthographic instruction are necessary for children to progress through the stages of reading and spelling development; children must first learn to decode the letters and symbols on a page to recognize words and phonemes and their connection to speech sounds. Here, we incorporate this word-level phonemic decoding process into readability assessment by crafting a phonetically-based feature set for grade-level classification for English. Our resulting feature set shows comparable performance to much larger, semantically- and syntactically-based feature sets, supporting the linguistic value of orthographic and phonetic considerations in readability assessment. 

Children often interact with search engines within a classroom context to complete assignments or discover new information. To successfully identify relevant resources among those presented on a search engine results page (SERP), users must first be able to comprehend the text included in SERP snippets. While this task may be straightforward for an adult user, children may encounter obstacles in terms of readability and comprehension when attempting to navigate a SERP. Previous research has demonstrated the positive impact of including visual cues on a SERP as relevance signals to guide children toward appropriate resources. In this work, we explore the effect of supplying visual cues related to readability and text difficulty on children’s (ages 6-12) navigation of a SERP. Using quantitative data collected from user-interface interactions and qualitative data gathered from participant interviews, we analyze the impact of these visual cues on children’s selection of results on a SERP when carrying out information discovery tasks. 

In this work, we discuss the findings emerging from co-design sessions between children ages 6 to 11 and adults, which were conducted to advance knowledge on how to best support children using well-known search tools for online information discovery. Specifically, we argue that by leveraging scaffolding, gamification techniques, and design choices via an application, it is possible to enhance children’s habits related to query formulation. Outcomes from this preliminary exploration reveal that gameplay incentives (e.g. levels, points, and other incentives like customization) are needed and effective in motivating further interaction with the application, which in turn leads to further utilization of the scaffolding needed to positively impact query formulation. 

Children often interact with search engines within a classroom context to complete assignments or discover new information. To successfully identify relevant resources among those presented on a search engine results page (SERP), users must first be able to comprehend the text included in SERP snippets. While this task may be straightforward for an adult user, children may encounter obstacles in terms of readability and comprehension when attempting to navigate a SERP. Previous research has demonstrated the positive impact of including visual cues on a SERP as relevance signals to guide children toward appropriate resources. In this work, we explore the effect of supplying visual cues related to readability and text difficulty on children's (ages 6-12) navigation of a SERP. Using quantitative data collected from user-interface interactions and qualitative data gathered from participant interviews, we analyze the impact of these visual cues on children's selection of results on a SERP when carrying out information discovery tasks. 

Designing for child-learning involves a number of stakeholders including, but not limited to: teachers, children, administrators, and families. A common approach used to design technologies is co-design. Yet, co-design frequently means different things for different stakeholders. Within the realm of education co-design can be used generally for any interaction with a stakeholder that can be used to guide or inform the design of the desired outcome (product or curriculum) -- often with different stakeholders separately and/or in very small groups (e.g. a group of teachers or 2-3 children, or a classroom if ``testing''). Within the field of child-computer interaction, designing technologies with and for children can involve children and other stakeholders in varying levels of involvement, although within the IDC community it is often a more substantial contribution. We posit that giving child stakeholders an authentic voice in the design of technologies is crucial to fully addressing stakeholder's needs. 

We introduce a re-ranking model that augments the functionality of standard search engines to aid classroom search activities for children (ages 6–11). This model extends the known listwise learning-to-rank framework by balancing risk and reward. Doing so enables the model to prioritize Web resources of high educational alignment, appropriateness, and adequate readability by analyzing the URLs, snippets, and page titles of Web resources retrieved by a mainstream search engine. Experimental results demonstrate the value of considering multiple perspectives inherent to the classroom when designing algorithms that can better support children's information discovery. 

The role that technology plays in supporting children at school and at home is more prominent than ever before due to the global COVID-19 pandemic. This has prompted us to focus the 6th International and Interdisciplinary Perspectives on Children \& Recommender and Information Retrieval Systems (KidRec) workshop on what the lasting changes will be to the design and development of child information retrieval systems. After two years, are information retrieval systems used more in and out of the classroom? Are they more interactive, more or less personalized? What is the impact on the research and business community? Are there long-term and unexpected changes on the design, ethics, and algorithms? The primary goal of our workshop continues to be to build community by bringing together researchers, practitioners, and other stakeholders from various backgrounds and disciplines to understand and advance information retrieval systems for children. 

In this paper, we explore how children engage with search engine result pages (SERP) generated by a popular search API in response to their online inquiries. We do so to further understand children navigation behaviour. To accomplish this goal, we examine search logs produced as a result of children (ages 6 to 12), using metrics commonly used to operationalize engagement, including: position of clicks, time spent hovering, and the sequence of navigation on a SERP. We also investigate the potential connection between the text complexity of SERP snippets and engagement. Our findings verify that children engage more frequently with SERP results in higher ranking positions, but that engagement does not decrease linearly as children navigate to lower ranking positions. They also reveal that children generally spend more time hovering on snippets with more complex readability levels (i.e., harder to read) than snippets on the lower end of the readability spectrum. 

Readability is a core component of information retrieval (IR) tools as the complexity of a resource directly affects its relevance: a resource is only of use if the user can comprehend it. Even so, the link between readability and IR is often overlooked. As a step towards advancing knowledge on the influence of readability on IR, we focus on Web search for children. We explore how traditional formulas–which are simple, efficient, and portable–fare when applied to estimating the readability of Web resources for children written in English. We then present a formula well-suited for readability estimation of child-friendly Web resources. Lastly, we empirically show that readability can sway children’s information access. Outcomes from this work reveal that: (i) for Web resources targeting children, a simple formula suffices as long as it considers contemporary terminology and audience requirements, and (ii) instead of turning to Flesch-Kincaid–a popular formula–the use of the “right” formula can shape Web search tools to best serve children. The work we present herein builds on three pillars: Audience, Application, and Expertise. It serves as a blueprint to place readability estimation methods that best apply to and inform IR applications serving varied audiences.