skip to main content


Title: Searching for Engagement: Child Engagement and Search Engine Result Pages
In this paper, we explore how children engage with search engine result pages (SERP) generated by a popular search API in response to their online inquiries. We do so to further understand children navigation behaviour. To accomplish this goal, we examine search logs produced as a result of children (ages 6 to 12), using metrics commonly used to operationalize engagement, including: position of clicks, time spent hovering, and the sequence of navigation on a SERP. We also investigate the potential connection between the text complexity of SERP snippets and engagement. Our findings verify that children engage more frequently with SERP results in higher ranking positions, but that engagement does not decrease linearly as children navigate to lower ranking positions. They also reveal that children generally spend more time hovering on snippets with more complex readability levels (i.e., harder to read) than snippets on the lower end of the readability spectrum.  more » « less
Award ID(s):
1763649
NSF-PAR ID:
10337084
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Interaction Design and Children
Page Range / eLocation ID:
479-484
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. In this paper, we take a step towards understanding how to design search engine results pages (SERP) that encourage children’s engagement as they seek for online resources. For this, we conducted a participatory design session to enable us to elicit children’s preferences and determine what children (ages 6–12) find lacking in more traditional SERP. We learned that children want more dynamic means of navigating results and additional ways to interact with results via icons. We use these findings to inform the design of a new SERP interface, which we denoted CHIRP. To gauge the type of engagement that a SERP incorporating interactive elements–CHIRP–can foster among children, we conducted a user study at a public school. Analysis of children’s interactions with CHIRP, in addition to responses to a post-task survey, reveals that adding additional interaction points results in a SERP interface that children prefer, but one that does not necessarily change engagement levels through clicks or time spent on SERP. 
    more » « less
  2. The contemporary Google Search Engine Results Page (SERP) supplements classic blue hyperlinks with complex components. These components produce tensions between searchers, 3rd-party websites, and Google itself over clicks and attention. In this study, we examine 12 SERP components from two categories: (1) extracted results (e.g., featured-snippets) and (2) Google Services (e.g., shopping-ads) to determine their effect on peoples’ behavior. We measure behavior with two variables: (1) click- through rate (CTR) to Google’s own domains versus 3rd-party domains and (2) time spent on the SERP. We apply causal inference methods to an ecologically valid trace dataset comprising 477,485 SERPs from 1,756 participants. We find that multiple components substantially increase CTR to Google domains, while others decrease CTR and increase time on the SERP. These findings may inform efforts to regulate the design of powerful intermediary platforms like Google. 
    more » « less
  3. Background & Program Description: The link between student engagement and retention is well-established in the education literature. As a result, many colleges have developed first-year experience programs to engage students in early technical work and to promote community-building. However, many of these student success programs require participation in extracurricular activities, which require time outside of class. Yet time for extracurricular activities is a luxury that many students of low socioeconomic status (SES) cannot afford due to family or work obligations. The Scholarships in STEM (S-STEM) program, funded by the National Science Foundation, provides crucial financial support to high-achieving low-SES STEM students. The S-STEM scholarships give students the option to work less or not at all. The intended result is that students regain the time afforded to their more privileged peers, thereby also giving them the opportunity to more effectively engage with their institution, studies, and peers. The Endeavour Program is a two-year program that incorporates the S-STEM financial support into a multi-faceted and multi-college program in STEM designed to increase the level of student engagement in school. The scholars, who are recruited from three colleges, take classes together, work on hands-on team projects, attend professional and personal development events, participate in outreach events, and conduct research with faculty mentors. Over the course of the two-year program, four dimensions of student engagement (academic, behavioral, cognitive, and affective) are tracked to determine the appropriateness of using these engagement levels as predictors of success. Results: Two cohorts of 20 students were recruited in the fall of 2017 and in the fall of 2018. The first cohort completed the two-year program in the spring of 2020, and the second cohort began the second year of the program in the fall of 2020. No third cohort was recruited in 2020 due the Covid19 pandemic. The third and fourth cohorts will now enter the program in the fall of 2021 and the fall of 2022 respectively. Overall, the results of the Endeavour Program have been positive. The final retention outcome for the first cohort (the only cohort to complete the program thus far) was 85% (17/20). Retention for the second cohort is currently at 100% (20/20). Initial results show that the S-STEM scholars are performing academically as well as their peers who do not share the same risk factors. In addition, the number of completed hours is also on par with their peers. However, the most significant gains were observed in the qualitative data. Students expressed fears and anxieties about the high school to college transition and reported that the guidance provided and the community formed through the Endeavour Program alleviated many of those negative emotions. The full paper shows student engagement data obtained over time for the first and second cohorts as well as lessons learned and directions for future work. Also, examples of advising charts created in an engagement data dashboard show how the quantitative engagement data has been compiled and organized to show early warning signs for current and future cohorts. 
    more » « less
  4. This study aims to investigate the collaboration processes of immigrant families as they search for online information together. Immigrant English-language learning adults of lower socioeconomic status often work collaboratively with their children to search the internet. Family members rely on each other’s language and digital literacy skills in this collaborative process known as online search and brokering (OSB). While previous work has identified ecological factors that impact OSB, research has not yet distilled the specific learning processes behind such collaborations. Design/methodology/approach: For this study, the authors adhere to practices of a case study examination. This study’s participants included parents, grandparents and children aged 10–17 years. Most adults were born in Mexico, did not have a college-degree, worked in service industries and represented a lower-SES population. This study conducted two to three separate in-home family visits per family with interviews and online search tasks. Findings: From a case study analysis of three families, this paper explores the funds of knowledge, resilience, ecological support and challenges that children and parents face, as they engage in collaborative OSB experiences. This study demonstrates how in-home computer-supported collaborative processes are often informal, social, emotional and highly relevant to solving information challenges. Research limitations/implications: An intergenerational OSB process is different from collaborative online information problem-solving that happens between classroom peers or coworkers. This study’s research shows how both parents and children draw on their funds of knowledge, resilience and ecological support systems when they search collaboratively, with and for their family members, to problem solve. This is a case study of three families working in collaboration with each other. This case study informs analytical generalizations and theory-building rather than statistical generalizations about families. Practical implications: Designers need to recognize that children and youth are using the same tools as adults to seek high-level critical information. This study’s model suggests that if parents and children are negotiating information seeking with the same technology tools but different funds of knowledge, experience levels and skills, the presentation of information (e.g. online search results, information visualizations) needs to accommodate different levels of understanding. This study recommends designers work closely with marginalized communities through participatory design methods to better understand how interfaces and visuals can help accommodate youth invisible work. Social implications: The authors have demonstrated in this study that learning and engaging in family online searching is not only vital to the development of individual and digital literacy skills, it is a part of family learning. While community services, libraries and schools have a responsibility to support individual digital and information literacy development, this study’s model highlights the need to recognize funds of knowledge, family resiliency and asset-based learning. Schools and teachers should identify and harness youth invisible work as a form of learning at home. The authors believe educators can do this by highlighting the importance of information problem solving in homes and youth in their families. Libraries and community centers also play a critical role in supporting parents and adults for technical assistance (e.g. WiFi access) and information resources. Originality/value: This study’s work indicates new conditions fostering productive joint media engagement (JME) around OSB. This study contributes a generative understanding that promotes studying and designing for JME, where family responsibility is the focus.

     
    more » « less
  5. This work describes the design of real-time dance-based interaction with a humanoid robot, where the robot seeks to promote physical activity in children by taking on multiple roles as a dance partner. It acts as a leader by initiating dances but can also act as a follower by mimicking a child’s dance movements. Dances in the leader role are produced by a sequence-to-sequence (S2S) Long Short-Term Memory (LSTM) network trained on children’s music videos taken from YouTube. On the other hand, a music orchestration platform is implemented to generate background music in the follower mode as the robot mimics the child’s poses. In doing so, we also incorporated the largely unexplored paradigm of learning-by-teaching by including multiple robot roles that allow the child to both learn from and teach to the robot. Our work is among the first to implement a largely autonomous, real-time full-body dance interaction with a bipedal humanoid robot that also explores the impact of the robot roles on child engagement. Importantly, we also incorporated in our design formal constructs taken from autism therapy, such as the least-to-most prompting hierarchy, reinforcements for positive behaviors, and a time delay to make behavioral observations. We implemented a multimodal child engagement model that encompasses both affective engagement (displayed through eye gaze focus and facial expressions) as well as task engagement (determined by the level of physical activity) to determine child engagement states. We then conducted a virtual exploratory user study to evaluate the impact of mixed robot roles on user engagement and found no statistically significant difference in the children’s engagement in single-role and multiple-role interactions. While the children were observed to respond positively to both robot behaviors, they preferred the music-driven leader role over the movement-driven follower role, a result that can partly be attributed to the virtual nature of the study. Our findings support the utility of such a platform in practicing physical activity but indicate that further research is necessary to fully explore the impact of each robot role. 
    more » « less