An official website of the United States government
In a technology-centric world, leveraging digital tools such as chatbots allows educators to engage students in ways that may be more accessible for both parties, particularly in large lecture classrooms. This report details the development of an interactive web-based chatbot to curate content for writing about chemistry in context. Students were assigned a 500-word paper where they discuss general chemistry concepts through the lens of a timely, sustainability-related topic, i.e., water footprint, carbon footprint, or embodied carbon. Discussed herein are the development of the decision tree, the chatbot’s components, and results from the initial implementation in a large lecture general chemistry classroom. Over 78% of the 347 enrolled students (271) used the chatbot over 350 times in the 3 weeks leading up to the assigned due date of the paper. Eighty-three percent of the interactions were captured for further analysis, which showed that 22% of students used the chatbot more than once. Forty-six percent of recorded interactions were used to aid students in developing or refining their idea for the assignment. The curated chatbot technology reported here for writing assignments in chemistry can be readily adapted to other aspects of coursework in chemistry.
more »
« less
This content will become publicly available on November 12, 2025
Understanding Student Help-Seeking for Contextualizing Chemistry through Curated Chatbot Data Analysis
Technological tools, like virtual assistants (aka chatbots), have been ubiquitous in people’s day to day. The challenge becomes how educators leverage digital omnipresence to benefit the learning environment. Using a curated chatbot allows educators to reach more students with instructor-approved information, particularly in large classrooms. Students can receive direct responses and guidance towards course materials, and educators may have less to manage by automating routine queries to a chatbot. Data from the 293 collected logs from 232 unique student users provide insight into the information students are interested in when tasked to complete an essay assignment contextualizing chemistry through a sustainability lens. Using process mining to show how students seek information, the extracted 5185 events from the logs created 204 unique pathways from students’ actions in the curated chatbot. Additional text mining was done on the 116 freeform queries students typed into the curated chatbot. Results from both analyses showed that students were primarily sought information on the sustainability context of the writing assignment in their queries and that the curated chatbot can provide personalized assistance, responding to students’ unique pathways of seeking help. A selection of subsets of student users’ chatbot interactions, limitations of the study, and extension of the curated chatbot use in other classroom tasks and settings were discussed.
more »
« less
- Award ID(s):
- 2235600
- PAR ID:
- 10575371
- Publisher / Repository:
- American Chemical Society Publications
- Date Published:
- Journal Name:
- Journal of Chemical Education
- Volume:
- 101
- Issue:
- 11
- ISSN:
- 0021-9584
- Page Range / eLocation ID:
- 4837 to 4846
- Subject(s) / Keyword(s):
- First-Year Undergraduate, Communication, Web-Based Learning, Student-Centered Learning, Interdisciplinary, Student Writing, Digital Assistant, Applications of Chemistry
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This paper investigates the implementation of AI-driven chatbots as a solution to streamline academic advising and improve the student experience. Through a review of preliminary results from the Nittany Advisor chatbot, we show how AI chatbots can boost advising efficiency, increase student satisfaction, and examine how chatbots can provide information on course requirements, prerequisites, and academic policies while suggesting the need for human intervention for more complex queries. We conclude that AI chatbots hold considerable promise for transforming academic advising by addressing routine questions, streamlining access to crucial information, and fostering a more responsive and supportive educational environment.more » « less
-
Query understanding plays a key role in exploring users’ search intents. However, it is inherently challenging since it needs to capture semantic information from short and ambiguous queries and often requires massive task-specific labeled data. In recent years, pre-trained language models (PLMs) have advanced various natural language processing tasks because they can extract general semantic information from large-scale corpora. However, directly applying them to query understanding is sub-optimal because existing strategies rarely consider to boost the search performance. On the other hand, search logs contain user clicks between queries and urls that provide rich users’ search behavioral information on queries beyond their content. Therefore, in this paper, we aim to fill this gap by exploring search logs. In particular, we propose a novel graph-enhanced pre-training framework, GE-BERT, which leverages both query content and the query graph to capture both semantic information and users’ search behavioral information of queries. Extensive experiments on offline and online tasks have demonstrated the effectiveness of the proposed framework.more » « less
-
The volume, variety, and velocity of different data, e.g., simulation data, observation data, and social media data, are growing ever faster, posing grand challenges for data discovery. An increasing trend in data discovery is to mine hidden relationships among users and metadata from the web usage logs to support the data discovery process. Web usage log mining is the process of reconstructing sessions from raw logs and finding interesting patterns or implicit linkages. The mining results play an important role in improving quality of search-related components, e.g., ranking, query suggestion, and recommendation. While researches were done in the data discovery domain, collecting and analyzing logs efficiently remains a challenge because (1) the volume of web usage logs continues to grow as long as users access the data; (2) the dynamic volume of logs requires on-demand computing resources for mining tasks; (3) the mining process is compute-intensive and time-intensive. To speed up the mining process, we propose a cloud-based log-mining framework using Apache Spark and Elasticsearch. In addition, a data partition paradigm, logPartitioner, is designed to solve the data imbalance problem in data parallelism. As a proof of concept, oceanographic data search and access logs are chosen to validate performance of the proposed parallel log-mining framework.more » « less
-
Like many of National Academy of Engineering’s consensus studies, the 2018 Pathways report tells us what we maybe knew, but nevertheless needed to hear: students enter engineering education from diverse points of origin, and continue through to careers that are as likely beyond engineering as it is within it. However, a close reading of the report also reveals two voices. On the one hand, educators and administrators who were eager to point out that engineering can serve as rigorous preparation for a variety of subsequent occupations; and a smaller number of educators and practitioners such as NAE staff members, who in being aware of the literature on women and minorities in education, make the point that students enter engineering with diverse backgrounds and preparation, and this impacts their educational experience and eventual diversity of the career pathways they take. In this paper, we wish to present some preliminary results on student perspectives on how they navigate through their own educational transformation. What we provide is an early analysis of interview data gained from student interviews, which point to how student pathways are determined in largely interactionist terms, namely through their interactions with other students, instructors, and other staff. How students experience, and emerge out of well-known phenomena such as imposter’s syndrome (Parkman 2016), race and gender dynamics in group work (Rosser 1998), peer study groups, family obligations and influence, and their willingness or discomfort in engaging with support services shape what choices they make about their degree program, much of which is less about a departure from the field as they are about formative decisions on how they plan to chart their career going forward.more » « less
