An official website of the United States government
Technological tools, like virtual assistants (aka chatbots), have been ubiquitous in people’s day to day. The challenge becomes how educators leverage digital omnipresence to benefit the learning environment. Using a curated chatbot allows educators to reach more students with instructor-approved information, particularly in large classrooms. Students can receive direct responses and guidance towards course materials, and educators may have less to manage by automating routine queries to a chatbot. Data from the 293 collected logs from 232 unique student users provide insight into the information students are interested in when tasked to complete an essay assignment contextualizing chemistry through a sustainability lens. Using process mining to show how students seek information, the extracted 5185 events from the logs created 204 unique pathways from students’ actions in the curated chatbot. Additional text mining was done on the 116 freeform queries students typed into the curated chatbot. Results from both analyses showed that students were primarily sought information on the sustainability context of the writing assignment in their queries and that the curated chatbot can provide personalized assistance, responding to students’ unique pathways of seeking help. A selection of subsets of student users’ chatbot interactions, limitations of the study, and extension of the curated chatbot use in other classroom tasks and settings were discussed.
more »
« less
Developing a Curated Chatbot as an Exploratory Communication Tool for Chemistry Learning
In a technology-centric world, leveraging digital tools such as chatbots allows educators to engage students in ways that may be more accessible for both parties, particularly in large lecture classrooms. This report details the development of an interactive web-based chatbot to curate content for writing about chemistry in context. Students were assigned a 500-word paper where they discuss general chemistry concepts through the lens of a timely, sustainability-related topic, i.e., water footprint, carbon footprint, or embodied carbon. Discussed herein are the development of the decision tree, the chatbot’s components, and results from the initial implementation in a large lecture general chemistry classroom. Over 78% of the 347 enrolled students (271) used the chatbot over 350 times in the 3 weeks leading up to the assigned due date of the paper. Eighty-three percent of the interactions were captured for further analysis, which showed that 22% of students used the chatbot more than once. Forty-six percent of recorded interactions were used to aid students in developing or refining their idea for the assignment. The curated chatbot technology reported here for writing assignments in chemistry can be readily adapted to other aspects of coursework in chemistry.
more »
« less
- Award ID(s):
- 2235600
- PAR ID:
- 10487348
- Publisher / Repository:
- American Chemical Society Publications
- Date Published:
- Journal Name:
- Journal of Chemical Education
- Volume:
- 100
- Issue:
- 10
- ISSN:
- 0021-9584
- Page Range / eLocation ID:
- 4092 to 4098
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Conflation of sex and gender is implicated in the development of essentialist thinking, which has been linked to the justification of systems of prejudice in modern society. This exploratory study presents findings from a person randomized control trial conducted with 460 students in 8th–10th grade that investigated the extent to which students conflate sex and gender in their writing about genetics. Students were randomly assigned to one of three short readings that either (1) explained the genetics of sex in plants; (2) explained the genetics of sex in humans; or (3) refuted neuro-genetic essentialism, offering instead a social explanation for why women receive fewer PhDs in science, technology, mathematics, and engineering than men. While previous findings from the authors suggest links between the condition students were assigned to and psychological indicators related to essentialist thinking, no work was done to investigate how students’ use of language might implicate cognitive conflation as a possible factor in understanding these results. In this study, student responses to a constructed response writing task given after the reading were analyzed to investigate the use of sex and gender language. Students in all three conditions used both sex and gender language. However, students in the refutational text condition tended to use sex and gender language deliberately in order to explain PhD attainment, while students in the traditional genetics conditions used the terms interchangeably, suggesting subconscious conflation. Students in the genetics of human sex condition were more likely to manifest this conflation than students in the genetics of plant sex condition. Implications for instruction are discussed.more » « less
-
Abstract BackgroundUsing simulations in science instruction can help make abstract topics more concrete and boost students' understanding. AimsThe current research examined whether using a simulation as an exploratory learning activity before an accompanying lecture has additional learning and motivational benefits compared to a more common lecture‐then‐simulation approach. SamplesParticipants (Experiment 1,N = 168; Experiment 2,N = 357) were undergraduate students in several sections of a first‐year chemistry course. MethodsStudents were randomly assigned to explore a simulation on atomic structure either before a lecture (explore‐first condition) or after the lecture (instruct‐first condition). In Experiment 1, the simulation activity time was limited (15 min) and the activity varied in whether self‐explanation (‘why’) prompts were included. In Experiment 2, the activity time was lengthened (20 min), and only ‘why’ prompts were used. After the activity and lecture, students completed a survey and posttest. ResultsIn Experiment 1, students in the explore‐first condition scored lower on posttest conceptual knowledge scores and reported lower curiosity compared to students in the instruct‐first condition. Scores for basic facts and transfer knowledge, and self‐reported situational interest, self‐efficacy, and competence, were equal between conditions. No effects of prompt condition were found. In Experiment 2, with longer activity time, the results reversed. Students in the explore‐first condition scored equally on basic facts and higher on conceptual knowledge and transfer measures, while also reporting higher curiosity, situational interest, self‐efficacy, competence, and cognitive engagement. ConclusionWhen properly designed, placing simulations before—rather than after—lecture can deepen learning, motivation, and competence.more » « less
-
Sampson, Demetrious; Ifenthaler, Dirk; Isaías, Pedro (Ed.)This quasi-experimental study seeks to improve the conceptual quality of lesson summary essays by comparing two conditions, essay prompts with or without a list of concepts from the lesson. It is assumed that these terms can be used as “anchors” while writing. Participants (n = 90) in an Architectural Engineering undergraduate course over a two week period read the assigned textbook chapter and attended lectures and labs, then in the final lab session were asked to write a 300-word summary of the lesson content. Data for analysis consists of these essays and the end-of-unit multiple choice test. Compared to the expert essay benchmark, the essay networks of those receiving the list of terms in the writing prompt were not significantly different from those who did not receive the terms, but however were significantly more like peers essay networks, the network of the Chapter 11 PowerPoint lecture, and the network of the Chapter 9 PowerPoint lecture. In addition those receiving the list of terms in the writing prompt performed significantly better on the end-of-unit test than those not receiving the terms. Term frequency analysis indicates that only the most network central terms in the terms list showed a greater frequency in essays, the other terms frequencies were remarkably the same for both the Term and No Terms groups, suggesting a similar underlying conceptual mental model of this lesson content. More research is needed to understand how including concept terms in a writing prompt influences essay conceptual structure and test performance.more » « less
-
Chemistry education research has increasingly considered the role of affect when investigating chemistry learning environments over the past decade. Despite its popularity in educational spheres, mindset has been understudied from a chemistry-specific perspective. Mindset encompasses one's beliefs about the ability to change intelligence with effort and has been shown to be a domain-specific construct. For this reason, students’ mindset would be most relevant in chemistry if it were measured as a chemistry-specific construct. To date, no instrument has been developed for use in chemistry learning contexts. Here we present evidence supporting the development process and final product of a mindset instrument designed specifically for undergraduate chemistry students. The Chemistry Mindset Instrument (CheMI) was developed through an iterative design process requiring multiple implementations and revisions. We analyze the psychometric properties of CheMI data from a sample of introductory (general and organic) chemistry students enrolled in lecture courses. We achieved good data-model fit via confirmatory factor analysis and high reliability for the newly developed items, indicating that the instrument functions well with the target population. Significant correlations were observed for chemistry mindset with students’ self-efficacy, mastery goals, and course performance, providing external validity evidence for the construct measurement.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1021/acs.jchemed.3c00520
