skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: #let’s-discuss: Analyzing Students’ Use of Emoji when Interacting with Course Readings
Abstract Emoji are commonly used in social media to convey affects, emotions, and attitudes. While popular in social media, their use in educational contexts has been sparsely studied even though emoji can be a natural way for students to express what they are feeling about the learning material. This paper studies how students use instructor-selected emoji when relating to and engaging with educational content. We use an online platform for collaborative annotations where discussions are embedded into the readings for the course. We also make it possible for students to use 11 unique emoji-hashtag pairings to express their thoughts and feelings about the readings and the ongoing discussion. We provide an empirical analysis of the usage of these emoji-hashtag pairs by over 1,800 students enrolled in different offerings of an introductory biology course from multiple academic terms. We also introduce a heat map, which allows the instructional team to visualize the distribution and types of emoji used by students in different parts of the reading material. To evaluate the heat map, we conducted a user study with five instructors/TAs. We found that instructors/TAs use the heat map as a tool for identifying textbook sections that students find difficult and/or interesting and plan to use it to help them design the online content for future classes. Finally, we introduce a computational analysis for predicting emoji/hashtag pairs based on the content of a given student post. We use pre-trained deep learning language models (BERT) to predict the emoji attached to a student’s post and then study the extent to which this model generated in an introductory biology course can be generalized to predict student emoji usage in other courses.  more » « less
Award ID(s):
1915724
PAR ID:
10505793
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
Springer Science + Business Media
Date Published:
Journal Name:
International Journal of Artificial Intelligence in Education
ISSN:
1560-4292
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Mitrovic, A.; Bosch, N. (Ed.)
    Emoji are commonly used in social media to convey attitudes and emotions. While popular, their use in educational contexts has been sparsely studied. This paper reports on the students’ use of emoji in an online course forum in which students annotate and discuss course material in the margins of the online textbook. For this study, instructors created 11 custom emoji-hashtag pairs that enabled students to quickly communicate affects and reactions in the forum that they experienced while interacting with the course material. Example reporting includes, inviting discussion about a topic, declaring a topic as interesting, or requesting assistance about a topic. We analyze emoji usage by over 1,800 students enrolled in multiple offerings of the same course across multiple academic terms. The data show that some emoji frequently appear together in posts associated with the same paragraphs, suggesting that students use the emoji in this way to communicating complex affective states. We explore the use of computational models for predicting emoji at the post level, even when posts are lacking emoji. This capability can allow instructors to infer information about students’ affective states during their ”at home” interactions with course readings. Finally, we show that partitioning the emoji into distinct groups, rather than trying to predict individual emoji, can be both of pedagogical value to instructors and improve the predictive performance of our approach using the BERT language model. Our procedure can be generalized to other courses and for the benefit of other instructors. 
    more » « less
  2. Learning standards for biology courses have called for increasing statistics content. Little is known, however, about biology students’ attitudes towards statistics content and what students actually learn about statistics in these courses. This study aims to uncover changes in attitudes and content knowledge in statistics for students in biology courses. One hundred thirty-four introductory biology students across five different instructors participated in a pre-post study of statistical thinking and attitudes toward statistics. Students performed better on the statistics conceptual inventory at the end of a biology course compared to the beginning. Student attitudes showed no change. These preliminary results suggest the potential importance for laying a conceptual foundation in statistics prior to taking biology courses with little formal statistical instruction. 
    more » « less
  3. MacDonald, Laura J (Ed.)
    ABSTRACT Building rapport between instructors and students is a challenge, especially in large classes and in online environments. Previous work has shown that non-content Instructor Talk can foster positive student-teacher relationships, but less is known about non-content talk in electronic instructor messages. Here, we used the established Instructor Talk framework to craft positively phrased electronic messages that were sent through the course’s learning management system to students enrolled in an introductory biology course at a large public institution. We examined both close- and open-ended survey responses (n= 226) to assess students’ perceptions of the electronic messages, the course, and their instructor. Of the established Instructor Talk categories, the building student/instructor relationship category was most memorable to students. Encouragingly, 61% of students indicated they “liked the course more” and 88% indicated they “liked the instructor more” in response to the electronic messages. This demonstrates that implementing positively phrased Instructor Talk into electronic communication is an effective way to build rapport between instructors and students. 
    more » « less
  4. With the onset of COVID-19, colleges and universities moved to emergency remote teaching, and instructors immediately adjusted their curricula. Many instructors adapted or developed new online lessons that they subsequently published as Open Educational Resources (OERs). While much has been examined related to how entire course designs evolved during this period, the same attention has not been paid to how individual lessons were structured to meet online learners’ needs. As such, we evaluated OER lessons for the integration of universal design for learning (UDL) guidelines and active learning strategies. We evaluated OER lessons published in CourseSource, which is an open-access, peer-reviewed journal that focuses on biology lessons implemented in undergraduate classrooms and provides the necessary details and supporting materials to replicate the lesson. We found that biology instructors used a variety of UDL guidelines and active learning strategies to encourage student learning and engagement in online teaching environments. This study also provides a collection of OER online lessons that instructors and educational developers can use to inform the practice of engaging biology students. 
    more » « less
  5. Abstract BackgroundThe first day of class helps students learn about what to expect from their instructors and courses. Messaging used by instructors, which varies in content and approach on the first day, shapes classroom social dynamics and can affect subsequent learning in a course. Prior work established the non-content Instructor Talk Framework to describe the language that instructors use to create learning environments, but little is known about the extent to which students detect those messages. In this study, we paired first day classroom observation data with results from student surveys to measure how readily students in introductory STEM courses detect non-content Instructor Talk. ResultsTo learn more about the instructor and student first day experiences, we studied 11 introductory STEM courses at two different institutions. The classroom observation data were used to characterize course structure and use of non-content Instructor Talk. The data revealed that all instructors spent time discussing their instructional practices, building instructor/student relationships, and sharing strategies for success with their students. After class, we surveyed students about the messages their instructors shared during the first day of class and determined that the majority of students from within each course detected messaging that occurred at a higher frequency. For lower frequency messaging, we identified nuances in what students detected that may help instructors as they plan their first day of class. ConclusionsFor instructors who dedicate the first day of class to establishing positive learning environments, these findings provide support that students are detecting the messages. Additionally, this study highlights the importance of instructors prioritizing the messages they deem most important and giving them adequate attention to more effectively reach students. Setting a positive classroom environment on the first day may lead to long-term impacts on student motivation and course retention. These outcomes are relevant for all students, but in particular for students in introductory STEM courses which are often critical prerequisites for being in a major. 
    more » « less