skip to main content


Title: Students’ written homework responses using digital games in Inquiry-Oriented Linear Algebra
In this report, we characterize seven of twenty-five students’ responses to a single written homework assignment from the Spring 2021 academic semester. The homework was designed to incorporate the Vector Unknown 2D digital game to investigate how students answered questions about span and linear independence after playing various levels of the game. We present our modification of the roles and characteristics framework of Zandieh et al. (2019), our identification of students’ grammatical use of game language and math language, as well as the results of analyzing students’ homework responses using our framework.  more » « less
Award ID(s):
1712524
NSF-PAR ID:
10346130
Author(s) / Creator(s):
; ;
Editor(s):
Karunakaran, S.; Higgins, A.
Date Published:
Journal Name:
Proceedings of the Annual Conference on Research in Undergraduate Mathematics Education
ISSN:
2474-9346
Page Range / eLocation ID:
54-62
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. When confronted with systematic racism, social justice, and equity issues, engineering and STEM education often assumes that these topics will be covered in other courses and are not relevant to STEM. However, engineering as a discipline has one of the greatest effects on society’s well-being. From the raw materials used, products created, and emissions generated, all aspects of engineering have direct and indirect impacts on humanity. Our current engineering education project works with upper elementary and middle school teachers to apply a culturally relevant engineering design (CRED) framework within their classrooms. This framework is adapted from UTeachEngineering and culturally relevant pedagogy from Gay and Billings is embedded within each step of the design process. The North Dakota Native American Essential Understandings are used to frame and inform the culturally relevant pedagogy. Tribal elder’s stories and experiences are centered along with community leaders in each of the school’s communities. Responses from students and teachers has been overwhelmingly positive. Teachers have noticed increased engagement from all students when cultural and community leaders have been invited into the classroom and involved in the engineering design process. Students who normally do not see themselves represented in STEM professions have taken active leadership roles in their group’s engineering design process. Teachers have also recognized that culturally relevant pedagogy can be utilized in all aspects of their curricula. With the success of the project in elementary and middle school classrooms, the question then became, how can we see similar success in our college classrooms? When brainstorming how to incorporate culture and community in our curricula it became apparent that best practices in engineering education have the opportunity to intentionally involve community and cultural leaders. ABET learning outcomes require the “consideration of public health, safety, and welfare” in engineering design and “the impact of engineering solutions in global, economic, environmental, and societal contexts.” When making engineering design decisions, who will be affected if there is an accidental release of chemicals to the environment? Which communities are affected by global warming? Will the public be able to afford the new product that is being produced? Will the new processes or products add value to people’s lives? And how do we train future engineers to consider all community members, not just those who look like them, but those from the most marginalized groups? This talk will introduce our culturally relevant engineering design framework, provide ways to include community and cultural leaders within courses, and how, with the help of Northwestern’s Anti-Racism, Diversity, Equity and Inclusion resources, to create homework problems that reflect social justice and equity issues within engineering 
    more » « less
  2. null (Ed.)
    Structured Query Language (SQL), the standard language for relational database management systems, is an essential skill for software developers, data scientists, and professionals who need to interact with databases. SQL is highly structured and presents diverse ways for learners to acquire this skill. However, despite the significance of SQL to other related fields, little research has been done to understand how students learn SQL as they work on homework assignments. In this paper, we analyze students' SQL submissions to homework problems of the Database Systems course offered at the University of Illinois at Urbana-Champaign. For each student, we compute the Levenshtein Edit Distances between every submission and their final submission to understand how students reached their final solution and how they overcame any obstacles in their learning process. Our system visualizes the edit distances between students' submissions to a SQL problem, enabling instructors to identify interesting learning patterns and approaches. These findings will help instructors target their instruction in difficult SQL areas for the future and help students learn SQL more effectively. 
    more » « less
  3. Automatic short answer grading is an important research direction in the exploration of how to use artificial intelligence (AI)-based tools to improve education. Current state-of-theart approaches use neural language models to create vectorized representations of students responses, followed by classifiers to predict the score. However, these approaches have several key limitations, including i) they use pre-trained language models that are not well-adapted to educational subject domains and/or student-generated text and ii) they almost always train one model per question, ignoring the linkage across question and result in a significant model storage problem due to the size of advanced language models. In this paper, we study the problem of automatic short answer grading for students’ responses to math questions and propose a novel framework for this task. First, we use MathBERT, a variant of the popular language model BERT adapted to mathematical content, as our base model and fine-tune it on the downstream task of student response grading. Second, we use an in-context learning approach that provides scoring examples as input to the language model to provide additional context information and promote generalization to previously unseen questions. We evaluate our framework on a real-world dataset of student responses to open-ended math questions and show that our framework (often significantly) outperform existing approaches, especially for new questions that are not seen during training. 
    more » « less
  4. Mitrovic, A ; Bosch, N (Ed.)
    Automatic short answer grading is an important research direction in the exploration of how to use artificial intelligence (AI)-based tools to improve education. Current state-of-theart approaches use neural language models to create vectorized representations of students responses, followed by classifiers to predict the score. However, these approaches have several key limitations, including i) they use pre-trained language models that are not well-adapted to educational subject domains and/or student-generated text and ii) they almost always train one model per question, ignoring the linkage across question and result in a significant model storage problem due to the size of advanced language models. In this paper, we study the problem of automatic short answer grading for students’ responses to math questions and propose a novel framework for this task. First, we use MathBERT, a variant of the popular language model BERT adapted to mathematical content, as our base model and fine-tune it on the downstream task of student response grading. Second, we use an in-context learning approach that provides scoring examples as input to the language model to provide additional context information and promote generalization to previously unseen questions. We evaluate our framework on a real-world dataset of student responses to open-ended math questions and show that our framework (often significantly) outperform existing approaches, especially for new questions that are not seen during training. 
    more » « less
  5. Automatic short answer grading is an important research direction in the exploration of how to use artificial intelligence (AI)-based tools to improve education. Current state-of-theart approaches use neural language models to create vectorized representations of students responses, followed by classifiers to predict the score. However, these approaches have several key limitations, including i) they use pre-trained language models that are not well-adapted to educational subject domains and/or student-generated text and ii) they almost always train one model per question, ignoring the linkage across question and result in a significant model storage problem due to the size of advanced language models. In this paper, we study the problem of automatic short answer grading for students’ responses to math questions and propose a novel framework for this task. First, we use MathBERT, a variant of the popular language model BERT adapted to mathematical content, as our base model and fine-tune it on the downstream task of student response grading. Second, we use an in-context learning approach that provides scoring examples as input to the language model to provide additional context information and promote generalization to previously unseen questions. We evaluate our framework on a real-world dataset of student responses to open-ended math questions and show that our framework (often significantly) outperform existing approaches, especially for new questions that are not seen during training. 
    more » « less