Humans tame the complexity of mathematical reasoning by developing hierarchies of abstractions. With proper abstractions, solutions to hard problems can be expressed concisely, thus making them more likely to be found. In this paper, we propose Learning Mathematical Abstractions (LEMMA): an algorithm that implements this idea for reinforcement learning agents in mathematical domains. LEMMA augments Expert Iteration with an abstraction step, where solutions found so far are revisited and rewritten in terms of new higher-level actions, which then become available to solve new problems. We evaluate LEMMA on two mathematical reasoning tasks--equation solving and fraction simplification--in a step-by-step fashion. In these two domains, LEMMA improves the ability of an existing agent, both solving more problems and generalizing more effectively to harder problems than those seen during training.
more »
« less
Peano: Learning Formal Mathematical Reasoning
General mathematical reasoning is computationally undecidable, but humans routinely solve new problems. Moreover, discoveries developed over centuries are taught to subsequent generations quickly. What structure enables this, and how might that inform automated mathematical reasoning? We posit that central to both puzzles is the structure of procedural abstractions underlying mathematics. We explore this idea in a case study on 5 sections of beginning algebra on the Khan Academy platform. To define a computational foundation, we introduce Peano, a theorem-proving environment where the set of valid actions at any point is finite. We use Peano to formalize introductory algebra problems and axioms, obtaining well-defined search problems. We observe existing reinforcement learning methods for symbolic reasoning to be insufficient to solve harder problems. Adding the ability to induce reusable abstractions (""tactics"") from its own solutions allows an agent to make steady progress, solving all problems. Furthermore, these abstractions induce an order to the problems, seen at random during training. The recovered order has significant agreement with the expert-designed Khan Academy curriculum, and second-generation agents trained on the recovered curriculum learn significantly faster. These results illustrate the synergistic role of abstractions and curricula in the cultural transmission of mathematics.
more »
« less
- Award ID(s):
- 1918839
- PAR ID:
- 10404355
- Date Published:
- Journal Name:
- arXivorg
- ISSN:
- 2331-8422
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Humans tame the complexity of mathematical reasoning by developing hierarchies of abstractions. With proper abstractions, solutions to hard problems can be expressed concisely, thus making them more likely to be found. In this paper, we propose Learning Mathematical Abstractions (LEMMA): an algorithm that implements this idea for reinforcement learning agents in mathematical domains. LEMMA augments Expert Iteration with an abstraction step, where solutions found so far are revisited and rewritten in terms of new higher-level actions, which then become available to solve new problems. We evaluate LEMMA on two mathematical reasoning tasks--equation solving and fraction simplification--in a step-by-step fashion. In these two domains, LEMMA improves the ability of an existing agent, both solving more problems and generalizing more effectively to harder problems than those seen during training.more » « less
-
Banu, Eliza A. (Ed.)Access to enriching science programs is not equitable, with students from affluent districts having more opportunities to develop their science, technology, engineering, and mathematics (STEM) skills than students from underserved districts. The Building Unique Inventions to Launch Discovery, Engagement, and Reasoning in STEM (BUILDERS) program was started in 2017 with support from the National Science Foundation’s ITEST program to provide students from the Alabama Black Belt with STEM opportunities to which they would otherwise have no access. This project-based learning (PBL) program uses the concept of a makerspace to allow students to explore how science and technology can be used to solve the problems that affect their own communities. During an intensive, 3-week summer experience (the BUILDERS Academy), teams of students enthusiastically use the makerspace to design, build, and test prototypes of technology-based solutions to their community problems. During this immersive PBL process, they acquire and apply STEM concepts, learn about STEM careers, and acquire valuable 21st century skills. An extension of the summer Academy into the academic year was moderately successful. Overall, these results highlight the need to make extracurricular STEM interventions available to underserved students in order to increase equitable access to practical and enriching educational experiences in STEM.more » « less
-
[This paper is part of the Focused Collection in Investigating and Improving Quantum Education through Research.] We discuss an investigation of student sensemaking and reasoning in the context of degenerate perturbation theory (DPT) in quantum mechanics. We find that advanced undergraduate and graduate students in quantum physics courses often struggled with expertlike sensemaking and reasoning to solve DPT problems. The sensemaking and reasoning were particularly challenging for students as they tried to integrate physical and mathematical concepts to solve DPT problems. Their sensemaking showed local coherence but lacked global consistency with different knowledge resources getting activated in different problem-solving tasks even if the same concepts were applicable. Depending upon the issues involved in the DPT problems, students were sometimes stuck in the “physics mode” or “math mode” and found it challenging to coordinate and integrate the physics and mathematics appropriately to solve quantum mechanics problems involving DPT. Their sensemaking shows the use of various reasoning primitives. It also shows that some advanced students struggled with self-monitoring and checking their answers to make sure they were consistent across different problems. Some also relied on memorized information, invoked authority, and did not make appropriate connections between their DPT problem solutions and the outcomes of experiments. Advanced students in quantum mechanics often displayed analogous patterns of challenges in sensemaking and reasoning as those that have been found in introductory physics. Student sensemaking and reasoning show that these advanced students are still developing expertise in this novel quantum physics domain as they learn to integrate physical and mathematical concepts. Published by the American Physical Society2024more » « less
-
This Innovative Practice Work in Progress presents progress in developing exercises for high school students incorporating level-appropriate mathematics into robotics activities. We assume mathematical foundations ranging from algebra to precalculus, whereas most prior work on integrating mathematics into robotics uses only very elementary mathematical reasoning or, at the other extreme, is comprised of technical papers or books using calculus and other advanced mathematics. The exercises suggested are relevant to any differential-drive robot, which is an appropriate model for many different varieties of educational robots. They guide students towards comparing a variety of natural navigational strategies making use of typical movement primitives. The exercises align with Common Core State Standards for Mathematics.more » « less
An official website of the United States government

