skip to main content


Title: Learning Spatial Transformations and their Math Representations through Embodied Learning in Augmented Reality
In Computer Aided Design, Computer Graphics, Robotics, etc., students suffer from inefficient and non-proficient use of the 3D modeling software due to a lack of mathematical knowledge. Deficient knowledge and skills may lead students to use the modeling software through trial-and-error without understanding the algorithms and mathematics. Spatial/geometric transformation is recognized as one of the key factors in learning 3D modeling software. This paper presents a newly developed educational Augmented Reality (AR) mobile application to help students intuitively learn the geometric reasoning of transformation matrices and the corresponding trigonometric equations through play. The application, developed in primary and advanced levels, intends to facilitate the understanding of fundamentals of spatial transformations and their mathematical representations in a self-learning approach. The results of a pilot user study conducted on 7 undergraduate students for the primary level reveal that students’ math scores improved after playing with the application.  more » « less
Award ID(s):
2119549
NSF-PAR ID:
10337670
Author(s) / Creator(s):
; ; ;
Editor(s):
Zaphiris, P.; Ioannou, A.
Date Published:
Journal Name:
Learning and Collaboration Technologies. Novel Technological Environments. HCII 2022. Lecture Notes in Computer Science.
Volume:
13329
Page Range / eLocation ID:
112–128
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper introduces a web-based interactive educational platform for 3D/polyhedral graphic statics (PGS) [1]. The Block Research Group (BRG) at ETH Zürich developed a dynamic learning and teaching platform for structural design. This tool is based on traditional graphic statics. It uses interactive 2D drawings to help designers and engineers with all skill levels to understand and utilize the methods [2]. However, polyhedral graphic statics is not easy to learn because of its characteristics in three-dimensional. All the existing computational design tools are heavily dependent on the modeling software such as Rhino or the Python-based computational framework like Compass [3]. In this research, we start with the procedural approach, developing libraries using JavaScript, Three.js, and WebGL to facilitate the construction by making it independent from any software. This framework is developed based on the mathematical and computational algorithms deriving the global equilibrium of the structure, optimizing the balanced relationship between the external magnitudes and the internal forces, visualizing the dynamic reciprocal polyhedral diagrams with corresponding topological data. This instant open-source application and the visualization interface provide a more operative platform for students, educators, practicers, and designers in an interactive manner, allowing them to learn not only the topological relationship but also to deepen their knowledge and understanding of structures in the steps for the construction of the form and force diagrams and analyze it. In the simplified single-node example, the multi-step geometric procedures intuitively illustrate 3D structural reciprocity concepts. With the intuitive control panel, the user can move the constraint point’s location through the inserted gumball function, the force direction of the form diagram will be dynamically changed from compression-only to tension and compression combined. Users can also explore and design innovative, efficient spatial structures with changeable boundary conditions and constraints through real-time manipulating both force distribution and geometric form, such as adding the number of supports or subdividing the global equilibrium in the force diagram. Eventually, there is an option to export the satisfying geometry as a suitable format to share with other fabrication tools. As the online educational environment with different types of geometric examples, it is valuable to use graphical approaches to teach the structural form in an exploratory manner. 
    more » « less
  2. There is a close relation between spatial thinking and mathematical problem-solving. This paper presents a newly developed educational Augmented Reality (AR) mobile application, BRICKxAR/T, to help students intuitively learn spatial transformations and the related mathematics through play. A pilot study with 7 undergraduate students evaluates students learning gain through a mental rotation and a math test on transformation matrices. The results show most students performed better with a higher score after learning with the app. Students found the app interesting to play and useful for learning geometric transformations and matrices. 
    more » « less
  3. null (Ed.)
    Abstract Engineering students need to spend time engaging in mathematical modeling tasks to reinforce their learning of mathematics through its application to authentic problems and real world design situations. Technological tools and resources can support this kind of learning engagement. We produced an online module that develops students’ mathematical modeling skills while developing knowledge of the fundamentals of rainfall-runoff processes and engineering design. This study examined how 251 students at two United States universities perceived mathematical modeling as implemented through the online module over a 5-year period. We found, subject to the limitation that these are perceptions from not all students, that: (a) the module allowed students to be a part of the modeling process; (b) using technology, such as modeling software and online databases, in the module helped students to understand what they were doing in mathematical modeling; (c) using the technology in the module helped students to develop their skill set; and (d) difficulties with the technology and/or the modeling decisions they had to make in the module activities were in some cases barriers that interfered with students’ ability to learn. We advocate for instructors to create modules that: (a) are situated within a real-world context, requiring students to model mathematically to solve an authentic problem; (b) take advantage of digital tools used by engineers to support students’ development of the mathematical and engineering skills needed in the workforce; and (c) use student feedback to guide module revisions. 
    more » « less
  4. This paper explains the design of a prototype desktop and augmented Virtual Reality (VR) framework as a medium to deliver instructional materials to the students in an introductory computer animation course. This framework was developed as part of a Teaching Innovation Grant to propose a cost-effective and innovative instructional frameworks to engage and stimulate students. Desktop-based virtual reality presents a 3-dimensional (3D) world using the display of a standard desktop computer available in most of the PC labs on campus. This is a required course at this university that has students not only from the primary department, but from other colleges/departments as well. Desktop VR has been chosen as a medium for this study due to the ease-of-access and affordability; this framework can be visualized and accessed with the available computers in PC labs available in university campuses. The proposed research is intended to serve as a low-cost framework that can be accessed by all students. The concepts of ‘computer graphics, modeling & animation’, instead of being presented using conventional methods such as notes or power point presentations, are presented in an interactive manner on a desktop display. This framework allows the users to interact with the objects on the display not only via the standard mouse and keyboard, but also using multiple forms of HCI such as Touchscreen, Touchpad, and 3D Mouse. Hence, the modules were developed from scratch for access via regular desktop PCs. Such a framework helps effective pedagogical strategies such as active learning (AL) and project-based learning (PBL), which are especially relevant to a highly lab-oriented course such as this course titled ‘Introduction to Animation’. Finally, the framework has also been tested on a range of VR media to check its accessibility. On the whole, this proposed framework can be used to not only teach basic modeling and animation concepts such as spatial coordinates, coordinate systems, transformation, and parametric curves, but it is also used to teach basic graphics programming concepts. Hence, instead of a touchscreen, the modules have to be developed from scratch for access via regular desktop PCs. Such a framework helps effective pedagogical strategies such as active learning (AL) and project-based learning (PBL), which are especially relevant to a highly lab-oriented course such as this animation course. 
    more » « less
  5. Robotics has emerged as one of the most popular subjects in STEM (Science, Technology, Engineering, and Mathematics) education for students in elementary, middle, and high schools, providing them with an opportunity to gain knowledge of engineering and technology. In recent years, flying robots (or drones) have also gained popularity as teaching tool to impart the fundamentals of computer programming to high school students. However, despite completing the programming course, students may still lack an understanding of the working principle of drones. This paper proposes an approach to teach students the basic principles of drone aeronautics through laboratory programming. This course was designed by professors from Vaughn College of Aeronautics and Technology for high school students who work on after-school and weekend programs during the school year or summer. In early 2021, the college applied for and was approved to offer a certificate program in UAS (Unmanned Aerial Systems) Designs, Applications, and Operations to college students by the Education Department of New York State. Later that year, the college also received a grant from the Federal Aviation Administration (FAA) to provide tuition-free early higher education for high school students, allowing them to complete the majority of the credits in the UAS certificate program while still enrolled in high school. The program aims to equip students with the hands-on skills necessary for successful careers as versatile engineers and technicians. Most of the courses in the certificate program are introductory or application-oriented, such as Introduction to Drones, Drone Law, Part 107 License, or Fundamentals of Land Surveying and Photogrammetry. However, one of the courses, Introduction to Drone Aeronautics, is more focused on the theory of drone flight and control. Organizing the lectures and laboratory of the course for high school students who are interested in pursuing the certificate can be a challenge. To create the Introduction to Drone Aeronautics course, a variety of school courses and online resources were examined. After careful consideration, the Robolink Co-drone [1] was chosen as the experimental platform for students to study drone flight, and control and stabilize a drone. However, developing a set of comprehensible lectures proved to be a difficult task. Based on the requirements of the certificate program, the lectures were designed to cover the following topics: (a) an overview of fundamentals of drone flight principles, including the forces acting on a drone such as lift, weight, drag, and thrust, as well as the selection of on-board components and trade-offs for proper payload and force balance; (b) an introduction to the proportional-integral-directive (PID) controller and its role in stabilizing a drone and reducing steady-state errors; (c) an explanation of the forces acting on a drone in different coordinates, along with coordinate transformations; and (d) an opportunity for students to examine the dynamic model of a 3D quadcopter with control parameters, but do not require them to derive the 3D drone dynamic equations. In the future, the course can be improved to cater to the diverse learning needs of the students. More interactive and accessible tools can be developed to help different types of students understand drone aeronautics. For instance, some students may prefer to apply mathematical skills to derive results, while others may find it easier to comprehend the stable flight of a drone by visualizing the continuous changes in forces and balances resulting from the control of DC motor speeds. Despite the differences in students’ mathematical abilities, the course has helped high school students appreciate that mathematics is a powerful tool for solving complex problems in the real world, rather than just a subject of abstract numbers. 
    more » « less