skip to main content


Title: Exploring Predictors of Achievement-Goal Profile Stability during Mathematics Learning in an Intelligent Tutoring System
Using archived student data for middle and high school students’ mathematics-focused intelligent tutoring system (ITS) learning collected across a school year, this study explores situational, achievement-goal latent profile membership and the stability of these profiles with respect to student demographics and dispositional achievement goal scores. Over 65% of students changed situational profile membership at some time during the school year. Start-of-year dispositional motivation scores were not related to whether students remained in the same profile across all unit-level measurements. Grade level was predictive of profile stability. Findings from the present study should shed light on how in-the-moment student motivation fluctuates while students are engaged in ITS math learning. Present findings have potential to inform motivation interventions designed for ITS math learning.  more » « less
Award ID(s):
1934745
NSF-PAR ID:
10353232
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Proceedings of The Third Workshop of the Learner Data Institute , The 15th International Conference on Educational Data Mining (EDM 2022)
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Building on recent work related to measuring situational, in-the-moment motivation and the stability of motivation profiles, this study explores the nature of situational motivation profiles constructed with measurements of achievement goals during middle and high school students’ algebra-focused intelligent tutoring system (ITS) learning during an academic semester. The results of multi-level profile analyses nesting multiple timepoints within students indicates the presence of four distinct profiles, with similar characteristics to those found in previous studies on dispositional achievement goals in mathematics for similar-aged students. Present findings have potential implications for designing effective motivation interventions during ITS learning. 
    more » « less
  2. Abstract

    Teachers play a critical role in successfully implementing science education reforms in the United States to provide high‐quality science learning opportunities to all students. However, the differentiated ways in which teachers make decisions about their science teaching are not well understood. This study takes a person‐centered approach by applying latent profile analysis to examine how cognitive (pedagogical content knowledge) and motivational (instructional goal orientations, self‐efficacy beliefs, and reform values) characteristics combine to form science teacher profiles in middle school. Predictors of profile membership (bachelor's degree, school %FRL) and both teacher (science instructional practices) and student (science achievement, engagement, and self‐efficacy) outcomes related to the teacher profiles were also examined. Five science teacher profiles were identified (severely discouraged but reform oriented, discouraged but reform oriented, conventional, confident and mastery oriented, and confident with multiple goal approaches) that represented unique configurations of cognitive and motivation characteristics. Additionally, findings showed that the teacher profiles were significantly related to three dimensions of science instructional practice including communication, discourse, and reasoning. Finally, the teacher profiles were significantly related to student science achievement and motivational outcomes. Implications for differentiated approaches to teacher professional learning and supports for science instruction are discussed.

     
    more » « less
  3. This work in progress is motivated by a self-study conducted at Texas State University. The study revealed that the average second year science, technology, engineering and math (STEM) student retention rate is 56% vs. 67% for all majors, and that 16% of STEM majors are female while 57% of all undergraduate students are female. Using these statistics, the authors identified the need to offer motivating experiences to freshman in STEM while creating a sense of community among other STEM students. This paper reports on the impact of two interventions designed by the authors and aligned with this need. The interventions are: (1) a one-day multi- disciplinary summer orientation (summer15) to give participants the opportunity to undertake projects that demonstrate the relevance of spatial and computational thinking skills and (2) a subsequent six-week spatial visualization skills training (fall 2015) for students in need to refine these skills. The interventions have spatial skills as a common topic and introduce participants to career applications through laboratory tours and talks. Swail et al.1 mentions that the three elements to address in order to best support students’ persistence and achievement are cognitive, social, and institutional factors. The interventions address all elements to some extent and are part of an NSF IUSE grant (2015-2018) to improve STEM retention. The summer 2015 orientation was attended by 17 freshmen level students in Physics, Engineering, Engineering Technology, and Computer Science. The orientation was in addition to “Bobcat Preview”, a separate mandatory one-week length freshman orientation that includes academic advising and educational and spirit sessions to acclimate students to the campus. The effectiveness of the orientation was assessed through exit surveys administered to participants. Current results are encouraging; 100% of the participants answered that the orientation created a space to learn about science and engineering, facilitated them to make friends and encouraged peer interaction. Eighty percent indicated that the orientation helped them to build confidence in their majors. Exit survey findings were positively linked to a former exit survey from an orientation given to a group of 18 talented and low-income students in 2013. The training on refining spatial visualization skills connects to the summer orientation by its goals. It offers freshman students in need to refine spatial skills a further way to increase motivation to STEM and create community among other students. It is also an effective approach to support students’ persistence and achievement. Bairaktarova et al.2 mention that spatial skills ability is gradually becoming a standard assessment of an individual’s likelihood to succeed as an engineer. Metz et al.3 report that well-developed spatial skills have been shown to lead to success in Engineering and Technology, Computer Science, Chemistry, Computer Aided Design and Mathematics. The effectiveness of the fall 2015 training was assessed through comparison between pre and post tests results and exit surveys administered to participants. All participants improved their pre-training scores and average improvement in students’ scores was 18.334%. 
    more » « less
  4. This work in progress is motivated by a self-study conducted at Texas State University. The study revealed that the average second year science, technology, engineering and math (STEM) student retention rate is 56% vs. 67% for all majors, and that 16% of STEM majors are female while 57% of all undergraduate students are female. Using these statistics, the authors identified the need to offer motivating experiences to freshman in STEM while creating a sense of community among other STEM students. This paper reports on the impact of two interventions designed by the authors and aligned with this need. The interventions are: (1) a one-day multi- disciplinary summer orientation (summer15) to give participants the opportunity to undertake projects that demonstrate the relevance of spatial and computational thinking skills and (2) a subsequent six-week spatial visualization skills training (fall 2015) for students in need to refine these skills. The interventions have spatial skills as a common topic and introduce participants to career applications through laboratory tours and talks. Swail et al.[1] mentions that the three elements to address in order to best support students’ persistence and achievement are cognitive, social, and institutional factors. The interventions address all elements to some extent and are part of an NSF IUSE grant (2015-2018) to improve STEM retention. The summer 2015 orientation was attended by 17 freshmen level students in Physics, Engineering, Engineering Technology, and Computer Science. The orientation was in addition to “Bobcat Preview”, a separate mandatory one-week length freshman orientation that includes academic advising and educational and spirit sessions to acclimate students to the campus. The effectiveness of the orientation was assessed through exit surveys administered to participants. Current results are encouraging; 100% of the participants answered that the orientation created a space to learn about science and engineering, facilitated them to make friends and encouraged peer interaction. Eighty percent indicated that the orientation helped them to build confidence in their majors. Exit survey findings were positively linked to a former exit survey from an orientation given to a group of 18 talented and low-income students in 2013. The training on refining spatial visualization skills connects to the summer orientation by its goals. It offers freshman students in need to refine spatial skills a further way to increase motivation to STEM and create community among other students. It is also an effective approach to support students’ persistence and achievement. Bairaktarova et al.[2] mention that spatial skills ability is gradually becoming a standard assessment of an individual’s likelihood to succeed as an engineer. Metz et al.[3] report that well-developed spatial skills have been shown to lead to success in Engineering and Technology, Computer Science, Chemistry, Computer Aided Design and Mathematics. The effectiveness of the fall 2015 training was assessed through comparison between pre and post tests results and exit surveys administered to participants. All participants improved their pre-training scores and average improvement in students’ scores was 18.334%. 
    more » « less
  5. Understanding the underlying psychological constructs that affect undergraduate engineering students’ academic achievement and persistence can inform curricular and programmatic changes in engineering education, with the goal of increasing access and advancement in engineering for a diverse population of students. As part of a larger study examining student experiences in a civil engineering department undergoing curricular and cultural changes, this quantitative study investigated the relationship between goal orientation, agency, and time-oriented motivation, differences in this relationship across academic years, and potential influences from personality types. The larger project seeks to examine the motivation, identity, and sense of belonging for undergraduate civil engineering students; this paper seeks to construct a conceptual model explaining the interactive nature of some of these constructs. A previously tested and established survey that draws from multiple theories of motivation and other affective factors such as agency and identity, and that includes Big 5 personality constructs, was used to collect data from second, third-and fourth-year civil engineering students over a two-year period. Prior studies have focused on the instrument’s latent constructs with sense of belonging. However, no analysis has been conducted to examine how some of the constructs influence each other. Specific latent constructs of goal orientation, agency (students’ beliefs that their career in science or engineering can lead to positive effects on the world), FTP, and personality were selected for secondary data analysis based on theory presented in the literature about relationships between motivation, goal setting, agency, and student perceptions of their future. The sample size of respondents was 843; data cleaning and deletion of missing data (65cases; 7.7%) resulted in a final sample size of 778(92.3% of the original data). This included328 second year, 294 third year and 156 fourth year students. Statistical analyses and modeling included bivariate correlational analysis, MANOVA and MANCOVA. Results indicated significant correlation between goal orientation, agency, and time-oriented motivation. Furthermore, differences in these constructs between academic years and personality type influenced the relationship. FTP differed between sophomores and seniors, with seniors having higher scores, suggesting motivation increases as time in the program increases. Personality significantly influenced these relationships in different ways but had the strongest effect on agency. The findings that certain types of people are not only motivated to go into civil engineering but believe their major will make a difference in the world, have implications for educational practice. Results align with current literature but also shed light onto the effects of personality on time-oriented motivation and agency, expanding theory in engineering education. Further research is needed to determine if the effects of personality hold true for other engineering and science majors. 
    more » « less