Attitudes play an important role in students’ academic achievement and retention, yet quality tools to measure them are not readily available in the new field of data science. Through funding from the National Science Foundation, we are developing a family of instruments that measure attitudes toward data science in the context of an introductory, college-level course. This poster will showcase preliminary results discussing pilot instruments to assess instructors’ attitudes toward teaching data science and an inventory which captures classroom characteristics. These instruments, based on Expectancy-Value Theory, will enable data science education researchers to evaluate pedagogical innovations and measure instructional effectiveness relating to student attitudes. We invite instructors of data science courses to join in this discussion and to use these instruments for their own data science education research projects.
more »
« less
S-SOMADS: A New Survey to Measure Student Attitudes Toward Data Science
Attitudes play an important role in students’ academic achievement and retention, yet we lack quality attitude measurement instruments in the new field of data science. This paper explains the process of creating Expectancy Value Theory-based instruments for introductory, college-level data science courses, including construct development, item creation, and refinement involving content experts. The family of instruments consist of surveys measuring student attitudes, instructor attitudes, and instructor and course characteristics. These instruments will enable data science education researchers to evaluate pedagogical innovations, create course assessments, and measure instructional effectiveness relating to student attitudes. We also present plans for pilot data collection and analyses to verify the categorization of items to constructs, as well as ways in which faculty who teach introductory data science courses can be involved.
more »
« less
- Award ID(s):
- 2013392
- PAR ID:
- 10386398
- Editor(s):
- Peters, S. A.; Zapata-Cardona, L.; Bonafini, F.; Fan, A.
- Date Published:
- Journal Name:
- Bridging the Gap: Empowering & Educating Today’s Learners in Statistics. Proceedings of the 11th International Conference on Teaching Statistics (ICOTS11 2022), Rosario, Argentina.
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Peters, S. A.; Zapata-Cardona, L.; Bonafini, F.; Fan, A. (Ed.)The Motivational Attitudes in Statistics and Data Science Education Research group is developing a family of validated instruments: two instruments assessing students’ attitudes toward statistics or data science, two instruments assessing instructors’ attitudes toward teaching statistics or data science, and two sets of inventories to measure the learning environment in which the students and instructor interact. The Environment Inventories measure the institutional structures, course characteristics, and enacted classroom behaviors of both the students and instructors, all of which interact with the student and instructor background. This paper will discuss our proposed theoretical framework for the learning environment and its development.more » « less
-
A central goal of the Learning Assistant (LA) model is to improve students’ learning of science through the transformation of instructor practices. There is minimal existing research on the impact of college physics instructor experiences on their effectiveness. To investigate the association between college introductory physics instructors’ experiences with and without LAs and student learning, we drew on data from the Learning About STEM Student Outcomes (LASSO) database. The LASSO database provided us with student-level data (concept inventory scores and demographic data) for 4,365 students and course-level data (instructor experience and course features) for the students’ 93 mechanics courses. We performed Hierarchical Multiple Imputation to impute missing data and Hierarchical Linear Modeling to nest students within courses when modeling the associations be- tween instructor experience and student learning. Our models predict that instructors’ effectiveness decreases as they gain experience teaching without LAs. However, LA supported environments appear to remediate this decline in effectiveness as instructor effectiveness is maintained while they gain experience teaching with LAs.more » « less
-
Peters, S. A.; Zapata-Cardona, L.; Bonafini, F.; Fan, A. (Ed.)Attitudes matter in statistics and data science education, but previous instruments have been limited in scope, resulting in many unanswered questions. This paper discusses the Surveys of Motivational Attitudes toward Statistics and Data Science, a family of instruments designed to provide a broad understanding of university-level student and instructor attitudes as well as learning environment characteristics. Based on Expectancy Value Theory, a meta-model explains the interrelationships among the instruments, and an iterative design process is followed for survey development. Psychometric results from data collections using instruments developed thus far are presented. This is the first time a cohesive, synergistic set of instruments has been designed to work together to give a broader understanding of the state of statistics and data science education.more » « less
-
Abstract BackgroundThe first day of class helps students learn about what to expect from their instructors and courses. Messaging used by instructors, which varies in content and approach on the first day, shapes classroom social dynamics and can affect subsequent learning in a course. Prior work established the non-content Instructor Talk Framework to describe the language that instructors use to create learning environments, but little is known about the extent to which students detect those messages. In this study, we paired first day classroom observation data with results from student surveys to measure how readily students in introductory STEM courses detect non-content Instructor Talk. ResultsTo learn more about the instructor and student first day experiences, we studied 11 introductory STEM courses at two different institutions. The classroom observation data were used to characterize course structure and use of non-content Instructor Talk. The data revealed that all instructors spent time discussing their instructional practices, building instructor/student relationships, and sharing strategies for success with their students. After class, we surveyed students about the messages their instructors shared during the first day of class and determined that the majority of students from within each course detected messaging that occurred at a higher frequency. For lower frequency messaging, we identified nuances in what students detected that may help instructors as they plan their first day of class. ConclusionsFor instructors who dedicate the first day of class to establishing positive learning environments, these findings provide support that students are detecting the messages. Additionally, this study highlights the importance of instructors prioritizing the messages they deem most important and giving them adequate attention to more effectively reach students. Setting a positive classroom environment on the first day may lead to long-term impacts on student motivation and course retention. These outcomes are relevant for all students, but in particular for students in introductory STEM courses which are often critical prerequisites for being in a major.more » « less