skip to main content


Title: Sensing Affect to Empower Students: Learner Perspectives on Affect-Sensitive Technology in Large Educational Contexts
Large-scale educational settings have been common domains for affect detection and recognition research. Most research emphasizes improvements in the accuracy of affect measurement to enhance instructors’ efficiency in managing large numbers of students. However, these technologies are not designed from students’ perspectives, nor designed for students’ own usage. To identify the unique design considerations for affect sensors that consider student capacities and challenges, and explore the potential of affect sensors to support students’ self-learning, we conducted semi-structured interviews and surveys with both online students and on-campus students enrolled in large in-person classes. Drawing on these studies we: (a) propose using affect data to support students’ self-regulated learning behaviors through a “scaling for empowerment” design perspective, (b) identify design guidelines to mitigate students’ concerns regarding the use of affect data at scale, (c) provide design recommendations for the physical design of affect sensors for large educational settings.  more » « less
Award ID(s):
1842693
NSF-PAR ID:
10310022
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Learning@Scale
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Need/Motivation (e.g., goals, gaps in knowledge) The ESTEEM implemented a STEM building capacity project through students’ early access to a sustainable and innovative STEM Stepping Stones, called Micro-Internships (MI). The goal is to reap key benefits of a full-length internship and undergraduate research experiences in an abbreviated format, including access, success, degree completion, transfer, and recruiting and retaining more Latinx and underrepresented students into the STEM workforce. The MIs are designed with the goals to provide opportunities for students at a community college and HSI, with authentic STEM research and applied learning experiences (ALE), support for appropriate STEM pathway/career, preparation and confidence to succeed in STEM and engage in summer long REUs, and with improved outcomes. The MI projects are accessible early to more students and build momentum to better overcome critical obstacles to success. The MIs are shorter, flexibly scheduled throughout the year, easily accessible, and participation in multiple MI is encouraged. ESTEEM also establishes a sustainable and collaborative model, working with partners from BSCS Science Education, for MI’s mentor, training, compliance, and building capacity, with shared values and practices to maximize the improvement of student outcomes. New Knowledge (e.g., hypothesis, research questions) Research indicates that REU/internship experiences can be particularly powerful for students from Latinx and underrepresented groups in STEM. However, those experiences are difficult to access for many HSI-community college students (85% of our students hold off-campus jobs), and lack of confidence is a barrier for a majority of our students. The gap between those who can and those who cannot is the “internship access gap.” This project is at a central California Community College (CCC) and HSI, the only affordable post-secondary option in a region serving a historically underrepresented population in STEM, including 75% Hispanic, and 87% have not completed college. MI is designed to reduce inequalities inherent in the internship paradigm by providing access to professional and research skills for those underserved students. The MI has been designed to reduce barriers by offering: shorter duration (25 contact hours); flexible timing (one week to once a week over many weeks); open access/large group; and proximal location (on-campus). MI mentors participate in week-long summer workshops and ongoing monthly community of practice with the goal of co-constructing a shared vision, engaging in conversations about pedagogy and learning, and sustaining the MI program going forward. Approach (e.g., objectives/specific aims, research methodologies, and analysis) Research Question and Methodology: We want to know: How does participation in a micro-internship affect students’ interest and confidence to pursue STEM? We used a mixed-methods design triangulating quantitative Likert-style survey data with interpretive coding of open-responses to reveal themes in students’ motivations, attitudes toward STEM, and confidence. Participants: The study sampled students enrolled either part-time or full-time at the community college. Although each MI was classified within STEM, they were open to any interested student in any major. Demographically, participants self-identified as 70% Hispanic/Latinx, 13% Mixed-Race, and 42 female. Instrument: Student surveys were developed from two previously validated instruments that examine the impact of the MI intervention on student interest in STEM careers and pursuing internships/REUs. Also, the pre- and post (every e months to assess longitudinal outcomes) -surveys included relevant open response prompts. The surveys collected students’ demographics; interest, confidence, and motivation in pursuing a career in STEM; perceived obstacles; and past experiences with internships and MIs. 171 students responded to the pre-survey at the time of submission. Outcomes (e.g., preliminary findings, accomplishments to date) Because we just finished year 1, we lack at this time longitudinal data to reveal if student confidence is maintained over time and whether or not students are more likely to (i) enroll in more internships, (ii) transfer to a four-year university, or (iii) shorten the time it takes for degree attainment. For short term outcomes, students significantly Increased their confidence to continue pursuing opportunities to develop within the STEM pipeline, including full-length internships, completing STEM degrees, and applying for jobs in STEM. For example, using a 2-tailed t-test we compared means before and after the MI experience. 15 out of 16 questions that showed improvement in scores were related to student confidence to pursue STEM or perceived enjoyment of a STEM career. Finding from the free-response questions, showed that the majority of students reported enrolling in the MI to gain knowledge and experience. After the MI, 66% of students reported having gained valuable knowledge and experience, and 35% of students spoke about gaining confidence and/or momentum to pursue STEM as a career. Broader Impacts (e.g., the participation of underrepresented minorities in STEM; development of a diverse STEM workforce, enhanced infrastructure for research and education) The ESTEEM project has the potential for a transformational impact on STEM undergraduate education’s access and success for underrepresented and Latinx community college students, as well as for STEM capacity building at Hartnell College, a CCC and HSI, for students, faculty, professionals, and processes that foster research in STEM and education. Through sharing and transfer abilities of the ESTEEM model to similar institutions, the project has the potential to change the way students are served at an early and critical stage of their higher education experience at CCC, where one in every five community college student in the nation attends a CCC, over 67% of CCC students identify themselves with ethnic backgrounds that are not White, and 40 to 50% of University of California and California State University graduates in STEM started at a CCC, thus making it a key leverage point for recruiting and retaining a more diverse STEM workforce. 
    more » « less
  2. There has been dramatic growth in the number of makerspaces at educational institutions. More research is needed to understand student interactions in these spaces and how these spaces should be designed to support student learning. This project uses network analysis techniques to study the network of activities in a makerspace that lead to successful student experiences. The proposed analyses will model a makerspace as a network of interactions between equipment, staff, and students. Results from this study will help educators to 1) identify and remove previously unknown hurdles for students who rarely use the space, 2) design an effective space using limited resources, 3) understand the impact of new equipment or staff, and 4) create learning opportunities such as workshops and curriculum integration that increase student learning. The new knowledge produced by this project may be useful for maximizing equipment and support infrastructure, and for guiding new equipment purchases. Thus, the results will support further development of effective makerspaces. This project hypothesizes that network-level analyses and metrics can provide valuable insights into student learning in makerspaces and will support what-if scenarios for proposed changes in spaces. Systems modeling and analysis have been used successfully to understand complex human and biological networks. In the context of makerspaces, this technique will provide measures of interaction between system components such as students, staff, and equipment. The analyses will identify the system components that are frequently used when students work in the makerspace over multiple visits. The project will allow for the comparison of makerspaces that have different levels of integration with the curriculum and methods of student introduction (pop-up classes, tours, extra-curricular competitions, advertising, and bring a friend). Demonstration of the effectiveness of the analyses in characterizing makerspaces and the ease of data collection will help support the use of this approach in future work that compares makerspaces nationwide. Current results explore the order in which students choose to learn and use the tools in the space, which tools/features are used most frequently and how the data from the daily entry/exit surveys compares to the end-of-semester self-reports. A key question in this research, especially for making it adoptable by other universities, is if end-of-semester, self-reported data is accurate enough to create informative, actionable guidance from the network models without requiring the daily tool usage data. 
    more » « less
  3. There is little research or understanding of curricular differences between two- and four-year programs, career development of engineering technology (ET) students, and professional preparation for ET early career professionals [1]. Yet, ET credentials (including certificates, two-, and four-year degrees) represent over half of all engineering credentials awarded in the U.S [2]. ET professionals are important hands-on members of engineering teams who have specialized knowledge of components and engineering systems. This research study focuses on how career orientations affect engineering formation of ET students educated at two-year colleges. The theoretical framework guiding this study is Social Cognitive Career Theory (SCCT). SCCT is a theory which situates attitudes, interests, and experiences and links self-efficacy beliefs, outcome expectations, and personal goals to educational and career decisions and outcomes [3]. Student knowledge of attitudes toward and motivation to pursue STEM and engineering education can impact academic performance and indicate future career interest and participation in the STEM workforce [4]. This knowledge may be measured through career orientations or career anchors. A career anchor is a combination of self-concept characteristics which includes talents, skills, abilities, motives, needs, attitudes, and values. Career anchors can develop over time and aid in shaping personal and career identity [6]. The purpose of this quantitative research study is to identify dimensions of career orientations and anchors at various educational stages to map to ET career pathways. The research question this study aims to answer is: For students educated in two-year college ET programs, how do the different dimensions of career orientations, at various phases of professional preparation, impact experiences and development of professional profiles and pathways? The participants (n=308) in this study represent three different groups: (1) students in engineering technology related programs from a medium rural-serving technical college (n=136), (2) students in engineering technology related programs from a large urban-serving technical college (n=52), and (3) engineering students at a medium Research 1 university who have transferred from a two-year college (n=120). All participants completed Schein’s Career Anchor Inventory [5]. This instrument contains 40 six-point Likert-scale items with eight subscales which correlate to the eight different career anchors. Additional demographic questions were also included. The data analysis includes graphical displays for data visualization and exploration, descriptive statistics for summarizing trends in the sample data, and then inferential statistics for determining statistical significance. This analysis examines career anchor results across groups by institution, major, demographics, types of educational experiences, types of work experiences, and career influences. This cross-group analysis aids in the development of profiles of values, talents, abilities, and motives to support customized career development tailored specifically for ET students. These findings contribute research to a gap in ET and two-year college engineering education research. Practical implications include use of findings to create career pathways mapped to career anchors, integration of career development tools into two-year college curricula and programs, greater support for career counselors, and creation of alternate and more diverse pathways into engineering. Words: 489 References [1] National Academy of Engineering. (2016). Engineering technology education in the United States. Washington, DC: The National Academies Press. [2] The Integrated Postsecondary Education Data System, (IPEDS). (2014). Data on engineering technology degrees. [3] Lent, R.W., & Brown, S.B. (1996). Social cognitive approach to career development: An overivew. Career Development Quarterly, 44, 310-321. [4] Unfried, A., Faber, M., Stanhope, D.S., Wiebe, E. (2015). The development and validation of a measure of student attitudes toward science, technology, engineeirng, and math (S-STEM). Journal of Psychoeducational Assessment, 33(7), 622-639. [5] Schein, E. (1996). Career anchors revisited: Implications for career development in the 21st century. Academy of Management Executive, 10(4), 80-88. [6] Schein, E.H., & Van Maanen, J. (2013). Career Anchors, 4th ed. San Francisco: Wiley. 
    more » « less
  4. To better support engineering students and to create an inclusive and welcoming educational context, it is necessary to reimagine instructional methods and approaches. In contrast to deficit educational models that focus on perceptions of what students lack, asset-based practices focus on how students’ lived experiences can be used to enrich and strengthen their educational experiences. There is a need to support faculty in adopting existing techniques or developing new techniques in undergraduate courses, as most existing literature related to asset-based practices is focused on K-12 settings. Engineering design courses provide an ideal context for asset-based practices because the design process requires a diverse set of knowledge, experiences, and skills. Guided by self-determination theory, an understanding of implicit bias and stereotype threat, and the large existing body of research on asset-based pedagogy, we seek to support engineering student outcomes by empowering faculty with tools and strategies to incorporate asset-based practices in their courses. We are engaged in a three-year project focused on assessing the impact of asset-based practices in engineering design courses a large, public, land-grant, Hispanic-serving institution in the southwestern United States, funded by the NSF IUSE:EDU program. Here, we will summarize the design and results from our professional development for faculty, including theoretical frameworks and evidence guiding our work. We share content from our professional development, summarizing learning objectives, presentation content, and activities. Additionally, we present comments shared by instructors related to our professional development, including common barriers to implementing educational innovations in their courses. Our work will provide insights to practitioners interested in promoting inclusive classroom practices in engineering education and researchers who are translating research to practice, especially through professional development. 
    more » « less
  5. Surviving Extinction is an interactive, adaptive, digital learning experience through which students learn about the history of vertebrate evolution over the last 350 million years. This experience is self-contained, providing students with immediate feedback. It is designed to be used in a wide range of educational settings from junior high school (∼12 years old) to university level. Surviving Extinction ’s design draws on effective aspects of existing virtual field trip-based learning experiences. Most important among these is the capacity for students to learn through self-directed virtual explorations of simulated historical ecosystems and significant modern-day geologic field sites. Surviving Extinction also makes significant innovations beyond what has previously been done in this area, including extensive use of gamified elements such as collectibles and hidden locations. Additionally, it blends scientifically accurate animations with captured media via a user interface that presents an attractive, engaging, and immersive experience. Surviving Extinction has been field-tested with students at the undergraduate, high school, and pre-high school levels to assess how well it achieves the intended learning outcomes. In all settings we found significant gains pre- to post-activity on a knowledge survey with medium to large effect sizes. This evidence of learning is further supported with data from the gamified elements such as the number of locations discovered and total points earned. Surviving Extinction is freely available for use and detailed resources for educators are provided. It is appropriate for a range of undergraduate courses that cover the history of life on Earth, including ones from a biology, ecology, or geology perspective and courses for either majors or non-majors. Additionally, at the high school level, Surviving Extinction is directly appropriate to teaching adaptation, one of the disciplinary core ideas in the Next Generation Science Standards. Beyond providing this resource to the educational community, we hope that the design ideas demonstrated in Surviving Extinction will influence future development of interactive digital learning experiences. 
    more » « less