skip to main content

Explore Research Products in the NSF-PAR

Title: Teaching Undergraduate Artificial Intelligence Classes: An Experiment with an Attendance Requirement
We report on an experiment that we performed when we taught the undergraduate artificial intelligence class at the University of Southern California. We taught it - under very similar conditions - once with and once without an attendance requirement. The attendance requirement substantially increased the attendance of the students. It did not substantially affect their performance but decreased their course ratings across all categories in the official course evaluation, whose results happened to be biased toward the opinions of the students attending the lectures. For example, the overall rating of the instructor was 0.89 lower (on a 1-5 scale) with the attendance requirement and the overall rating of the class was 0.85 lower. Thus, the attendance requirement, combined with the policy for administering the course evaluation, had a large impact on the course ratings, which is a problem if the course ratings influence decisions on promotions, tenure, and salary increments for the instructors but also demonstrates the potential for the manipulation of course ratings.  more » « less
Award ID(s):
1724392
NSF-PAR ID:
10179967
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Symposium on Educational Advances in Artificial Intelligence (EAAI)
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; ( , JMIR Mental Health)
    Background

    Increasingly, college science courses are transitioning from a traditional lecture format to active learning because students learn more and fail less frequently when they engage in their learning through activities and discussions in class. Fear of negative evaluation (FNE), defined as a student’s sense of dread associated with being unfavorably evaluated while participating in a social situation, discourages undergraduates from participating in small group discussions, whole class discussions, and conversing one-on-one with instructors.

     Objective

    This study aims to evaluate the acceptability of a novel digital single-session intervention and to assess the feasibility of implementing it in a large enrollment college science course taught in an active learning way.

     Methods

    To equip undergraduates with skills to cope with FNE and bolster their confidence, clinical psychologists and biology education researchers developed Project Engage, a digital, self-guided single-session intervention for college students. It teaches students strategies for coping with FNE to bolster their confidence. Project Engage provides biologically informed psychoeducation, uses interactive elements for engagement, and helps generate a personalized action plan. We conducted a 2-armed randomized controlled trial to evaluate the acceptability and the preliminary effectiveness of Project Engage compared with an active control condition that provides information on available resources on the college campus.

     Results

    In a study of 282 upper-level physiology students, participants randomized to complete Project Engage reported a greater increase in overall confidence in engaging in small group discussions (P=.01) and whole class discussions (P<.001), but not in one-on-one interactions with instructors (P=.05), from baseline to immediately after intervention outcomes, compared with participants in an active control condition. Project Engage received a good acceptability rating (1.22 on a scale of –2 to +2) and had a high completion rate (>97%).

     Conclusions

    This study provides a foundation for a freely available, easily accessible intervention to bolster student confidence for contributing in class.

     Trial Registration

    OSF Registries osf.io/4ca68 http://osf.io/4ca68

     
    more » « less
  2. ( , ASEE New England annual conference)
    Over the course of several semesters, two different project-based learning approaches were used in two undergraduate engineering courses–a 100-level introductory course that covered a general education requirement on information literacy and a 300-level fluid mechanics course. One project (treatment) was an interdisciplinary service-learning project, implemented with undergraduate engineering and education students who collaborated to develop and deliver engineering lessons to fourth and fifth-grade students in a field trip model. The other projects (comparison) involved a team-based design project contained within each class. In the 100-level course, students selected their project based on personal interests and followed the engineering design process to develop, test, and redesign a prototype. In the fluid mechanics class, students designed a pumped pipeline system for a hypothetical plant. This study aimed to determine whether participating in the interdisciplinary project affected students’ evaluation of their own and their teammates’ teamwork effectiveness skills, measured using the Behaviorally Anchored Rating Scale (BARS) version of the Comprehensive Assessment of Team Member Effectiveness (CATME). The five dimensions of CATME measured in this study are (1) contribution to the team’s work, (2) interacting with teammates, (3) keeping the team on track, (4) expecting quality, and (5) having relevant knowledge, skills, and abilities (KSAs). The quantitative data from CATME were analyzed using ANCOVA. Furthermore, since data were collected over three semesters and coincided with the pre, during, and post-phases of the COVID-19 pandemic, it was possible to examine the effects of the evolving classroom constraints over the course of the pandemic on the teamwork effectiveness skills of both the treatment and comparison classes. 
    more » « less
  3. ; ( , Frontiers in Virtual Reality)
    null (Ed.)
    We study student experiences of social VR for remote instruction, with students attending class from home. The study evaluates student experiences when: (1) viewing remote lectures with VR headsets, (2) viewing with desktop displays, (3) presenting with VR headsets, and (4) reflecting on several weeks of VR-based class attendance. Students rated factors such as presence, social presence, simulator sickness, communication methods, avatar and application features, and tradeoffs with other remote approaches. Headset-based viewing and presenting produced higher presence than desktop viewing, but had less-clear impact on overall experience and on most social presence measures. We observed higher attentional allocation scores for headset-based presenting than for both viewing methods. For headset VR, there were strong negative correlations between simulator sickness (primarily reported as general discomfort) and ratings of co-presence, overall experience, and some other factors. This suggests that comfortable users experienced substantial benefits of headset viewing and presenting, but others did not. Based on the type of virtual environment, student ratings, and comments, reported discomfort appears related to physical ergonomic factors or technical problems. Desktop VR appears to be a good alternative for uncomfortable students, and students report that they prefer a mix of headset and desktop viewing. We additionally provide insight from students and a teacher about possible improvements for VR class technology, and we summarize student opinions comparing viewing and presenting in VR to other remote class technologies. 
    more » « less
  4. ; ; ; ; ( , ASEE Annual Conference proceedings)
    We are assessing the impact of an intervention (a two-day voluntary workshop) on the specific factors of self-efficacy and student integration. This workshop, called the “ChemE Camp”, takes place just before the start of fall classes and includes team-building exercises, presentations from faculty about upcoming classes, a hands-on project, a lab tour, presentations from upper-level students and alumni about their experiences in the curriculum and in industry, information about academic advising and the career fair, and some recreational games. Students attending the camp learn more about chemical engineering courses and the profession and also have the opportunity to meet peers and interact with faculty and upper-level students. We hypothesized that the activities included in the camp would positively impact on students’ self-efficacy and social integration, factors which have been shown in other studies to significantly influence student experience and student success. The effects of the intervention were assessed using surveys administered to students at the start of the camp. These surveys included published subscales used in the study of self-efficacy and social and academic integration. The same surveys were administered to all second-year chemical engineering students at the beginning of the academic year (three days after the beginning of the camp) and the end of the academic year (approximately eight months later). Data collected from the previous three academic years indicate a statistically significant increase in the chemical engineering self-efficacy, coping self-efficacy, and social and academic integration ratings for students who attend the camp and these effects appear to largely be maintained throughout the sophomore year. Non-attendees enter the sophomore year with lower average ratings in these factors and show little change over the course of the year. Students’ intent to persist in the chemical engineering major was also assessed by these surveys, and while the camp attendees’ ratings showed almost no change from just prior to the camp to just after, their ratings exhibited a substantial, statistically-significant increase during the sophomore year. Non-attendees entered the year with a similar average rating to the attendees but showed a much more modest increase over the course of the year. We continue to collect data from both student survey responses and academic records, with the goal of eventually using path analysis to establish the relationships between the factors of self-efficacy and student integration and the outcomes of academic performance and persistence for second-year chemical engineering students. We currently have insufficient data to power such an analysis, but our available data suggest that the intervention is having a positive impact on these factors. 
    more » « less
  5. ; ; ; ( , International Journal of STEM Education)
    Abstract Background

    There is overwhelming evidence that evidence-based teaching improves student performance; however, traditional lecture predominates in STEM courses. To provide support as faculty transform their lecture-based classrooms with evidence-based teaching practices, we created a faculty development program based on best practices, Consortium for the Advancement of Undergraduate STEM Education (CAUSE). CAUSE paired exploration of evidence-based teaching with support for classroom implementation over two years. Each year for three years, CAUSE recruited cohorts of faculty from seven STEM departments. Faculty met biweekly to discuss evidence-based teaching and receive feedback on their implementation. We used the PORTAAL observation tool to document evidence-based teaching practices (PORTAAL practices) across four randomly chosen class sessions each term. We investigated if the number of PORTAAL practices used or the amount of practices increased during the program.

     Results

    We identified identical or equivalent course offerings taught at least twice by the same faculty member while in CAUSE (n = 42 course pairs). We used a one-way repeated measures within-subjects multivariate analysis to examine the changes in average use of 14 PORTAAL practices between the first and second timepoint. We created heat maps to visualize the difference in number of practices used and changes in level of implementation of each PORTAAL practice. Post-hoc within-subjects effects indicated that three PORTAAL practices were significantly higher and two were lower at timepoint two. Use of prompting prior knowledge and calling on volunteers to give answers decreased, while instructors doubled use of prompting students to explain their logic, and increased use of random call by almost 40% when seeking answers from students. Heat maps indicated increases came both from faculty’s adoption of these practices and increased use, depending on the practice. Overall, faculty used more practices more frequently, which contributed to a 17% increase in time that students were actively engaged in class.

     Conclusions

    Results suggest that participation in a long-term faculty development program can support increased use of evidence-based teaching practices which have been shown to improve student exam performance. Our findings can help prioritize the efforts of future faculty development programs.

     
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email