skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Beyond Surveys: Using Visual Data to Evidence Achievement of Proposed Learning Objectives
Visual qualitative methodologies enhance the richness of data and makes participants experts on the object of interest. Visual data brings another dimension to the evaluation process, besides surveys and interviews, as well as depth and breadth to participants reactions to specific program activities. Visual data consists of images, such as photos, drawings, artwork, among others. Exploring a different approach to assess impact of an educational activity, an exercise was designed where participants were asked to take photos to document a site visit to an area impacted by a swarm of earthquakes in 2019. The exercise required taking five photos of either objects, persons, scenery, structures, or any other thing that captured their attention during the visit and write a reflective essay to answer three questions: 1) How do these photos represent your site visit experience? 2) Based on the content of your photos, write about what you learned, discovered, new knowledge acquired, emotions, changes in your way of thinking, etc., and 3) What did you learned or discovered from doing this exercise? Twenty-two undergraduate engineering and architecture students from the RISE-UP Program, enrolled in a curricular sequence in design and construction of resilient and sustainable structures, completed the exercise. Analyses of obtained data includes frequency of captured images and content analysis of reflective essays to determine instances where each of the four proposed learning objectives was present. Results show that across essays, 32% of the essays include text that demonstrate impact related to the first objective, 59% for the second, 73% for the third, and 86% for the fourth objective. Forty-five percent of essays included text considered relevant but not related to an objective. Personal, social, and career insights were categorized as unintended results. Photos taken by students represent what they considered relevant during the visit and also evidence the achievement of the proposed learning objectives. In general, three mayor categories emerged from the content in photos: 1) photos related to the design and construction of the structure and specific damage observed from earthquakes; 2) photos of classmates, professors, and group activities; and 3) other photos that do not share a theme. Both photos and essays demonstrate that the learning objectives were successfully achieved and encourage the use of visual data as an alternative for the evaluation of educational activities.  more » « less
Award ID(s):
1832468
PAR ID:
10468675
Author(s) / Creator(s):
Publisher / Repository:
2023 ASEE Annual Conference & Exposition
Date Published:
Format(s):
Medium: X
Location:
Baltimore, MD
Sponsoring Org:
National Science Foundation
More Like this
  1. Cybersecurity is a topic of growing interest. Do you have hands-on exercises that match the skills and levels of your students? Over the last few years, we have worked on making it easier to create, modify, and deploy exercises with assessment questions. EDURange is an open source project with exercises that span a wide range and can serve as templates for new ones. In addition to providing a framework for editing exercises, EDURange also allows Instructors to see student interaction and offer hints while they are doing the exercise. The features, that support this include chat with the instructor and machine learning algorithms for identifying which students need help. We plan to share some of the existing exercises and show how to adapt them to different students' profiles. We will also share our experiences with the hint system. Participants will gain experience in designing and adapting cybersecurity exercises and writing learning objectives and assessments. All backgrounds are welcome, whether you are new to teaching cybersecurity and have little experience with the command line, or whether you can create a network of containers and bash scripts to configure them. You will come away with a better understanding of how to design and create your own hands-on exercises. 
    more » « less
  2. As proposal, subaward, award, and agreement volumes continue to grow at your institution, how can you strategize to support the size of your research infrastructure? How can you justify the expansion of your teams and talent? How do you adjust roles and workload to align with the growing portfolio? What technology considerations should you make to track this? This session will cover how to leverage data to make effective business decisions regarding resource needs and allocation methodology to meet growing demands, starting with your internal data and then looking externally. We will cover strategies for using data analytics to efficiently manage the size of your research enterprise and portfolios, as well as measure performance of pre-award and post-award functions across the grant lifecycle. Participants will understand how to analyze portfolios, beyond sheet volume, and analyze the various criteria that can be objectively evaluated to determine how to balance your sponsored programs portfolio. We will review common reporting and analytics tools and provide examples of critical data points to consider at both the central office and department level. Presented at the 2024 Research Analytics Summit in Albuquerque, NM 
    more » « less
  3. Abstract Background To compare the performance (as determined by lower extremity kinematics) of knee exercises in healthy middle-aged and older individuals immediately after instruction and one week later. Methods This is a cross-sectional study in a laboratory setting. Nineteen healthy volunteers (age [y] 63.1 ± 8.6, mass [kg] 76.3 ± 14.7, height [m] 1.7 ± 0.1) participated in this study. High speed video and reflective markers were used to track motion during four exercises. The exercises were knee flexion, straight leg raise, and “V “in supine position, and hip abduction in side lying position. All participants received verbal and tactile cues during the training phase and the therapist observed and, if necessary, corrected the exercises. Upon return a week later the participants performed the same exercises without any further instructions. Knee and hip sagittal and rotational angles were extracted from the motion capture. A repeated measures t-test was used to compare the motions between two visits. Results Participants demonstrated more knee flexion during straight leg raise and “V in” exercises at the 2nd visit compared to the 1st visit (both p  <  0.05). During the “V out” exercise, they performed more external rotation ( p  <  0.05) while they showed more internal rotation during the “V in” exercise at the 2nd visit compared to the 1st visit. Conclusions Exercise performance declined significantly in healthy middle-aged and older individuals one week after instruction. This decline occurred despite an instructional exercise sheet being given to every participant. Other approaches designed to help individuals retain the ability to perform rehabilitative exercises correctly need to be explored. 
    more » « less
  4. This dataset includes anonymized interview data collected in the Yukon-Kuskokwim Delta in August 2022. These interviews were designed to capture end-users' perceptions and experiences with their water infrastructure systems. Interview questions included, for example: Can you tell me how you use water in your household?; What do you like about your water or water system?; What are some of the concerns/challenges you deal with in your household water system?; Do you worry about whether your water is safe to drink? 10 semi-structured interviews with 12 end-users are included. These interviews were conducted from August 2nd to August 8th, 2022. All interviews were conducted in-person. Interviews were recorded (with permission), transcribed, checked for quality, and anonymized. 
    more » « less
  5. When you start a Ph.D. program, you may be thrilled to be studying a fancy topic that you love—and you should be! But don’t let that prevent you from carefully considering the impact that your Ph.D. supervisor has on your educational experience and career. To set yourself up for success, it’s worth taking the time to select someone who aligns well with your professional goals, work style and personality. 
    more » « less