skip to main content


Title: Studying Student Experience of Technology Enhanced Assessment Methods (TEAM) in Science and Health in Ireland
ABSTRACT This is a cross institution project involving four Institutes of Technology in Ireland. The objective of this project is to assess the use of technology to enhance the assessment of laboratory sessions in Science and Health. In science, health and engineering, the laboratory sessions are at the core of the learning process for skill development. These laboratory sessions focus on the skills acquisition. The Irish Institute of Technology sector, in particular, develops these skills and considers them essential for ‘professionally ready’ graduates. In terms of student progression and retention, the assessment structure has been identified as having a significant impact on student engagement. The Technology Enhanced Assessment Methods (TEAM) project led by Dundalk Institute of Technology and partnering with Institute of Technology Sligo, Athlone Institute of Technology and Institute of Technology Carlow is exploring the potential offered by digital technologies to address these concerns. It aims to develop a framework for applying the principles of effective assessment and feedback to practical assessment. The TEAM project also aims to facilitate dialogue among stakeholders about what it is we want student to learn in laboratory sessions and how our assessment can facilitate this. A peer network of discipline-specific academics and students in the Science and Health field has been established across all four Institutes. As the network focuses on authentic skills assessment in all core modules, including physics and chemistry, the best practice from this project will inform future assessment procedures across laboratory sessions and may be considered for application within a Science and Materials Engineering context. Assessing the skills acquired in this environment takes many forms. Using student and stakeholder feedback along with an extensive literature review of the area, the team identified key technologies that cut across science and health disciplines, with the potential to influence and enable the learning process. The emphasis was on developing a powerful learning environment approach to enable students to deepen their learning through engagement with the process. The areas identified are: (i) Pre-practical preparation (videos and quizzes), (ii) Electronic laboratory notebooks and ePortfolios, (iii) Digital Feedback technologies and (iv) Rubrics). This paper describes the student experience and perceptions of the adoption of digital technology in science practical assessments. It also describes the process involved in setting up the pilot structure and it presents the initial results from the student survey.  more » « less
Award ID(s):
1748262
NSF-PAR ID:
10054204
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
MRS Advances
ISSN:
2059-8521
Page Range / eLocation ID:
1 to 6
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Major challenges in engineering education include retention of undergraduate engineering students (UESs) and continued engagement after the first year when concepts increase in difficulty. Additionally, employers, as well as ABET, look for students to demonstrate non-technical skills, including the ability to work successfully in groups, the ability to communicate both within and outside their discipline, and the ability to find information that will help them solve problems and contribute to lifelong learning. Teacher education is also facing challenges given the recent incorporation of engineering practices and core ideas into the Next Generation Science Standards (NGSS) and state level standards of learning. To help teachers meet these standards in their classrooms, education courses for preservice teachers (PSTs) must provide resources and opportunities to increase science and engineering knowledge, and the associated pedagogies. To address these challenges, Ed+gineering, an NSF-funded multidisciplinary collaborative service learning project, was implemented into two sets of paired-classes in engineering and education: a 100 level mechanical engineering class (n = 42) and a foundations class in education (n = 17), and a fluid mechanics class in mechanical engineering technology (n = 23) and a science methods class (n = 15). The paired classes collaborated in multidisciplinary teams of 5-8 undergraduate students to plan and teach engineering lessons to local elementary school students. Teams completed a series of previously tested, scaffolded activities to guide their collaboration. Designing and delivering lessons engaged university students in collaborative processes that promoted social learning, including researching and planning, peer mentoring, teaching and receiving feedback, and reflecting and revising their engineering lesson. The research questions examined in this pilot, mixed-methods research study include: (1) How did PSTs’ Ed+gineering experiences influence their engineering and science knowledge?; (2) How did PSTs’ and UESs’ Ed+gineering experiences influence their pedagogical understanding?; and (3) What were PSTs’ and UESs’ overall perceptions of their Ed+gineering experiences? Both quantitative (e.g., Engineering Design Process assessment, Science Content Knowledge assessment) and qualitative (student reflections) data were used to assess knowledge gains and project perceptions following the semester-long intervention. Findings suggest that the PSTs were more aware and comfortable with the engineering field following lesson development and delivery, and often better able to explain particular science/engineering concepts. Both PSTs and UESs, but especially the latter, came to realize the importance of planning and preparing lessons to be taught to an audience. UESs reported greater appreciation for the work of educators. PSTs and UESs expressed how they learned to work in groups with multidisciplinary members—this is a valuable lesson for their respective professional careers. Yearly, the Ed+gineering research team will also request and review student retention reports in their respective programs to assess project impact. 
    more » « less
  2. As society increasingly relies on digital technologies in many different aspects, those who lack relevant access and skills are lagging increasingly behind. Among the underserved groups disproportionately affected by the digital divide are women who are transitioning from incarceration and seeking to reenter the workforce outside the carceral system (women-in-transition). Women-in-transition rarely have been exposed to sound technology education, as they have generally been isolated from the digital environment while in incarceration. Furthermore, while women have become the fastest-growing segment of the incarcerated population in the United States in recent decades, prison education and reentry programs are still not well adjusted for them. Most programs are mainly designed for the dominant male population. Consequently, women-in-transition face significant post-incarceration challenges in accessing and using relevant digital technologies and thus have added difficulties in entering or reentering the workforce. Against this backdrop, our multi-disciplinary research team has conducted empirical research as part of technology education offered to women-in-transition in the Midwest. In this article, we report results from our interviews with 75 women-in-transition in the Midwest that were conducted to develop a tailored technology education program for the women. More than half of the participants in our study are women of color and face precarious housing and financial situations. Then, we discuss principles that we adopted in developing our education program for the marginalized women and participants’ feedback on the program. Our team launched in-person sessions with women-in-reentry at public libraries in February 2020 and had to move the sessions online in March due to COVID-19. Our research-informed educational program is designed primarily to support the women in enhancing their knowledge and comfort with technology and nurturing computational thinking. Our study shows that low self-efficacy and mental health challenges, as well as lack of resources for technology access and use, are some of the major issues that need to be addressed in supporting technology learning among women-in-transition. This research offers scholarly and practical implications for computing education for women-in-transition and other marginalized populations. 
    more » « less
  3. In this proposal, we will share some initial findings about how teacher and student engagement in cogenerative dialogues influenced the development of the Culturally Relevant Pedagogical Guidelines for Computational Thinking and Computer Science (CRPG-CSCT). The CRPG-CSCT’s purpose is to provide computer science teachers with tools to enhance their instruction by accurately reflecting students’ diverse cultural resources in the classroom. Additionally, the CRPG-CSCT will provide guidance to non-computer science teachers on how to facilitate the integration of computational thinking skills to a broad spectrum of classes in the arts, humanities, sciences, social sciences, and mathematics. Our initial findings shared here are part of a larger NSF-funded research project (Award No. 2122367) which aims to better understand the barriers to entry and challenges for success faced by underrepresented secondary school students in computer science, through direct engagement with the students themselves. Throughout the 2022-23 academic year, the researchers have been working with a small team of secondary school teachers, students, and instructional designers, as well as university faculty in computer science, secondary education, and sociology to develop the CRPG-CSCT. The CRPG-CSCT is rooted in the tenets of culturally relevant pedagogy (Ladson-Billings, 1995) and borrows from Muhammad’s (2020) work in Cultivating Genius: An Equity Framework for Culturally and Historically Responsive Literacy. The CRPG-CCT is being developed over six day-long workshops held throughout the academic year. At the time of this submission, five of the six workshops had been completed. Each workshop utilized cogenerative dialogues (cogens) as the primary tool for organizing and sustaining participants’ engagement. Through cogens, participants more deeply learn about students’ cultural capital and the value of utilizing that capital within the classroom (Roth, Lawless, & Tobin, 2000). The success of cogens relies on following specific protocols (Emdin, 2016), such as listening attentively, ensuring there are equal opportunities for all participants to share, and affirming the experiences of other participants. The goal of a cogen is to reach a collective decision, based on the dialogue, that will positively impact students by explicitly addressing barriers to their engagement in the classroom. During each workshop, one member of the research team and one undergraduate research assistant observed the interactions among cogen participants and documented these in the form of ethnographic field notes. Another undergraduate research assistant took detailed notes during the workshop to record the content of small and large group discussions, presentations, and questions/responses throughout the workshops. A grounded theory approach was used to analyze the field notes. Additionally, at the conclusion of each workshop, participants completed a Cogen Feedback Survey (CFS) to gather additional information. The CFS were analyzed through open thematic coding, memos, and code frequencies. Our preliminary results demonstrate high levels of engagement from teacher and student participants during the workshops. Students identified that the cogen structure allowed them to participate comfortably, openly, and honestly. Further, students described feeling valued and heard. Students’ ideas and experiences were frequently affirmed, which served as an important step toward dismantling traditional teacher-student boundaries that might otherwise prevent them from sharing freely. Another result from the use of cogens was the shared experience of participants comprehending views from the other group’s perspective in the classroom. Students appreciated the opportunity to learn from teachers about their struggles in keeping students engaged. Teachers appreciated the opportunity to better understand students’ schooling experiences and how these may affirm or deny aspects of their identity. Finally, all participants shared meaningful suggestions and strategies for future workshops and for the collective betterment of the group. Initial findings shared here are important for several reasons. First, our findings suggest that cogens are an effective approach for fostering participants’ commitment to creating the conditions for students’ success in the classroom. Within the context of the workshops, cogens provided teachers, students, and faculty with opportunities to engage in authentic conversations for addressing the recruitment and retention problems in computer science for underrepresented students. These conversations often resulted in the development of tangible pedagogical approaches, examples, metaphors, and other strategies to directly address the recruitment and retention of underrepresented students in computer science. Finally, while we are still developing the CRPG-CSCT, cogens provided us with the opportunity to ensure the voices of teachers and students are well represented in and central to the document. 
    more » « less
  4. Broadband infrastructure in urban parks may serve crucial functions including an amenity to boost overall park use and a bridge to propagate WiFi access into contiguous neighborhoods. This project: SCC:PG Park WiFi as a BRIDGE to Community Resilience has developed a new model —Build Resilience through the Internet and Digital Greenspace Exposure, leveraging off-the-shelf WiFi technology, novel algorithms, community assets, and local partnerships to lower greenspace WiFi costs. This interdisciplinary work leverages: computer science, information studies, landscape architecture, and public health. Collaboration methodologies and relational definitions across disciplines are still nascent —especially when paired with civic-engaged, applied research. Student researchers (UG/Grad) are excellent partners in bridging disciplinary barriers and constraints. Their capacity to assimilate multiple frameworks has produced refinements to the project’s theoretical lenses and suggested novel socio-technical methodology improvements. Further, they are excellent ambassadors to community partners and stakeholders. In BRIDGE, we tested two mechanisms to augment student research participation. In both, we leveraged a classic, curriculum-based model named the Partnership for Action Learning in Sustainability program (PALS). This campus-wide, community-engaged initiative pairs faculty and students with community partners. PALS curates economic, environmental, and social sustainability challenges and scopes projects to customize appropriate coursework that addresses identified challenges. Outcomes include: literature searches, wireframes, and design plans that target solutions to civic problems. Constraints include the short semester timeframe and curriculum-learning-outcome constraints. (1) On BRIDGE, Dr. Kweon executed a semester-based Landscape Architecture PALS 400-level-studio. 18 undergraduates conducted in-class and in-field work to assess community needs and proposed design solutions for future park-wide WiFi. Research topics included: community-park history, neighborhood demographics, case-study analysis, and land-cover characteristics. The students conducted an in-Park, community engagement session —via interactive posterboard surveys, to gain input on what park amenities might be redesigned or added to promote WiFi use. The students then produced seven re-design plans; one included a café/garden, with an eco-corridor that integrated technology with nature. (2) From the classic, curriculum-based PALS model we created a summer-intensive for our five research assistants, to stimulate interdisciplinary collaboration in their research tasks and co-analysis of project data products: experimental technical WiFi-setup, community survey results, and stakeholder needs-assessments. Students met weekly with each other and team leadership, exchanged journal articles, and attended joint research events. This model shows promise for integrating students more formally into an interdisciplinary research project. An end-of-intensive focus group highlighted, from the students’ perspective, the pro/cons of this model. Results: In contrasting the two mechanisms, our results include: Model 1 is tried-and-trued and produces standardized, reliable products. However, as work is group based, student independence is limited —to explore topics/themes of interest. Civic groups are typically thrilled with the diversity of action plans produced. Model 2 provides greater independence in student-learning outcomes, fosters interdisciplinary, “dictionary-building” that can be used by the full team, deepens methodological approaches, and allows for student stipend payments. Lessons learned: intensive time frame needed more research team support and ideally should be extended, when possible, over the full project-span. UMD-IRB#1785365-4; NSF-award: 2125526. 
    more » « less
  5. This paper describes a project led by the University of South Carolina (USC) to address the cybersecurity workforce gap. The project creates curricular material based on virtual laboratories (vLabs). As vLabs are developed, they are adopted and tested at USC and Northern New Mexico College (NNMC), the main partnering institution in this project. These vLabs consist of virtual equipment (e.g., virtual network, virtual router, virtual firewall) emulating complete systems on-demand running in NETLAB. NETLAB is a widely used platform for training purposes across the country, with more than 1,000 institutions currently using it. USC and NNMC have also established an alliance with industry organizations and with Los Alamos National Laboratory (LANL) and Savannah River National Laboratory (SRNL) to establish internship opportunities. Currently, student interns are not only exercising technical skills but also developing soft skills such as team work and time management. Finally, in partnership with manufacturer leaders, the project permits students to earn industry certificates. These certificates are aligned with the guidelines for “Information Technology Curricula 2017 for IT programs” by the IEEE/ACM. Specifically, the guidelines indicate that IT should emphasize “learning IT core concepts combined with authentic practice” and “use of professional tools and platforms.” Hands-on vLabs activities show that providing access to computing technologies (e.g., professional next-generation firewalls, routers) used in the work environment eases the transition of students from academia to the workplace. 
    more » « less