skip to main content


Title: A Size and Scale Framework for Guiding Curriculum Design and Assessment
Abstract Background

The concepts of size and scale in nanotechnology are difficult for most beginning engineering students to grasp. Yet, guidance on the specific aspects of size and scale that should be taught and assessed is limited.

Purpose

This research sought to empirically develop a framework for size and scale conceptualization and provide a blueprint to guide curriculum development and assessment.

Design/Methods

Through an exploratory sequential mixed methods design, we qualitatively examined 30 teams of 119 first‐year engineering students' nanotechnology‐based projects to identify concepts beyond those in the literature to create a Size and Scale Framework (SSF). We then created a blueprint with associated learning objectives that can guide curriculum and assessment development. To demonstrate the utility of the SSF blueprint, an SSF‐based quiz was developed and studied using classical test theory with 378 first‐year engineering students.

Results

The findings categorized size and scale in terms of eight aspects: Definition, Qualitative Categorical, Qualitative Relational, Qualitative Proportional, Quantitative Absolute, Quantitative Categorical, Quantitative Relational, and Quantitative Proportional. The SSF can be applied as a blueprint for others to develop curriculum and assessment. The SSF‐based quiz demonstrated acceptable properties for use with first‐year engineering students.

Conclusions

Development of the SSF‐based quiz is an example of how the SSF can be applied to create a classroom quiz to assess students' size and scale knowledge in the context of nanotechnology.

 
more » « less
NSF-PAR ID:
10028613
Author(s) / Creator(s):
 ;  ;  ;  ;  
Publisher / Repository:
Wiley Blackwell (John Wiley & Sons)
Date Published:
Journal Name:
Journal of Engineering Education
Volume:
106
Issue:
3
ISSN:
1069-4730
Page Range / eLocation ID:
p. 431-453
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    The Framework for K‐12 science education (TheFramework) and Next Generation Science Standards (NGSS) emphasize the usefulness of learning progressions in helping align curriculum, instruction, and assessment to organize the learning process. TheFrameworkdefines three dimensions of science as the basis of theoretical learning progressions described in the document and used to develop NGSS. The three dimensions include disciplinary core ideas, scientific and engineering practices, and crosscutting concepts. TheFrameworkdefines three‐dimensional learning (3D learning) as integrating scientific and engineering practices, crosscutting concepts, and disciplinary core ideas to make sense of phenomena. Three‐dimensional learning leads to the development of a deep, useable understanding of big ideas that students can apply to explain phenomena and solve real‐life problems. While theFrameworkdescribes the theoretical basis of 3D learning, and NGSS outlines possible theoretical learning progressions for the three dimensions across grades, we currently have very limited empirical evidence to show that a learning progression for 3D learning can be developed and validated in practice. In this paper, we demonstrate the feasibility of developing a 3D learning progression (3D LP) supported by qualitative and quantitative validity evidence. We first present a hypothetical 3D LP aligned to a previously designed NGSS‐based curriculum. We further present multiple sources of validity evidence for the hypothetical 3D LP, including interview analysis and item response theory (IRT) analysis to show validity evidence for the 3D LP. Finally, we demonstrate the feasibility of using the assessment tool designed to probe levels of the 3D LP for assigning 3D LP levels to individual student answers, which is essential for the practical applicability of any LP. This work demonstrates the usefulness of validated 3D LP for organizing the learning process in the NGSS classroom, which is essential for the successful implementation of NGSS.

     
    more » « less
  2. Major challenges in engineering education include retention of undergraduate engineering students (UESs) and continued engagement after the first year when concepts increase in difficulty. Additionally, employers, as well as ABET, look for students to demonstrate non-technical skills, including the ability to work successfully in groups, the ability to communicate both within and outside their discipline, and the ability to find information that will help them solve problems and contribute to lifelong learning. Teacher education is also facing challenges given the recent incorporation of engineering practices and core ideas into the Next Generation Science Standards (NGSS) and state level standards of learning. To help teachers meet these standards in their classrooms, education courses for preservice teachers (PSTs) must provide resources and opportunities to increase science and engineering knowledge, and the associated pedagogies. To address these challenges, Ed+gineering, an NSF-funded multidisciplinary collaborative service learning project, was implemented into two sets of paired-classes in engineering and education: a 100 level mechanical engineering class (n = 42) and a foundations class in education (n = 17), and a fluid mechanics class in mechanical engineering technology (n = 23) and a science methods class (n = 15). The paired classes collaborated in multidisciplinary teams of 5-8 undergraduate students to plan and teach engineering lessons to local elementary school students. Teams completed a series of previously tested, scaffolded activities to guide their collaboration. Designing and delivering lessons engaged university students in collaborative processes that promoted social learning, including researching and planning, peer mentoring, teaching and receiving feedback, and reflecting and revising their engineering lesson. The research questions examined in this pilot, mixed-methods research study include: (1) How did PSTs’ Ed+gineering experiences influence their engineering and science knowledge?; (2) How did PSTs’ and UESs’ Ed+gineering experiences influence their pedagogical understanding?; and (3) What were PSTs’ and UESs’ overall perceptions of their Ed+gineering experiences? Both quantitative (e.g., Engineering Design Process assessment, Science Content Knowledge assessment) and qualitative (student reflections) data were used to assess knowledge gains and project perceptions following the semester-long intervention. Findings suggest that the PSTs were more aware and comfortable with the engineering field following lesson development and delivery, and often better able to explain particular science/engineering concepts. Both PSTs and UESs, but especially the latter, came to realize the importance of planning and preparing lessons to be taught to an audience. UESs reported greater appreciation for the work of educators. PSTs and UESs expressed how they learned to work in groups with multidisciplinary members—this is a valuable lesson for their respective professional careers. Yearly, the Ed+gineering research team will also request and review student retention reports in their respective programs to assess project impact. 
    more » « less
  3. Despite limited success in broadening participation in engineering with rural and Appalachian youth, there remain challenges such as misunderstandings around engineering careers, misalignments with youth’s sociocultural background, and other environmental barriers. In addition, middle school science teachers may be unfamiliar with engineering or how to integrate engineering concepts into science lessons. Furthermore, teachers interested in incorporating engineering into their curriculum may not have the time or resources to do so. The result may be single interventions such as a professional development workshop for teachers or a career day for students. However, those are unlikely to cause major change or sustained interest development. To address these challenges, we have undertaken our NSF ITEST project titled, Virginia Tech Partnering with Educators and Engineers in Rural Schools (VT PEERS). Through this project, we sought to improve youth awareness of and preparation for engineering related careers and educational pathways. Utilizing regular engagement in engineering-aligned classroom activities and culturally relevant programming, we sought to spark an interest with some students. In addition, our project involves a partnership with teachers, school districts, and local industry to provide a holistic and, hopefully, sustainable influence. By engaging over time we aspired to promote sustainability beyond this NSF project via increased teacher confidence with engineering related activities, continued integration within their science curriculum, and continued relationships with local industry. From the 2017-2020 school years the project has been in seven schools across three rural counties. Each year a grade level was added; that is, the teachers and students from the first year remained for all three years. Year 1 included eight 6th grade science teachers, year 2 added eight 7th grade science teachers, and year 3 added three 8th grade science teachers and a career and technology teacher. The number of students increased from over 500 students in year 1 to over 2500 in year 3. Our three industry partners have remained active throughout the project. During the third and final year in the classrooms, we focused on the sustainable aspects of the project. In particular, on how the intervention support has evolved each year based on data, support requests from the school divisions, and in scaffolding “ownership” of the engineering activities. Qualitative data were used to support our understanding of teachers’ confidence to incorporate engineering into their lessons plans and how their confidence changed over time. Noteworthy, our student data analysis resulted in an instrument change for the third year; however due to COVID, pre and post data was limited to schools who taught on a semester basis. Throughout the project we have utilized the ITEST STEM Workforce Education Helix model to support a pragmatic approach of our research informing our practice to enable an “iterative relationship between STEM content development and STEM career development activities… within the cultural context of schools, with teachers supported by professional development, and through programs supported by effective partnerships.” For example, over the course of the project, scaffolding from the University leading interventions to teachers leading interventions occurred. 
    more » « less
  4. Teaming is a core part of engineering education, especially in the first and last years of engineering when project work is a prevalent focus. The literature on the effects of working in diverse teams is mixed. Negative findings include decreased affect, increased frustration, and sustained conflict in teams. Positive findings include increased productivity, production of high quality products, and divergent-thinking and idea generation. Given these mixed findings, it becomes important to not only understand the practical outputs of working in diverse teams, but also how the experience of working in diverse teams influences whether students see themselves as engineers and whether or not they feel they belong in engineering. Our project, Building Supports for Diversity through Engineering Teams, investigates how students’ attitudes towards diversity influence how students experience work in diverse teams through addressing two main research questions: 1) What changes occur in students’ diversity sensitivity, multicultural effectiveness, and engineering practices as a result of working in diverse teams? 2) How do students’ perceptions of diversity, affect, and engineering practices change because of working on diverse teams? Using a multi-method approach, we deployed survey instruments to determine changes in student’s attitudes about teaming, diversity sensitivity, and openness attitudes. We also observed students working in teams and interviewed these students about their perceptions of diversity and experiences in their teams. Preliminary results of the quantitative phase show that variance in students’ attitudes about diversity significantly increase over the semester, further reflecting the mixed results that have been seen previously in the literature. Additionally, Social Network Analysis was used to characterize the social structure practices of a multi-section, large-enrollment first-year engineering course. This reveals the underlying social structure of the environment, its inclusiveness, and how diverse students work with others on engineering. Initial results indicate that students are included in social networks regardless of gender and race. Preliminary results of the qualitative phase, using Interpretive Phenomenological Analysis, have yielded relationships between student’s definitions, valuation, and enactment of diversity in engineering spaces. Individual student’s incoming attitudes of diversity and previous experiences interact with practical needs in first-year engineering classrooms to create different microclimates within each team. These microclimates depict tensions between what instructors emphasize about diversity, stereotypes of engineering as focused on technical instead of social skills, and pragmatic forces of “getting the job done.” This knowledge can help explain some of the complexity behind the conflicting literature on diversity in teams. Ultimately, this research can help us understand how to build inclusive and diverse environments that guide students to learn how to understand their own complex relationship, understanding, and enactment of diversity in engineering. By understanding how students make sense of diversity in engineering spaces, educators and researchers can figure out how to introduce these concepts in relevant ways so that students can inclusively meet the grand challenges in engineering. This curriculum integration, in turn, can improve team interactions and the climate of engineering for underrepresented groups. 
    more » « less
  5. null (Ed.)
    Many university engineering programs require their students to complete a senior capstone experience to equip them with the knowledge and skills they need to succeed after graduation. Such capstone experiences typically integrate knowledge and skills learned cumulatively in the degree program, often engaging students in projects outside of the classroom. As part of an initiative to completely transform the civil engineering undergraduate program at Clemson University, a capstone-like course sequence is being incorporated into the curriculum during the sophomore year. Funded by a grant from the National Science Foundation’s Revolutionizing Engineering Departments (RED) program, this departmental transformation (referred to as the Arch initiative) is aiming to develop a culture of adaptation and a curriculum support for inclusive excellence and innovation to address the complex challenges faced by our society. Just as springers serve as the foundation stones of an arch, the new courses are called “Springers” because they serve as the foundations of the transformed curriculum. The goal of the Springer course sequence is to expose students to the “big picture” of civil engineering while developing student skills in professionalism, communication, and teamwork through real-world projects and hands-on activities. The expectation is that the Springer course sequence will allow faculty to better engage students at the beginning of their studies and help them understand how future courses contribute to the overall learning outcomes of a degree in civil engineering. The Springer course sequence is team-taught by faculty from both civil engineering and communication, and exposes students to all of the civil engineering subdisciplines. Through a project-based learning approach, Springer courses mimic capstone in that students work on a practical application of civil engineering concepts throughout the semester in a way that challenges students to incorporate tools that they will build on and use during their junior and senior years. In the 2019 spring semester, a pilot of the first of the Springer courses (Springer 1; n=11) introduced students to three civil engineering subdisciplines: construction management, hydrology, and transportation. The remaining subdisciplines will be covered in a follow-on Springer 2 pilot.. The project for Springer 1 involved designing a small parking lot for a church located adjacent to campus. Following initial instruction in civil engineering topics related to the project, students worked in teams to develop conceptual project designs. A design charrette allowed students to interact with different stakeholders to assess their conceptual designs and incorporate stakeholder input into their final designs. The purpose of this paper is to describe all aspects of the Springer 1 course, including course content, teaching methods, faculty resources, and the design and results of a Student Assessment of Learning Gains (SALG) survey to assess students’ learning outcomes. An overview of the Springer 2 course is also provided. The feedback from the SALG indicated positive attitudes towards course activities and content, and that students found interaction with project stakeholders during the design charrette especially beneficial. Challenges for full scale implementation of the Springer course sequence as a requirement in the transformed curriculum are also discussed. 
    more » « less