<?xml-model href='http://www.tei-c.org/release/xml/tei/custom/schema/relaxng/tei_all.rng' schematypens='http://relaxng.org/ns/structure/1.0'?><TEI xmlns="http://www.tei-c.org/ns/1.0">
	<teiHeader>
		<fileDesc>
			<titleStmt><title level='a'>Board 120: Development of an Engineering Identity and Career Aspirations Survey for Use with Elementary Students</title></titleStmt>
			<publicationStmt>
				<publisher>ASEE Conferences</publisher>
				<date>06/01/2019</date>
			</publicationStmt>
			<sourceDesc>
				<bibl> 
					<idno type="par_id">10483960</idno>
					<idno type="doi">10.18260/1-2--32210</idno>
					
					<author>Kelli Paul</author><author>Adam Maltese</author><author>Karen Miel</author><author>Merredith Portsmore</author><author>Euisuk Sung</author>
				</bibl>
			</sourceDesc>
		</fileDesc>
		<profileDesc>
			<abstract><ab><![CDATA[nterest in science, technology, engineering, and mathematics (STEM) begins as early as elementary and middle school. As youth enter adolescence, they begin to shape their personal identities and start making decisions about who they are and could be in the future. Students form their career aspirations and interests related to STEM in elementary school, long before they choose STEM coursework in high school or college. Much of the literature examines either science or STEM identity and career aspirations without separating out individual sub-disciplines. Therefore, the purpose of this paper is to describe the development of a survey instrument to specifically measure engineering identity and career aspirations in adolescents and preadolescents. When possible, we utilized existing measures of STEM identity and career aspirations, adapting them when necessary to the elementary school level and to fit the engineering context. The instrument was developed within the context of a multi-year, NSF-funded research project examining the dynamics between undergraduate outreach providers and elementary students to understand the impact of the program on students’ engineering identity and career aspirations. Three phases of survey development were conducted that involved 492 elementary students from diverse communities in the United States. Three sets of items were developed and/or adapted throughout the four phases. The first set of items assessed Engineering Identity. Recent research suggests that identity consists of three components: recognition, interest, and performance/competence. Items assessing each of these constructs were included in the survey. The second and third sets of items reflected Career Interests and Aspirations. Because elementary and middle school students often have a limited or nascent awareness of what engineers do or misconceptions about what a job in science or engineering entails, it is problematic to measure their engineering identity or career aspirations by directly asking them whether they want to be a scientist/engineer or by using a checklist of broad career categories. Therefore, similar to other researchers, the second set of items assessed the types of activities that students are interested in doing as part of a future career, including both non-STEM and STEM (general and engineering-specific) activities. These items were created by the research team or adapted from activity lists used in existing research. The third set of items drew from career counseling measures relying on Holland’s Career Codes. We adapted the format of these instruments by asking students to choose the activity they liked the most from a list of six activities that reflected each of the codes rather than responding to their interest about each activity. Preliminary findings for each set of items will be discussed. Results from the survey contribute to our understanding of engineering identities and career aspirations in preadolescent and adolescent youth. However, our instrument has the potential for broader application in non-engineering STEM environments (e.g., computer science) with minor wording changes to reflect the relevant science subject area. More research is needed in determining its usefulness in this capacity.]]></ab></abstract>
		</profileDesc>
	</teiHeader>
	<text><body xmlns="http://www.tei-c.org/ns/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink">
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Introduction</head><p>One of the primary goals of K-12 engineering education is to increase the number of students interested in or pursuing engineering-related studies <ref type="bibr">[1]</ref><ref type="bibr">[2]</ref>. Many engineering education researchers have identified that young students' conceptions of engineering play a significant role in their career choice and persistence in engineering studies <ref type="bibr">[3]</ref><ref type="bibr">[4]</ref>. In 2018, underrepresentation within engineering careers persists such that 15.9% of engineers were women, 6.5% were African American, and 8.9% were Hispanic, all are less than their representation in the U.S. population <ref type="bibr">[5]</ref>. Yet, little is known about how elementary students, particularly students from groups underrepresented in engineering, choose STEM careers <ref type="bibr">[6]</ref><ref type="bibr">[7]</ref>. Engineering interest declines as youth enter middle school, making elementary school a potentially critical developmental window for bolstering engineering aspirations <ref type="bibr">[8]</ref><ref type="bibr">[9]</ref>.</p><p>Our aim was to develop a tool to measure how young students conceive of engineering and themselves as engineers. One popular tool used to measure conceptions of engineering is the Draw-an-Engineer Test (DAET) <ref type="bibr">[10]</ref>, which is an adaptation of the Draw-A-Scientist Test (DAST) <ref type="bibr">[11]</ref>. Unlike previous measures, the DAST did not rely on a student's ability to write or respond to written instruments and capitalized on the belief that most children like to draw <ref type="bibr">[12]</ref>. Children's drawings are rated on the presence/absence of certain characteristics. These ratings provide information about their conceptions and stereotypical images of scientists. However, the DAET does not provide information as to whether students see themselves as an engineer or envision engineering as a future possible self. While the drawings from the DAET provide information regarding perceptions of engineers and engineering, we wanted to capture whether students can see themselves as engineers, rather than simply assessing students' impressions and perceptions of others as engineers. As an alternative, we developed the Create-a-LEGO-Engineer (CALE) activity in which students create themselves as engineers and create a scene to show the work they are doing as engineers. In this paper we describe the evolution of the CALE activity through three phases of development and discuss preliminary findings from each phase.</p><p>We drew from the LEGO Serious Play (LSP) method which is grounded on the premise that hands-on learning results in a deeper understanding of the world and oneself in it <ref type="bibr">[13]</ref>. The theoretical principles that guide LSP are play, constructionism, flow, hands-mind connection, and the use of metaphors <ref type="bibr">[14]</ref>. Participants have opportunities to create and refine abstract mental ideas through the iterative process of making with physical artifacts <ref type="bibr">[15]</ref>. Drawing from the LSP method, we designed the CALE activity to be more interactive and engaging for students than the DAET assessment tool. The use of LEGO blocks in the CALE activity allows students to modify and explore multiple ideas without the concern for making changes in the drawing; rather, they simply move the bricks around to create something new. Additionally, using LEGO bricks is advantageous in that they: 1) are familiar to most students; 2) are easy to use even without prior experience; 3) do not require prerequisite artistic skills or self-confidence; and 4) afford symbolization (e.g., a LEGO brick can represent anything that you want it to).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Methods</head><p>The CALE activity was developed as part of a multi-year NSF-funded project. During the development of the activity, we solicited 3 rd -5 th grade teachers in the Midwest United States to determine their interest in using the activity with their students as a supplement to their science instruction. Eleven teachers from two schools expressed interest. The two schools were located in two suburban school districts. Ten teachers represented School A and one teacher represented School B. The majority of students in both schools were White/Caucasian, followed by multiracial, Hispanic, and other (district level data statistics), and these patterns were observed by researchers in the classrooms (demographic data were not collected on students). In all, 265 students participated in the activity.</p><p>Two researchers facilitated the CALE activity in the classrooms. The activity ranged in duration from 30-50 minutes, depending on classroom schedules. After completing the activity in each classroom, researchers made field notes and discussed aspects of the activity that did and did not work. Because the activity was in development, we refined and updated the activity as needed. Four types of data were collected during the pilot tests: 1) written notecards describing the engineers and scenes; 2) photographs of the LEGO creations; 3) videos of the overall activity and students describing their final creations; and 4) field notes that included student feedback collected at the end of the activity. With the exception of field notes which were collected in every classroom, the other data were collected to varying degrees in each classroom.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Phases of Activity Development</head><p>The overall activity itself remained similar across the first two phases of development, with the primary revisions focusing on the order of the instructions and activity. Figure <ref type="figure">1</ref> presents a flow chart depicting the order of instructions during Phase 1 and 2. In both phases, students began by creating themselves as a LEGO Person (hereafter LEGO Me). Once they had created their LEGO Me, they were directed to create their LEGO scene with the following instructions: "Imagine that you and your LEGO Me are engineers. Think about the types of activities or engineering work that you might do. Now, using your LEGO bricks, create a scene to depict what your LEGO Me is doing." During the instructions, we were very conscious not to use the word "build"; rather, we used the words "create", "make", or "design" to avoid cueing the stereotypical image of engineering as "building". Students were instructed to make brief notes on a notecard about what their LEGO Me was doing in the scene by responding to the following prompt: "Describe the engineer you created and what your engineer is doing." The two phases differed as to when students were given the LEGO bricks as well as when students created notes about their scenes.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Phase 1 -Initial Activity</head><p>In the first two classrooms, because LEGO bricks were distributed simultaneously with or slightly before the instructions to create their scene, we observed that students' scene designs often were driven by the LEGO pieces in front of them rather than what their engineer might be doing. We also observed that students' descriptions on their notecards did not describe their scene but only described the actual LEGO person created (e.g., "I created a really pink person" or "A girl with a ponytail and white shirt"). Additionally, at the end of the activity, we observed that some students had misconceptions of engineers, but since the activity was designed as an assessment tool, we did not have the opportunity to address this with students. However, based on this observation, we revised the activity in Phase 2 to afford an opportunity to directly address students' (mis)conceptions of engineers.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Phase 2 -Revised activity</head><p>Based on observations from Phase 1, we revised the order of the activity so that students made notes about what their engineer would be doing in the scene prior to receiving their LEGO bricks. Students were encouraged to revise their notecard if their scene changed during the activity. We hoped that this would help focus students on seeing themselves as engineers and have their ideas, rather than the LEGO bricks, drive the creation of the scene. We also added a brief time at the end of the activity to talk about what an engineer is and does, the variety of scenes created and how that reflects the variety of engineers, and how students' interests can fit with the many different types of engineers. This shift moved the activity more into the realm of an intervention rather than just data collection alone. The revised version of the activity was used in the remaining nine classrooms. When they completed their scene, we encouraged students to create a brief video using a GoPro camera to describe what their engineer was doing. However, time constraints often resulted in few videos being made. We made concerted efforts in the later classrooms to try and collect these data. Figure <ref type="figure">2</ref> presents examples of created LEGO scenes.</p><p>During the revised activity, we noticed that students tended to plan their scene prior to creating, resulting in the activity being more idea-driven than LEGO brick-driven. We also observed that students made changes to their scenes and often noted these on their cards. However, we found that it still was difficult to fully interpret the scene and notecard, especially when students did not record a video description. To try and ensure we understood the scenes when no video data were available, in the last classroom we modified the note card by providing specific prompts to guide students' thinking and description about the scene. Namely, we asked them: 1) Where is your engineer?; 2) What is  your engineer doing and why?; and 3) Describe two or more things in your scene. This slight modification resulted in more detailed descriptions of the scene created.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Phase 3 -LEGO Me Puppet</head><p>After conducting the activity in 11 classrooms, we encountered a few challenges with the activity. The most difficult challenge was finding LEGO minifigure pieces that reflected the variety of hair, skin, and clothing options that students desired to create themselves as a LEGO person. The lack of variety, especially in terms of gender and ethnic characteristics, precluded some students from being able to accomplish the initial task of creating themselves. When LEGO minifigure pieces were found, there was a significant cost associated with providing them in sufficient quantities to conduct the activity with a classroom of students. We tried to use 3D printing to make custom parts, but the colors of filaments were lacking in diversity and a realistic skin tone palette. Finally, for students, the largest disappointment with the activity was finding out that they would not be able to keep their LEGO Me. As such, we revised the activity modeled after Hynes' Make-an-Engineer <ref type="bibr">[16]</ref> such that students create a LEGO Me Puppet. Using 4-inch laser-cut wooden LEGO-style figures with detachable arms fastened with metal brads, students used fabric, yarn, duct tape, markers, and colored paper to decorate their LEGO Me Puppet on one side. On the opposite side, they answered questions about themselves (e.g., skills and interests, problems they would like to solve, and ways of thinking to solve these problems). Figure <ref type="figure">3</ref> presents examples of created LEGO Me Puppets. The LEGO Me Puppet can be used as a stand-alone activity or in combination with creating the LEGO scene. Unlike the minifigures, students are able to keep their LEGO Me Puppet at the end of the activity. In combination with the notecards and videos, the LEGO Me Puppet also serves as an assessment tool, but it also has potential as an intervention activity to help students continue to explore engineering as a possible future self.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Preliminary Findings</head><p>Preliminary analysis suggests that students attempted to represent themselves in the LEGO Me and scene and that the CALE elicited students' conceptions of what engineers do. Students actively engaged in the activity and tried to create their engineer in their own image. Field notes and photos showed that students identified similarities between themselves and their LEGO engineers (e.g., wearing glasses, similar hair color or shirt color). Many of the LEGO scenes were based on interests and contexts from the students' lives (e.g., coding video games, on the school playground, at gymnastics), suggesting that students were putting themselves into the role of the engineer. Scenes that portray students' living contexts could help inform researchers as to how one's situated context influences conceptions of engineering <ref type="bibr">[17]</ref>.</p><p>All students created a LEGO scene in which their LEGO Me was engaged in what students conceived to be engineering work or activities. While not all LEGO scenes accurately portrayed engineering (e.g., building a cupcake store), those that did tended to overlap in the types of engineering work depicted (e.g., designing, coding) across a variety of engineering fields (e.g., electrical, mechanical, civil, biomedical.). Based on the preliminary findings, the CALE seemed to meet its intended purpose of assessing if students could see themselves as engineers and how students envision engineering work.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Conclusions</head><p>Our primary purpose was to develop the CALE as a data collection tool. The CALE seemed to function as intended and provided information about students' perceptions of the work that engineers do and if students could see themselves as engineers. Future work could compare student responses over time to note any changes in perceptions of engineering. The primary challenge would be obtaining sufficiently detailed descriptions to allow comparisons among multiple time points. Additionally, we sought to find distinct features of the CALE compared to similar tools such as the DAET <ref type="bibr">[10]</ref> or Make-an-Engineer <ref type="bibr">[16]</ref> in order to examine what, if anything, we gained from the CALE as an alternative to these tools. All three tools provide varying levels of information about students' perceptions of the type of work engineers do. While the DAET primarily collects students' stereotypes of an engineer, the Make-an-Engineer and CALE go a step further by connecting the created engineer to the student. While the Makean-Engineer targets older students (e.g., undergraduates) who have a more developed understanding of engineering, the CALE takes into account the emerging understandings that elementary students have and simply asks them to create a visual representation of themselves as a LEGO person that they then imagine as an engineer. The use of LEGO bricks provided a sufficiently low barrier to entry to all students we encountered. As such, students were able to take on the role of an engineer through playful, active making, which may support seeing themselves as possible future engineers <ref type="bibr">[15,</ref><ref type="bibr">18]</ref>.</p><p>During development, we realized that the CALE had potential beyond an assessment tool. While it could be used as a stand-alone assessment tool, the CALE also could serve as the starting point for an intervention; educators could use it to spark discussion about what engineers do and who they are as well as to connect students' personal interests to real-world engineering options. We encountered this during Phase 1, at which point we added a brief discussion at the end of the assessment activity to highlight and expand upon the wide variety of engineering work represented in the LEGO scenes. Because students have an emerging awareness of engineering, such discussion would provide the opportunity to describe engineering fields not represented in created scenes and identify engineering fields of which students are not yet aware. Additionally, information obtained from the CALE could be leveraged to tailor future intervention or classroom activities to student interests, reinforcing possible future selves in engineering. If educators intend to use the CALE as an assessment tool, then its implementation should only focus on data collection and not include feedback or additional discussion. However, if used as both an assessment and intervention, the CALE activity combined with discussion could encourage students to explore engineering and allow them to imagine themselves in the role of an engineer. Continued research is needed to examine the effectiveness of the CALE in both of these capacities.</p></div></body>
		</text>
</TEI>
