<?xml-model href='http://www.tei-c.org/release/xml/tei/custom/schema/relaxng/tei_all.rng' schematypens='http://relaxng.org/ns/structure/1.0'?><TEI xmlns="http://www.tei-c.org/ns/1.0">
	<teiHeader>
		<fileDesc>
			<titleStmt><title level='a'>Work in Progress: A Study of Variations in Motivation and Efficacy for Computational Modeling in First-year Engineering Students</title></titleStmt>
			<publicationStmt>
				<publisher></publisher>
				<date>10/13/2021</date>
			</publicationStmt>
			<sourceDesc>
				<bibl> 
					<idno type="par_id">10350501</idno>
					<idno type="doi">10.1109/FIE49875.2021.9637463</idno>
					<title level='j'>2021 IEEE Frontiers in Education Conference (FIE)</title>
<idno></idno>
<biblScope unit="volume"></biblScope>
<biblScope unit="issue"></biblScope>					

					<author>Alison Polasik</author><author>Anna Suggs</author><author>Rachel Kajfez</author>
				</bibl>
			</sourceDesc>
		</fileDesc>
		<profileDesc>
			<abstract><ab><![CDATA[Computational modeling skills are critical for the success of both engineering students and practicing engineers and are increasingly included as part of the undergraduate curriculum. However, students' belief in the utility of these skills and their ability to succeed in learning them can vary significantly. This study hypothesizes that the self-efficacy and motivation of engineering students at the outset of their degree program varies significantly and that engineering students pursuing some disciplines (such as computer, software, and electrical engineering) will begin with a higher initial self-efficacy than others (such as materials science and engineering and biomedical engineering). In this pilot study, a survey was used to investigate the motivational and efficacy factors of approximately 70 undergraduate students in their first year of engineering studies at a large public university. Surveys were implemented after students were introduced to MATLAB in their first-year engineering design course. The data was analyzed for variations in baseline motivation based on the students' intended major. The results of this survey will help determine whether efficacy and interest related to computational modeling are indeed lower for certain engineering disciplines and will inform future studies in this area.]]></ab></abstract>
		</profileDesc>
	</teiHeader>
	<text><body xmlns="http://www.tei-c.org/ns/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink">
<div xmlns="http://www.tei-c.org/ns/1.0"><head>I. INTRODUCTION</head><p>Programming and the use of computational tools have been integral to the curriculum of electrical, software, and computer engineering disciplines for decades. Other engineering disciplines have more recently added computational competencies to the curriculum. Thus, there is a sense that some engineering degrees -and the careers they lead to -do not require a high degree of computational competency. However, instructors and industrial leaders both increasingly agree that computational skills are necessary for success in all engineering fields. As an example, many materials science and engineering (MSE) programs have included significant computational instruction in their curriculum over the past 10 years <ref type="bibr">[1]</ref>. Previous experience by the lead author has indicated that a significant proportion of MSE majors may have lower selfefficacy related to using computational tools, specifically MATLAB. These students often reported a belief that they will not need such skills in their career or are fundamentally less capable because they are "not programmers" <ref type="bibr">[2]</ref>. More broadly, studies of students taking programming courses have shown that some students find this topic incredibly difficult <ref type="bibr">[3]</ref>, <ref type="bibr">[4]</ref>. To date, little research has identified barriers to learning computational tools such as programming, modeling, or simulation methods specific to different groups of engineering students based on their specialization or sub-discipline. Students often decide to pursue a specific discipline within the field of engineering based on their interests and perceptions of the careers available to them with a certain major <ref type="bibr">[5]</ref>, and studies have identified differences in some motivational factors for students in traditional engineering majors when compared to those in more interdisciplinary majors <ref type="bibr">[6]</ref>  <ref type="bibr">[7]</ref>. If some engineering disciplines are perceived as being "less computational", then it is likely that students pursuing these will have different -perhaps lowermotivation for learning to use computational tools.</p><p>Three motivational factors that are investigated in this study are self-efficacy, expectancy value, and utility value. Selfefficacy is defined as an individual's judgement of his or her ability to execute a task within a specific domain, and it has been applied as a key part of theoretical frameworks in engineering curricula <ref type="bibr">[4]</ref>, <ref type="bibr">[8]</ref>. Expectancy value is an individual's assessment of whether working on a task is likely to lead to the desired outcomes, and utility value is an individual's assessment of how important the task is <ref type="bibr">[9]</ref>. Both are closely linked to selfefficacy. In the context of learning computational skills, these aspects of motivation relate to students' perceptions of whether learning these skills is possible and worthwhile. Some studies have shown that self-efficacy and expectancy value affect student learning, academic success, and career decisions <ref type="bibr">[10]</ref>.</p><p>Studies have shown that a number of factors affect engineering students' self-efficacy and expectancy-value at the outset of their undergraduate studies, and significant variations in prior experience and motivation can exist between students in different majors <ref type="bibr">[8]</ref>, <ref type="bibr">[11]</ref>, <ref type="bibr">[12]</ref>. If motivational factors for learning computational modeling are indeed lower for certain populations of students -specifically, students in some engineering disciplines compared to others -then interventions aimed at improving self-efficacy and expectancy value could improve learning without requiring major curricular reforms.</p><p>This study ultimately seeks to determine whether meaningful differences exist in motivational factors related to computational modeling for first-year engineering students at the time they are exposed to a new computational tool, MATLAB. Specifically, the study hypothesizes that differences might be observed when comparing students in more traditionally computational majors to those in majors that are considered less computer-focused. This paper presents the results of a preliminary study conducted in January 2021.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>II. METHODS</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>A. Rationale and Sample Population</head><p>Students taking first-year engineering courses at a large state university in the midwestern United States.were the target population for this study. This university offers 12 different engineering major programs, and students typically apply to their major program in the second year of studies. Until then, they are "engineering pre-majors" <ref type="bibr">[5]</ref>. All engineering premajors take the same sequence of two first-year design courses. In the first of these courses, students are introduced to the basics of computational thinking, focused on the use of MATLAB. MATLAB is used extensively for the final semester project, and it is expected that students will have spent significant time learning to use the program and to apply this knowledge on assignments by the end of the semester. Approximately 1,400 students take this course in the fall semester.</p><p>This paper describes a pilot study that seeks to test the hypothesis about differences in students in "computational" majors versus those interested in "less computational" majors. In this context, computational means relating to the use of computers. Specifically, this work seeks to look at engineering subdisciplines that are traditionally considered computationalsuch as electrical engineering (EE) and computer science and engineering (CSE) -and those that are not -specifically, materials science and engineering (MSE), biomedical engineering (BME), and welding engineering (WE). The specific research question for this pilot study is:</p><p>What are the differences in motivational factors related to computational modeling (specifically for using MATLAB) for students intending to pursue EE or CSE degrees as compared to those intending to pursue MSE, WE, or BME degrees?</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>B. Survey Description</head><p>The survey measures three aspects of motivation: utility value, self-efficacy, and self-regulation. The survey also asked students, "If you had to select your top 3 engineering majors to apply to today, which would they be?" The survey was informed by previous work in self-efficacy <ref type="bibr">[13]</ref>. Several questions were modeled after a self-efficacy scale for computer programming primed to the C++ programming language developed by Ramalingam and Wiedenbeck in 1998 <ref type="bibr">[14]</ref>, with modifications made to the wording to account for the MATLAB curriculum in the course. The coordinator for the course was consulted in this process to ensure that the questions aligned with course content and correctly encompassed the expected range of skill level for task-specific self-efficacy questions. Before being administered, five engineering students who were not part of the sample population were asked to comment on how clear the survey was, to reflect on what they thought each question meant, and to suggest rewording. The survey was also discussed with the senior advisory committee for the project, whose members provided feedback.</p><p>The survey contained a number of questions related to aspects of motivation. Each question asked students to report their level of agreement with statements about the value of computational modeling or their confidence that they could perform a task in MATLAB. The individual questions and four categories are shown in Table <ref type="table">1</ref>.  <ref type="table">3</ref>. In this case, 1 = "Far above average" and 7 = "Far below average", with a middle value of 4 = "average". Thus, for each question a lower value represents greater self-confidence.</p><p>Students were taught to use MATLAB in the second half of their first semester, with a final project due in December of 2020. The finalized survey was administered to students at the start of their second semester of engineering design course, in January 2021. In addition to the motivational factors, students were asked to self-report their gender, race, ethnicity, prior programming experience, and math experience. 69 students provided complete responses. Distributions in population with respect to gender and ethnicity were not widely different from those for the institution <ref type="bibr">[15]</ref>Demographics for sample population and institution. Some students chose not to report the requested information, and students were not asked to report on their nationality, which resulted in some variations between our demographic numbers and those reported by the institution. The institution also tabulates international students as a separate category.   <ref type="table">33</ref>. The 69 responses were separated by intended major such that two groups were created: those who had either CSE or EE listed as their first or second choice for intended major (Group I, n=25), and those who listed MSE, BME, or WE as their first or second choice for intended major (Group II, n=16). Including multiple potential majors in the grouping accounted for the possibility that students' intentions are still somewhat fluid during their first year and provided data groups that were large enough to analyze. Previous studies demonstrated that students who change majors during the first year will often transfer within these groups <ref type="bibr">[5]</ref>. Students who did not have a preferred major in any of the five targeted areas (n=25) and students who planned majors in both Group I and Group II specialties (n=3) were also not included in this analysis. The average score for</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>III. RESULTS AND DISCUSSION</head><p>The categorical responses on the questions listed in each category A -E were combined into an average value for each category for each student to give a roughly continuous set of values for each category for the population as a whole. In this way, each student has a numerical value corresponding to their motivation levels. to the questions in categories A -E. It is important to note that a higher number in this case denotes a lower utility value, self-efficacy, or self-regulation. These averages for groups I and II for each category can be seen in Error! Reference source not found.. An independent-samples t-test was used to test whether the means of Groups I and II for each category were significantly different. The results of these calculations are presented in Error! Reference source not found.. If we use the conventional &#945;=0.05 or 95% confidence, category C demonstrates a significant difference. However, this category only had two questions; averaging only two questions resulted in a less continuous range of values. Thus, the application of a ttest is less reliable. Group I and Group II are not significantly different in their measures for Categories A, B, D, and E. The pvalue for categories B, C, and E are much lower than for A and D, which could indicate that significant statistical differences might be detectable with a larger data set. </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Motivation Factors -Survey Categories and Questions</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Question Stems 1 6</head><p>A -Expectancy and Utility Value 1 -In order to successfully complete my engeineering degree, I will need to develop the skills to use computational programs such as MATLAB.  </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Self-Evaluation of Performance</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>IV. CONCLUSIONS</head><p>The results of this study are still inconclusive. There may be differences in some motivation factors between engineering premajors interested in computationally focused degrees and those who are pursuing majors that seem to be less so. The p-value for the t-tests that look at the self-efficacy sub score means (categories B and C) between groups 1 and 2 are much lower than for the other categories. The results of this pilot will inform the study conducted in Fall 2021. Interviews with study participants are being conducted in the Summer of 2021. These interviews address students' beliefs about computational modeling and their motivation related to learning to use MATLAB in particular and computational tools and programming in general. The results of these interviews will inform minor changes to the survey. The finalized survey will be administered in the fall of 2021, with an anticipated participation of at least 200 students. With many potential participants, it will be possible to investigate whether there is a significant difference in motivation by surveying these students about their intended major and asking questions about motivation related to computational modeling in general and MATLAB tasks in particular.</p></div><note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="2021" xml:id="foot_0"><p>IEEE Frontiers in Education Conference (FIE) | 978-1-6654-3851-3/21/$31.00 &#169;2021 IEEE | DOI: 10.1109/FIE49875.2021.9637463 Authorized licensed use limited to: Carnegie Mellon Libraries. Downloaded on August 22,2022 at 17:04:29 UTC from IEEE Xplore. Restrictions apply.</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" xml:id="foot_1"><p>Authorized licensed use limited to: Carnegie Mellon Libraries. Downloaded on August 22,2022 at 17:04:29 UTC from IEEE Xplore. Restrictions apply.</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" xml:id="foot_2"><p>National Science Foundation Grant No. 2025093 Authorized licensed use limited to: Carnegie Mellon Libraries. Downloaded on August 22,2022 at 17:04:29 UTC from IEEE Xplore. Restrictions apply.</p></note>
		</body>
		</text>
</TEI>
