Search for: All records

This methods paper describes the application of and insights gained from using aspects of an emerging methodology, agile ethnography, to study engineers working in practice. Research has suggested that there is a misalignment between what is taught in engineering school and the types of work that engineers do in practice [1]. Little is known about the types of engineering work that are conducted in practice [2], [3]. In order to best prepare engineering graduates to meet the demands of the engineering workforce, students should be taught the types of knowledge and problem-solving strategies that are commonly used by practicing engineers. By teaching students the problem-solving strategies that are used by their professional counterparts, the gap between what students are taught in school and what is expected of them in the workplace may be lessened. The purpose of this paper is to describe how agile ethnography [4], [5] was successfully used in our research project to examine workplace literacy practices and habits of mind employed by eight engineers in their workplaces over a period of three years. The overarching purpose of the project was to develop models of disciplinary literacy instruction [6] and habits of mind [7] in engineering, both ofmore »which are potential methods for teaching students the knowledge, skills, and strategies that may prepare them for an engineering career. Disciplinary literacy instruction teaches students the ways that practitioners use literacy practices when reading, writing, interpreting, and evaluating discipline-specific information [8]. Habits of mind are the intelligent behaviors that guide how professionals respond when faced with situations of uncertainty [9]. By understanding how engineers use disciplinary literacy practices and habits of mind in the workplace, models for student instruction can be developed. These instructional practices can be used to support students’ use of authentic engineering practices and ways of thinking that will support them in the classroom and in their future workplaces. Findings about the disciplinary practices and habits of mind of the eight engineers are presented in previous publications by the authors (e.g., [10]–[12]).« less

Despite efforts to diversify the engineering workforce, the field remains dominated by White, male engineers. Research shows that underrepresented groups, including women and minorities, are less likely to identify and engage with scientific texts and literacy practices. Often, children of minority groups and/or working-class families do not receive the same kinds of exposure to science, technology, engineering, and mathematics (STEM) knowledge and practices as those from majority groups. Consequently, these children are less likely to engage in school subjects that provide pathways to engineering careers. Therefore, to mitigate the lack of diversity in engineering, new approaches able to broadly support engineering literacy are needed. One promising approach is disciplinary literacy instruction (DLI). DLI is a method for teaching students how advanced practitioners in a given field generate, interpret, and evaluate discipline-specific texts. DLI helps teachers provide access to to high quality, discipline-specific content to all students, regardless of race, ethnicity, gender, or socio-economic status, Therefore, DLI has potential to reduce literacy-based barriers that discourage underrepresented students from pursuing engineering careers. While models of DLI have been developed and implemented in history, science, and mathematics, little is known about DLI in engineering. The purpose of this research is to identify themore »authentic texts, practices, and evaluative frameworks employed by professional engineers to inform a model of DLI in engineering. While critiques of this approach may suggest that a DLI model will reflect the literacy practices of majority engineering groups, (i.e., White male engineers), we argue that a DLI model can directly empower diverse K-16 students to become engineers by instructing them in the normed knowledge and practices of engineering. This paper presents a comparative case study conducted to investigate the literacy practices of electrical and mechanical engineers. We scaffolded our research using situated learning theory and rhetorical genre studies and considered the engineering profession as a community of practice. We generated multiple types of data with four participants (i.e., two electrical and two mechanical engineers). Specifically, we generated qualitative data, including written field notes of engineer observations, interview transcripts, think-aloud protocols, and engineer logs of literacy practices. We used constant comparative analysis (CCA) coding techniques to examine how electrical and mechanical engineers read, wrote, and evaluated texts to identify the frameworks that guide their literacy practices. We then conducted within-group and cross-group constant comparative analyses (CCA) to compare and contrast the literacy practices specific to each sub-discipline Findings suggest that there are two types of engineering literacy practices: those that resonate across both mechanical and electrical engineering disciplines and those that are specific to each discipline. For example, both electrical and mechanical engineers used test procedures to review and assess steps taken to evaluate electrical or mechanical system performance. In contrast, engineers from the two sub-disciplines used different forms of representation when depicting components and arrangements of engineering systems. While practices that are common across sub-disciplines will inform a model of DLI in engineering for K-12 settings, discipline-specific practices can be used to develop and/or improve undergraduate engineering curricula.« less

In this theory paper, we set out to consider, as a matter of methodological interest, the use of quantitative measures of inter-coder reliability (e.g., percentage agreement, correlation, Cohen’s Kappa, etc.) as necessary and/or sufficient correlates for quality within qualitative research in engineering education. It is well known that the phrase qualitative research represents a diverse body of scholarship conducted across a range of epistemological viewpoints and methodologies. Given this diversity, we concur with those who state that it is ill advised to propose recipes or stipulate requirements for achieving qualitative research validity and reliability. Yet, as qualitative researchers ourselves, we repeatedly find the need to communicate the validity and reliability—or quality—of our work to different stakeholders, including funding agencies and the public. One method for demonstrating quality, which is increasingly used in qualitative research in engineering education, is the practice of reporting quantitative measures of agreement between two or more people who code the same qualitative dataset. In this theory paper, we address this common practice in two ways. First, we identify instances in which inter-coder reliability measures may not be appropriate or adequate for establishing quality in qualitative research. We query research that suggests that the numerical measure itselfmore »is the goal of qualitative analysis, rather than the depth and texture of the interpretations that are revealed. Second, we identify complexities or methodological questions that may arise during the process of establishing inter-coder reliability, which are not often addressed in empirical publications. To achieve this purposes, in this paper we will ground our work in a review of qualitative articles, published in the Journal of Engineering Education, that have employed inter-rater or inter-coder reliability as evidence of research validity. In our review, we will examine the disparate measures and scores (from 40% agreement to 97% agreement) used as evidence of quality, as well as the theoretical perspectives within which these measures have been employed. Then, using our own comparative case study research as an example, we will highlight the questions and the challenges that we faced as we worked to meet rigorous standards of evidence in our qualitative coding analysis, We will explain the processes we undertook and the challenges we faced as we assigned codes to a large qualitative data set approached from a post positivist perspective. We will situate these coding processes within the larger methodological literature and, in light of contrasting literature, we will describe the principled decisions we made while coding our own data. We will use this review of qualitative research and our own qualitative research experiences to elucidate inconsistencies and unarticulated issues related to evidence for qualitative validity as a means to generate further discussion regarding quality in qualitative coding processes.« less

This study, part of a larger research project focused on disciplinary literacy within engineering (Authors, 2018), is a comparative case study of the literacy practices of two electrical engineers. The goal of this comparative case study was to understand how electrical engineers read, write, and evaluate multi-representational texts in the context of their professional lives. We used the findings from this study to construct a model of disciplinary literacy in electrical engineering, whose purpose is to prepare students for the electrical engineering workforce by teaching them to interpret and produce texts using authentic disciplinary frameworks. This paper examines the literacy practices of two electrical engineers to answer the following research questions: (1) What texts do the electrical engineers read and write? (2) What disciplinary frameworks do they use to read and write different texts? (3) How do engineers use internet searches to locate and evaluate information? (4) What role does argumentation have with respect to their literacy practices?

Despite efforts to diversify the science, technology, engineering, and mathematics (STEM) workforce, engineering remains a White, male-dominated profession. Often, women and underrepresented students do not identify with STEM careers and many opt out of STEM pathways prior to entering high school or college. In order to broaden participation in engineering, new methods of engaging and retaining those who are traditionally underrepresented in engineering are needed. This work is based on a promising approach for encouraging and supporting diverse participation in engineering: disciplinary literacy instruction (DLI). Generally, teachers use DLI to provide K-12 students with a framework for interpreting, evaluating, and generating discipline-specific texts. This instruction provides students with an understanding of how experts in the discipline read, engage, and generate texts used to solve problems or communicate information. While models of disciplinary literacy have been developed and disseminated in several humanities and science fields, there is a lack of empirical and theoretical research that examines the use of DLI within the engineering domain. It is thought that DLI can be used to foster diverse student interest in engineering from a young age by removing literacy-based barriers that often discourage underrepresented students from entering and pursuing careers in STEM fields. Thismore »work-in-progress paper describes a new study underway to develop and disseminate a model of disciplinary literacy in engineering. During this project, researchers will observe, interview, and collect written artifacts from engineers working across four sub-disciplines of engineering: aerospace/mechanical, biological, civil/environmental, and electrical/computer. Data that will be collected include interview transcripts, observation field notes, engineer logs of literacy practices, and photographs of texts that the engineers read and write. Data will be analyzed using constant comparative analytic (CCA) methods. CCA will be used to generate theoretical codes from the data that will form the basis for a model of disciplinary literacy in engineering. As a primary outcome of this research, the engineering DLI model will promote the use of DLI practices within K-12 engineering instruction in order to assist and encourage diverse, underrepresented students to engage in engineering courses of study and pursue STEM careers. Thus far, the research team has begun collecting and analyzing data from two electrical engineers. This work in progress paper will report on preliminary findings, as well as implications for K-12 classroom instruction. For instance, this study has shed insights on how engineers use texts as part of the process of conducting failure analysis, and the research team has begun to conceptualize how these types of texts might be used with K-12 students to help them conduct failure analyses during design testing. Ultimately, this project will result in a list of grade-appropriate texts, evaluative frameworks, and activities (e.g., failure analysis in testing) that K-12 engineering teachers can use to prepare their diverse students to think, act, read, and write like engineers.« less