skip to main content


Title: Work In Progress: Considering the Impact on Research Quality of a Team Approach to Phenomenography
This WIP paper describes a team approach to phenomenography on ethical engineering practice in the health products industry and its potential impact on research quality. Although qualitative researchers often conduct phenomenography collaboratively, most often a single individual leads the data collection and analysis; others primarily serve as critical reviewers. However, quality may be enhanced by involving collaborators as data analysts in “sustained cycles of scrutiny, debate and testing against the data” [1, p. 88], thus interweaving unique perspectives and insights throughout the analysis process. Nonetheless, collaborating in this intensive data analysis process also presents unique challenges. In this paper, we (1) describe the processes we are applying in an integrated team-based phenomenographic study, (2) identify how the team approach affects research quality, and (3) reflect on the challenges inherent to this process. We ground this reflective case study in the methodological literature on phenomenography. Our team strategies include multiple interviewers (and, when possible, two interviewers per inter-view), team communication through reflective memos, and integration of individual and team-based data analysis with peer critique of individual analyses. We compare our team approach with typical individual phenomenographic approaches, and we align our procedures with the five strategies of the Qualifying Qualitative Research Quality Framework, or Q3, designed by Walther, Sochacka, and Kellam [2]. In aligning strategies, we consider benefits and trade-offs.  more » « less
Award ID(s):
1737303
NSF-PAR ID:
10312452
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
Work In Progress: Considering the Impact on Research Quality of a Team Approach to Phenomenography
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This Work-in-Progress Research paper describes (1) the contemporary research space on ethics education in engineering; (2) our long-term research plan; (3) the theoretical underpinnings of Phase 1 of our research plan (phenomenography); and (4) the design and developmental process of a phenomenographic interview protocol to explore engineers’ experiences with ethics. Ethical behavior is a complex phenomenon that is complicated by the institutional and cultural contexts in which it occurs. Engineers also have varied roles and often work in a myriad of capacities that influence their experiences with and understanding of ethics in practice. We are using phenomenography, a qualitative research approach, to explore and categorize the ways engineers experience and understand ethical engineering practice. Specifically, phenomenography will allow us to systematically investigate the range and complexity of ways that engineers experience ethics in professional practice in the health products industry. Phenomenographic data will be obtained through a specialized type of semi-structured interview. Here we introduce the design of our interview protocol and its four sections: Background, Experience, Conceptual, and Summative. We also describe our iterative process for framing questions throughout each section. 
    more » « less
  2. Three broad issues have been identified in the professional formation of engineers: 1) the gap between what students learn in universities and what they practice upon graduation; 2) the limiting perception that engineering is solely technical, math, and theory oriented; and 3) the lack of diversity (representation of a wide range of people) and lack of inclusion (incorporation of different perspectives, values, and ways of thinking and being in engineering) in many engineering programs. These are not new challenges in engineering education, rather they are persistent and difficult to change. There have been countless calls to recruit and retain women and underrepresented minority group members into engineering careers and numerous strategies proposed to improve diversity, inclusion, and retention, as well as to calls to examine socio-technical integration in engineering cultures and education for professional formation. Despite the changes in some disciplinary profiles in engineering and the curricular reforms within engineering education, there still has not been the deep transformation needed to integrate inclusionary processes and thinking into professional formation. In part, the reason is that diversity and inclusion are still framed as simply “numbers problems” to be solved. What is needed instead is an approach that understands and explores diversity and inclusion as interrelated with the epistemological (what do engineers need to know) and ontological (what does it mean to be an engineer) underpinnings of engineering. These issues are highly complex, interconnected, and not amenable to simple solutions, that is, they are “wicked” problems. They require design thinking. Thus our NSF-funded Research in the Formation of Engineers (RFE) study utilizes a design thinking approach and research activities to explore foundational understandings of formation and diversity and inclusion in engineering while addressing the three project objectives: 1) Better prepare engineers for today’s workforce; 2) Broaden understandings of engineering practice as both social and technical; and 3) Create and sustain more diverse and inclusionary engineering programs. The project is organized around the three phases of the design process (inspiration, ideation, and implementation), and embedded within the design process is a longitudinal, multiphase, mixed-methods study. Although the goal is to eventually study these objectives on a broader scale, we begin with a smaller context: the School of Electrical and Computer Engineering (ECE) and the Weldon School of Biomedical Engineering (BME) at Purdue University. These schools share similarities with some common coursework and faculty, but also provide contrasts as BME’s undergraduate population, on average for recent semesters, has been 44-46% female, where ECE has been 13-14% female. Although BME has slightly more underrepresented minority students (7-8% versus 5%), approximately 60% of BME students are white, versus 40% for ECE. It is important to note that Purdue’s School of ECE offers B.S. degrees in Electrical Engineering (EE) and Computer Engineering (CmpE), which reflect unique disciplinary cultures. Additionally, the schools differ significantly on undergraduate enrollment. The BME enrollment was 278, whereas ECE’s enrollment was 675 in EE and 541 in CmpE1. In this paper we describe the background literature and the research design, including the study contexts, target subject populations, and procedures for quantitative and qualitative data collection and analysis. In addition, we present the data collected during the first phase of the research project. In our poster, we will present preliminary analysis of the first phase data. 
    more » « less
  3. This work-in-progress research paper explores the intersection of cross-functional teamwork and design thinking within the course design process through collaborative autoethnography. Collaborative autoethnography uses individual and dialogic reflections to provide a detailed and nuanced exploration of experiences within a culture (e.g., a course design team) and generate insights that might inform broader community of individuals who experience related cultures. In this study, we investigate how individual educators attempt to shape and are shaped by a unique team course design process in electrical and computer engineering. The participant-researchers in this study are three electrical and computer engineering faculty members and one engineering education researcher who have participated in a six-semester-long course redesign effort. The effort has emphasized building and utilizing a new cross-functional team approach, imbued with design thinking strategies, to support improved professional formation and student-centeredness within an embedded systems course for electrical and computer engineering students. In this study, data collection and analysis were integrated and iterative. This process engaged cycles of setting writing prompts, individual writing, group discussion and reflection, and setting new writing prompts. This process was repeated as participant-researchers and the team as a whole refined their insights, explored emergent topics, and connected their observations to external research and scholarship. The autoethnographic process is ongoing, but five themes have emerged that describe key features of the team course design process and experience: (1) uncertainty, (2) navigating the team, (3) navigating the self, (4) navigating the system, and (5) process. The paper features a collection of participant-researcher reflections related to these emergent themes. 
    more » « less
  4. The lack of community-relevant flood informational resources and tools often results in inadequate and divergent understandings of flood risk and can impede communities' ability to function cohesively in the face of increasing flood threats. The current study reports on a set of workshops that the authors conducted with various groups (citizens, city engineers and planners, realtors and builders, and media representatives) within a flood prone community to evaluate how novel hydroinformatic tools that include hydrodynamic modeling, geospatial visualization, and socioeconomic analysis can enhance understanding of flood risk and engagement in flood risk mitigation among diverse community members. The workshops were designed to help identify stakeholder preferences regarding key functionality needed for integrated hydroinformatic technologies and socioeconomic analyses for flood risk reduction. Workshop participants were asked to use and comment on examples of prototype flood risk informational tools, such as: (1) flood damage estimation tool, (2) drivability and emergency accessibility tool, and (3) community-scale social and economic metrics tool. Data gathered from workshops were analyzed using qualitative analysis based on a grounded-theory approach. Data were coded by hand based on themes identified by the research team and incorporated deviant case analysis to ensure minority opinions was represented. The study results are focused on the following main themes and how flood tools can address them: (1) improving the understanding of flood risk and engagement in flood risk mitigation, (2) reducing the gap between individual and community risk, (3) challenges in communicating flood risk information, (4) enhancing relevance to and engagement of the community, and (5) enabling actionable information. Our research demonstrates the need for community-anchored tools and technologies that can illustrate local context, include local historical and simulated events at multiple levels of community impact, enable analyses by flood professionals while also providing simplified tools of use by citizens, and allow individuals to expand their knowledge beyond their homes, businesses, and places of work. 
    more » « less
  5. Purpose Personas are lifelike characters that are driven by potential or real users’ personal goals and experiences when interacting with a product. Personas support user-centered design by focusing on real users’ needs. However, the use of personas in educational research and design requires certain adjustments from its original use in human-computer interface design. This paper aims to propose a process of creating personas from phenomenographic studies, which helps us create data-grounded personas effectively. Design/methodology/approach Personas have features that can help address design problems in educational contexts. The authors compare the use of personas with other common methodologies in education research, including phenomenology and phenomenography. Then, this study presents a six-step process of building personas using phenomenographic study as follows: articulate a design problem, collect user data, assemble phenomenographic categories, build personas, check personas and solve the design problem using personas. The authors illustrate this process with two examples, including the redesign of a professional development website and an undergraduate research program design. Findings The authors find that personas are valuable tools for educational design websites and programs. Phenomenography can productively help educational designers and researchers build sets of personas following the process the authors propose. Originality/value The use and method of personas in educational contexts are scarce and vague. Using the example contexts, the authors provide educational designers and researchers a clear method of creating personas that are relatable and applicable for their design problems. 
    more » « less