Who and by what means do we ensure that engineering education evolves to meet the ever changing needs of our society? This and other papers presented by our research team at this conference offer our initial set of findings from an NSF sponsored collaborative study on engineering education reform. Organized around the notion of higher education governance and the practice of educational reform, our open-ended study is based on conducting semi-structured interviews at over three dozen universities and engineering professional societies and organizations, along with a handful of scholars engaged in engineering education research. Organized as a multi-site, multi-scale study, our goal is to document differences in perspectives and interest the exist across organizational levels and institutions, and to describe the coordination that occurs (or fails to occur) in engineering education given the distributed structure of the engineering profession.
This paper offers for all engineering educators and administrators a qualitative and retrospective analysis of ABET EC 2000 and its implementation. The paper opens with a historical background on the Engineers Council for Professional Development (ECPD) and engineering accreditation; the rise of quantitative standards during the 1950s as a result of the push to implement an engineering science curriculum appropriate to the Cold War era; EC 2000 and its call for greater emphasis on professional skill sets amidst concerns about US manufacturing productivity and national competitiveness; the development of outcomes assessment and its implementation; and the successive negotiations about assessment practice and the training of both of program evaluators and assessment coordinators for the degree programs undergoing evaluation. It was these negotiations and the evolving practice of assessment that resulted in the latest set of changes in ABET engineering accreditation criteria (“1-7” versus “a-k”).
more »
« less
ABET & Engineering Accreditation - History, Theory, Practice: Initial Findings from a National Study on the Governance of Engineering Education
Who and by what means do we ensure that engineering education evolves to meet the ever changing needs of our society? This and other papers presented by our research team at this conference offer our initial set of findings from an NSF sponsored collaborative study on engineering education reform. Organized around the notion of higher education governance and the practice of educational reform, our open-ended study is based on conducting semi-structured interviews at over three dozen universities and engineering professional societies and organizations, along with a handful of scholars engaged in engineering education research. Organized as a multi-site, multi-scale study, our goal is to document differences in perspectives and interest the exist across organizational levels and institutions, and to describe the coordination that occurs (or fails to occur) in engineering education given the distributed structure of the engineering profession.
This paper offers for all engineering educators and administrators a qualitative and retrospective analysis of ABET EC 2000 and its implementation. The paper opens with a historical background on the Engineers Council for Professional Development (ECPD) and engineering accreditation; the rise of quantitative standards during the 1950s as a result of the push to implement an engineering science curriculum appropriate to the Cold War era; EC 2000 and its call for greater emphasis on professional skill sets amidst concerns about US manufacturing productivity and national competitiveness; the development of outcomes assessment and its implementation; and the successive negotiations about assessment practice and the training of both of program evaluators and assessment coordinators for the degree programs undergoing evaluation. It was these negotiations and the evolving practice of assessment that resulted in the latest set of changes in ABET engineering accreditation criteria (“1-7” versus “a-k”).
To provide an insight into the origins of EC 2000, the “Gang of Six,” consisting of a group of individuals loyal to ABET who used the pressure exerted by external organizations, along with a shared rhetoric of national competitiveness to forge a common vision organized around the expanded emphasis on professional skill sets. It was also significant that the Gang of Six was aware of the fact that the regional accreditation agencies were already contemplating a shift towards outcomes assessment; several also had a background in industrial engineering. However, this resulted in an assessment protocol for EC 2000 that remained ambiguous about whether the stated learning outcomes (Criterion 3) was something faculty had to demonstrate for all of their students, or whether EC 2000’s main emphasis was continuous improvement. When it proved difficult to demonstrate learning outcomes on the part of all students, ABET itself began to place greater emphasis on total quality management and continuous process improvement (TQM/CPI). This gave institutions an opening to begin using increasingly limited and proximate measures for the “a-k” student outcomes as evidence of effort and improvement. In what social scientific terms would be described as “tactical” resistance to perceived oppressive structures, this enabled ABET coordinators and the faculty in charge of degree programs, many of whom had their own internal improvement processes, to begin referring to the a-k criteria as “difficult to achieve” and “ambiguous,” which they sometimes were.
Inconsistencies in evaluation outcomes enabled those most discontented with the a-k student outcomes to use ABET’s own organizational processes to drive the latest revisions to EAC accreditation criteria, although the organization’s own process for member and stakeholder input ultimately restored much of the professional skill sets found in the original EC 2000 criteria. Other refinements were also made to the standard, including a new emphasis on diversity. This said, many within our interview population believe that EC 2000 had already achieved much of the changes it set out to achieve, especially with regards to broader professional skills such as communication, teamwork, and design. Regular faculty review of curricula is now also a more routine part of the engineering education landscape. While programs vary in their engagement with ABET, there are many who are skeptical about whether the new criteria will produce further improvements to their programs, with many arguing that their own internal processes are now the primary drivers for change.
more »
« less
- Award ID(s):
- 1818454
- NSF-PAR ID:
- 10106685
- Date Published:
- Journal Name:
- ASEE Annual Conference proceedings
- Volume:
- 126
- ISSN:
- 1524-4644
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This paper reflects on the significance of ABET’s “maverick evaluators” and what it says about the limits of accreditation as a mode of governance in US engineering education. The US system of engineering education operates as a highly complex system, where the diversity of the system is an asset to robust knowledge production and the production of a varied workforce. ABET Inc., the principal accreditation agency for engineering degree programs in the US, attempts to uphold a set of professional standards for engineering education using a voluntary, peer-based system of evaluation. Key to their approach is a volunteer army of trained program evaluators (PEVs) assigned by the engineering professional societies, who serve as the frontline workers responsible for auditing the content, learning outcomes, and continuous improvement processes utilized by every engineering degree program accredited by ABET. We take a look specifically at those who become labeled “maverick evaluators” in order to better understand how this system functions, and to understand its limitations as a form of governance in maintaining educational quality and appropriate professional standards within engineering education. ABET was established in 1932 as the Engineers’ Council for Professional Development (ECPD). The Cold War consensus around the engineering sciences led to a more quantitative system of accreditation first implemented in 1956. However, the decline of the Cold War and rising concerns about national competitiveness prompted ABET to shift to a more neoliberal model of accountability built around outcomes assessment and modeled after total quality management / continuous process improvement (TQM/CPI) processes that nominally gave PEVs greater discretion in evaluating engineering degree programs. However, conflicts over how the PEVs exercised judgment points to conservative aspects in the structure of the ABET organization, and within the engineering profession at large. This paper and the phenomena we describe here is one part of a broader, interview-based study of higher education governance and engineering educational reform within the United States. We have conducted over 300 interviews at more than 40 different academic institutions and professional organizations, where ABET and institutional responses to the reforms associated with “EC 2000,” which brought outcomes assessment to engineering education, are extensively discussed. The phenomenon of so-called “maverick evaluators” reveal the divergent professional interests that remain embedded within ABET and the engineering profession at large. Those associated with Civil and Environmental Engineering, and to a lesser extent Mechanical Engineering continue to push for higher standards of accreditation grounded in a stronger vision for their professions. While the phenomenon is complex and more subtle than we can summarize in an abstract, “maverick evaluators” emerged as a label for PEVs who interpreted their role, including determinations about whether certain content “appropriate to the field of study,” utilizing professional standards that lay outside of the consensus position held by the majority of the member of the Engineering Accreditation Commission. This, conjoined with the engineers’ epistemic aversion to uncertainty and concerns about the legal liability of their decisions, resulted in a more narrow interpretation of key accreditation criteria. The organization then designed and used a “due-process” reviews process to discipline identified shortcomings in order to limit divergent interpretations. The net result is that the bureaucratic process ABET built to obtain uniformity in accreditation outcomes, simultaneously blunts the organization’s capacity to support varied interpretations of professional standards at the program level. The apparatus has also contributed to ABET’s reputation as an organization focused on minimum standards, as opposed to one that functions as an effective driver for further change in engineering education.more » « less
-
Most engineering programs in the United States are accredited by ABET under the guidelines known as EC-2000. The EC-2000 framework is broadly based on the continual quality management (CQM) movement in industry where programs are striving to constantly improve the quality of their output, in this case the skills of graduates. Broadly speaking, ABET evaluates engineering programs on eight different criteria; some are related to processes, some to resources, but those central to CQM are program educational objectives, that define hoped for long-term accomplishments of graduates, and outcomes which articulate what students can do when they graduate. Degree programs must convince ABET they have a documented and effective process to improve outcomes to gain accreditation. CQM of course is not the only framework by which educational development can be framed or measured. This paper explores ABET processes through the lens of the economist Amartya Sen’s capability approach, which is broadly applied in the developing world in areas of inequity, poverty, and human rights. The capability approach is often used when a focus on diverse individuals is desirable for understanding aspects of development. Central to Sen’s approach are capabilities and functionings. Capabilities are the resources and supports in an individual’s environment that provide opportunities to pursue a life they value. Functionings are what they actually become and do. Thus capabilities can be thought of as the potential for functionings; alternatively capabilities are opportunities and functionings are outcomes. This paper compares ABET’s accreditation criteria with a published set of capabilities in education. The comparison shows there are some areas where criteria overlap with capabilities, but also several areas where the overlap is low. The capabilities that aligned most with ABET criteria overlap with engineering epistemologies and a view of students as the ‘product’ of engineering education.more » « less
-
Most engineering programs in the United States are accredited by ABET under the guidelines known as EC-2000. The EC-2000 framework is broadly based on the continual quality management (CQM) movement in industry where programs are striving to constantly improve the quality of their output, in this case the skills of graduates. Broadly speaking, ABET evaluates engineering programs on eight different criteria; some are related to processes, some to resources, but those central to CQM are program educational objectives, that define hoped for long-term accomplishments of graduates, and outcomes which articulate what students can do when they graduate. Degree programs must convince ABET they have a documented and effective process to improve outcomes to gain accreditation. CQM of course is not the only framework by which educational development can be framed or measured. This paper explores ABET processes through the lens of the economist Amartya Sen’s capability approach, which is broadly applied in the developing world in areas of inequity, poverty, and human rights. The capability approach is often used when a focus on diverse individuals is desirable for understanding aspects of development. Central to Sen’s approach are capabilities and functionings. Capabilities are the resources and supports in an individual’s environment that provide opportunities to pursue a life they value. Functionings are what they actually become and do. Thus capabilities can be thought of as the potential for functionings; alternatively capabilities are opportunities and functionings are outcomes. This paper compares ABET’s accreditation criteria with a published set of capabilities in education. The comparison shows there are some areas where criteria overlap with capabilities, but also several areas where the overlap is low. The capabilities that aligned most with ABET criteria overlap with engineering epistemologies and a view of students as the ‘product’ of engineering education.more » « less
-
Engineering education research and accreditation criteria have for some time emphasized that to adequately prepare engineers to meet 21st century challenges, programs need to move toward an approach that integrates professional knowledge, skills, and real-world experiences throughout the curriculum [1], [2], [3]. An integrated approach allows students to draw connections between different disciplinary content, develop professional skills through practice, and relate their emerging engineering competencies to the problems and communities they care about [4], [5]. Despite the known benefits, the challenges to implementing such major programmatic changes are myriad, including faculty’s limited expertise outside their own disciplinary area of specialization and lack of perspective of professional learning outcomes across the curriculum. In 2020, Montana State University initiated a five-year NSF-funded Revolutionizing Engineering Departments (RED) project to transform its environmental engineering program by replacing traditional topic-focused courses with a newly developed integrated and project-based curriculum (IPBC). The project engages all tenure-track faculty in the environmental engineering program as well as faculty from five external departments in a collaborative, iterative process to define what students should be expected to know and do at the completion of the undergraduate program. In the process, sustainability, professionalism, and systems thinking arose as foundational pillars of the successful environmental engineer and are proposed as three knowledge threads that can be woven throughout environmental engineering curricula. The paper explores the two-year programmatic redesign process and examines how lessons learned through the process can be applied to course development as the team transitions into the implementation phase of the project. Two new integrated project-based learning courses targeting the 1st- and 2nd-year levels will be taught in academic year 2023-2024. The approach described in this work can be utilized by similar programs as a model for bottom-up curriculum development and integration of non-technical content, which will be necessary for educating engineers of the future.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
