- NSF-PAR ID:
- 10401394
- Date Published:
- Journal Name:
- 2022 ITiCSE Working Group Reports (ITiCSE-WGR ’22)
- Page Range / eLocation ID:
- 1 to 35
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
Since the early 21st century, ABET’s accreditation criteria have focused on learning outcomes (what students learn) rather than what professors teach. Such accreditation criteria bring to bear the need for programs to establish clear learning objectives and assessment processes that ensure that program graduates have the requisite technical and professional preparation. To this end, ABET defines student outcomes as “what students are expected to know and be able to do by the time of graduation,” further noting that these outcomes “relate to the knowledge, skills, and behaviors that students acquire as they progress through the program.” With the recent release of Computing Curricula 2020 (CC2020), the competencies of computing program graduates have received additional attention. CC2020 describes competency as “comprising knowledge, skills, and dispositions that are observable in accomplishing a task within a work context.” ABET’s student outcomes thus largely correspond to the CC2020 competencies of program graduates. This paper is a first attempt to reconcile the two notions in the context of computer science. It presents the relevant background and discusses student competencies and their assessments that focus on competency-based learning in computer science. The contributions of this paper are (1) forging an improved shared understanding of computing competencies and (2) an interpretation of ABET’s student outcomes to improve the competency, including dispositions, expectations of computer science graduates.more » « less
-
In the past decade, academic computing curricular guidelines have shifted from specifying knowledge and occasionally technical skills to establishing the overall competence expected of graduates. For instance, Computing Curricula 2020 (CC2020) guidelines identify competency as knowledge, skills, and dispositions where “dispositions” correspond to the behavioral and professional characteristics driven by employer needs and captured by industry-driven frameworks, such as the Skills Framework for the Information Age (SFIA). Computing programs thus must also ensure that graduates have these characteristics to improve initial employment and long-term career prospects. This paper aims to understand and achieve consistency between academia and industry curricular frameworks. The CC2020 dispositions map to the responsibility characteristics for SFIA Level 3, the level appropriate for a new graduate. As the mapping is not one-to-one, the paper reviews the extent to which each SFIA responsibility characteristic requires and enables the CC22020 dispositions, identifying potential shortcomings and, conversely, the importance of each disposition as it supports the responsibility characteristics. The developed mapping is validated by relating the CC2020 dispositions to the SFIA behavioral factors, the principal “21st Century Skills,” and relevant competency-based educational frameworks. Thus, dispositions in competency-focused curricula map to the actual competencies sought by employers. Finally, the paper postulates that future computing curricula must further develop the CC2020 dispositions and relate them to SFIA to guide academic programs in their preparation of career-ready graduates to reduce the current “skills gap”.more » « less
-
Competency-based learning has been a successful pedagogical approach for centuries, but only recently has it gained traction within computing. Competencies, as defined in Computing Curricula 2020, comprise knowledge, skills, and professional dispositions. Building on recent developments in competency and computing education, this working group examined relevant pedagogical theories, investigates various skill frameworks, reviewed competencies and standard practices in other professional disciplines such as medicine and law. It also investigated the integrative nature of content knowledge, skills, and professional dispositions in defining professional competencies in computing education. In addition, the group explored appropriate pedagogies and competency assessment approaches. It also developed guidelines for evaluating student achievement against relevant professional competency frameworks and explores partnering with employers to offer students genuine professional experience. Finally, possible challenges and opportunities in moving from traditional knowledge-based to competency-based education were also examined. This report makes recommendations to inspire educators of future computing professionals and smooth students’ transition from academia to employment.more » « less
-
Abstract The skills and competencies of IT professionals are often described using employer-led skills frameworks. They express competencies as technical knowledge and skills combined with a range of personal qualities. Employers have indicated the importance of developing such qualities for new graduates. In response, recent ACM/IEEE curricular recommendations have shifted their emphases from bodies of knowledge to the development of competencies. The IT2017 ACM/IEEE Curriculum Guidelines for Baccalaureate Degree Programs proposed a model of IT competency comprising three interrelated components: content knowledge, skills, and dispositions, where dispositions represent personal qualities desirable in the workplace. The ACM/IEEE Computing Curricula 2020 (CC2020) report enriched the IT2017 disposition concept by identifying eleven dispositions that all computing programs should include for the career preparation of their graduates. However, developing and assessing dispositions in a degree program remain challenges, often involving internships, work placements and similar student opportunities. A recent mapping of the eleven CC2020 dispositions to the responsibility characteristics of the Skills Framework for the Information Age (SFIA), a widely used professional skills framework, suggested a promising approach to addressing this challenge. Inspired by this mapping, this paper aims to help educators assess students’ achievement of CC2020 dispositions by mapping real-world experiences they have recorded in individual portfolios against the SFIA responsibility characteristics. First, the selection of SFIA to operationalize the CC2020 dispositions is validated by demonstrating that alternative frameworks pose significant challenges for any assessment approach that needs to be independent of particular technical skills. A tool is described that maps demonstration of SFIA responsibility characteristics to CC2020 dispositions, applying a simple, consistent assessment algorithm. Finally, the assessment process and outcomes are illustrated using a fictional student portfolio, constructed to reflect one author’s experience of work placement students’ achievements.
-
The release of the Information Technology (IT) 2017 curricular guidelines provided the impetus to focus on students’ professional competencies by incorporating authentic practice into disciplinary content. Authentic practices require appropriate learning experiences such as workplace-bound experiences, employer engagement with programs via paid internships, and critical reflection on what was learned. Both professional technical and non-technical skills must be emphasized for such authenticity. However, practical assessment of the learning of professional competencies remains challenging. This paper develops such a practical assessment approach to IT competencies. It builds on the industry-led Skills Framework for the Information Age (SFIA) that defines over 120 IT professional skills across seven levels of responsibility and experience. SFIA provides actionable and measurable activities and behaviors, which IT graduates need to demonstrate in the workplace. The paper explores the assessment of student performance on authentic, real-world tasks using a rubric-based scoring scheme supported by a systematic collection of sample student work over their time in the program. It concludes with a discussion of the validation of the proposed approach to demonstrate its practicality.more » « less