Search for: All records

The release of the Information Technology (IT) 2017 curricular guidelines provided the impetus to focus on students’ professional competencies by incorporating authentic practice into disciplinary content. Authentic practices require appropriate learning experiences such as workplace-bound experiences, employer engagement with programs via paid internships, and critical reflection on what was learned. Both professional technical and non-technical skills must be emphasized for such authenticity. However, practical assessment of the learning of professional competencies remains challenging. This paper develops such a practical assessment approach to IT competencies. It builds on the industry-led Skills Framework for the Information Age (SFIA) that defines over 120 IT professional skills across seven levels of responsibility and experience. SFIA provides actionable and measurable activities and behaviors, which IT graduates need to demonstrate in the workplace. The paper explores the assessment of student performance on authentic, real-world tasks using a rubric-based scoring scheme supported by a systematic collection of sample student work over their time in the program. It concludes with a discussion of the validation of the proposed approach to demonstrate its practicality. 

This Innovative Practice Full Paper addresses the assessment of dispositions which, along with knowledge and skills, form the three legs of competency needed to perform a task in context, as described in recent computing curricular reports, particularly ACM/IEEE Computing Curricula 2020 (CC2020). Here, dispositions in CC2020 express the behavioral characteristics of competence, such as being adaptable, collaborative, or inventive. Instructors have assessed knowledge from the start of computing programs and have paid increased attention to assessing skills in recent decades. However, dispositions and their role within competency is relatively new, with little guidance available for assessing dispositions. Lately, computing instructors have begun to understand the importance of evaluating dispositions during the performance of tasks in the real world or in the context of the industry-based global Skills Framework for the Information Age (SFIA). Hence, this paper develops a criterion-based approach for use by educators in assessing competence based on a reflective portfolio of "real-world" achievements. Building on concepts developed by the UK Institute of Coding and other recent reports, this work demonstrates how this assessment approach relates to industry-based competency frameworks such as SFIA and the European e-Competence Framework (eCF). The paper also explores using the criterion-based approach in a classroom environment to help students focus on particular dispositions. Its main contribution is to advance the competency focus in academic computing programs and future computing curricula. 

Program accreditation in medical or religious professions has existed since the 1800s while accreditation of business and engineering programs started in the early twentieth century. With this long history, these disciplines have focused on ensuring the competence of their graduates, as modern society demands appropriate expertise from doctors and engineers before letting them practice their profession. In computing, however, professional accreditation started in the last decades of the twentieth century only after computer science, informatics, and information systems programs became widespread. At the same time, although competency-based learning has existed for centuries, its growth in computing is relatively new, resulting from recent curricular reports such as Computing Curricula 2020, which have defined competency comprising knowledge, skills, and dispositions. In addition, demands are being placed on university programs to ensure their graduates are ready to enter and sustain employment in the computing profession. This work explores the role of accreditation in forming and developing professional competency in non-computing disciplines worldwide, building on this understanding to see how computing accreditation bodies could play a similar role in computing. This work explores the role of accreditation in forming and developing professional competency in non-computing disciplines worldwide, building on this understanding to see how computing accreditation bodies could play a similar role in computing. Its recommendations are to incorporate competencies in all computing programs and future curricular guidelines; create competency-based models for computing programs; involve industry in identifying workplace competencies, and ensure accreditation bodies include competencies and the assessment in their standards. 

In the past decade, academic computing curricular guidelines have shifted from specifying knowledge and occasionally technical skills to establishing the overall competence expected of graduates. For instance, Computing Curricula 2020 (CC2020) guidelines identify competency as knowledge, skills, and dispositions where “dispositions” correspond to the behavioral and professional characteristics driven by employer needs and captured by industry-driven frameworks, such as the Skills Framework for the Information Age (SFIA). Computing programs thus must also ensure that graduates have these characteristics to improve initial employment and long-term career prospects. This paper aims to understand and achieve consistency between academia and industry curricular frameworks. The CC2020 dispositions map to the responsibility characteristics for SFIA Level 3, the level appropriate for a new graduate. As the mapping is not one-to-one, the paper reviews the extent to which each SFIA responsibility characteristic requires and enables the CC22020 dispositions, identifying potential shortcomings and, conversely, the importance of each disposition as it supports the responsibility characteristics. The developed mapping is validated by relating the CC2020 dispositions to the SFIA behavioral factors, the principal “21st Century Skills,” and relevant competency-based educational frameworks. Thus, dispositions in competency-focused curricula map to the actual competencies sought by employers. Finally, the paper postulates that future computing curricula must further develop the CC2020 dispositions and relate them to SFIA to guide academic programs in their preparation of career-ready graduates to reduce the current “skills gap”.