skip to main content


Title: Evaluation of EDISON's data science competency framework through a comparative literature analysis

During the emergence of Data Science as a distinct discipline, discussions of what exactly constitutes Data Science have been a source of contention, with no clear resolution. These disagreements have been exacerbated by the lack of a clear single disciplinary 'parent.' Many early efforts at defining curricula and courses exist, with the EDISON Project's Data Science Framework (EDISON-DSF) from the European Union being the most complete. The EDISON-DSF includes both a Data Science Body of Knowledge (DS-BoK) and Competency Framework (CF-DS). This paper takes a critical look at how EDISON's CF-DS compares to recent work and other published curricular or course materials. We identify areas of strong agreement and disagreement with the framework. Results from the literature analysis provide strong insights into what topics the broader community see as belonging in (or not in) Data Science, both at curricular and course levels. This analysis can provide important guidance for groups working to formalize the discipline and any college or university looking to build their own undergraduate Data Science degree or programs.

 
more » « less
Award ID(s):
1839259 1740741 1839270
NSF-PAR ID:
10314377
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Foundations of Data Science
Volume:
0
Issue:
0
ISSN:
2639-8001
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Sinatra, Anne M. (Ed.)
    This paper presents our latest research on the efficient support of Data Science (DS) students in higher education, particularly focusing on underserved universities. The need for new graduates and professionals to upskill in DS surpasses the capacity of universities to offer conventional classes, particularly in underserved universities (NASEM, 2018). Our solution provides otherwise unavailable DS courses for all students by implementing the Generalized Intelligent Framework for Tutoring (GIFT, Sottilare et al., 2012) to develop a multi-university adaptive distributed learning (ADL) environment that can share DS courses and facilitate student learning from anywhere at any time. This distributed learning ecosystem using Department of Defense (DOD)-initiated technologies (ADL, 2018) allows students from 11 networked universities to share courses and resources, providing equal access to underserved and better-equipped research universities within the system. Besides GIFT, the ADL environment integrates the learning management system (LMS), Moodle, competency management software such as Competence and Skill System (CaSS, 2021), and Learning Record Stores (LRSs) to collect and analyze data for personalized learning. Our instructional design and course development efficiently align learning objectives, activities, and assessments of DS student competencies based on the Edison DS Competency Framework (Edison, 2017). 
    more » « less
  2. The field of Mechatronics and Robotics Engineering (MRE) is emerging as a distinct academic discipline. Previously, courses in this field have been housed in departments of Mechanical Engineering, Electrical Engineering, or Computer Science, instead of a standalone department or curriculum. More recently, single, freestanding courses have increasingly grown into course sequences and concentrations, with entire baccalaureate and graduate degree programs now being offered. The field has been legitimized in recent years with the National Center for Education Statistics creating the Classification of Instructional Programs (CIP) code 14.201 Mechatronics, Robotics, and Automation Engineering. As of October 2019, ABET accredits a total of 9 B.S. programs in the field: 5 Mechatronics Engineering, 3 Robotics Engineering, 1 Mechatronics and Robotics Engineering, and none in Automation Engineering. Despite recent tremendous and dynamic growth, MRE lacks a dedicated professional organization and has no discipline-specific ABET criteria. As the field grows more important and widespread, it becomes increasingly relevant to formalize and standardize the curricula of these programs. This paper begins a conversation about the contents of a cohesive concept inventory for MRE. The impetus for this effort grew from a set of four industry and government sponsored workshops held around the country named the Future of Mechatronics and Robotics Engineering (FoMRE). These workshops brought together multidisciplinary academic professionals and industry leaders in the field, and ran from September 2018 to September 2019. The study presented here focuses primarily on programs at the baccalaureate level, but informs discussion at the graduate level as well. A survey is prepared with lists of potential concept inventory items, and asks university faculty, students and practicing engineers to identify which concepts lie at the core of MRE. Because of the interdisciplinary nature of the field, a wide range of basic concepts including physical quantities and units, circuit analysis, digital logic, electronics, programming, computer-aided design, solid and fluid mechanics, chemistry, dynamic systems and controls, and mathematics are considered. Questions ask participants to rank the priority or importance of potential core concepts from these categories and also provide opportunities for open-ended response. The results of this survey identify gaps between existing undergraduate curricula, student experience, and employer expectations, and continuing work will provide insight into the direction of a unifying curricular design for MRE education. 
    more » « less
  3. Web-browsing histories, online newspapers, streaming music, and stock prices all show that we live in an age of data. Extracting meaning from data is necessary in many fields to comprehend the information flow. This need has fueled rapid growth in data science education aiming to serve the next generation of policy makers, data science researchers, and global citizens. Initially, teaching practices have been drawn from data science's parent disciplines (e.g., computer science and mathematics). This project addresses the early stages of developing a concept inventory of student difficulty within the newly emerging field of data science. In particular this project will address three primary research objectives: (1) identify student misconceptions in data science courses; (2) document students’ prior knowledge and identify courses that teach early data science concepts; and (3) confirm expert identification of data science concepts, and their importance for introductory-level data science curricula. During the first year of this grant, we have collected approximately 200 responses for a survey to confirm concepts from an existing body of knowledge presented by the Edison Project. Survey respondents are comprised of faculty and industry practitioners within data science and closely related fields. Preliminary analysis of these results will be presented with respect to our third research objective. In addition, we developed and launched a pilot assessment for identifying student difficulties within data science courses. The protocol includes regular responses to reflective questions by faculty, teaching assistants, and students from selected data science courses offered at the three participating institutions. Preliminary analyses will be presented along with implications for future data collection in year two of the project. In addition to the anticipated results, we expect that the data collection and analysis methodologies will be of interest to many scholars who have or will engage in discipline-based educational research. 
    more » « less
  4. Bennett, M. ; Frank, B. ; Vieyra, R. (Ed.)
    As the field of Quantum Information Science (QIS) continues to advance, there is an increased need for a quantum-smart workforce to address the needs of the growing quantum industry. As institutions begin to expand their course offerings, there is a unique opportunity for discipline-based education researchers to have an impact on the curricular and pedagogical choices being made in these courses. As a first step, it is necessary for education researchers to have a representative picture of what QIS education currently looks like. We reviewed recent course catalogues from a large sample of institutions in the United States looking for courses focused on QIS content. Our conservative analysis reveals that roughly a quarter of the institutions we reviewed offer QIS courses. While encouraging for such an emerging field, we found disparities in the types of institutions offering these courses as the vast majority were Doctoral-granting institutions. Additionally, we found that some classifications of minority serving institutions were much less likely to offer a QIS course (for example Historically Black Colleges and Universities or Predominantly Black Institutions), while Asian American and Native American Pacific Islander serving institutions were more likely than the national average to offer a QIS course. These disparities may lead to further racial, socioeconomic, and geographic disparity in the future quantum workforce. We also found that there was no single department that offered a majority of the QIS courses, indicating that the best efforts to improve QIS education will need to consider the multi-disciplinary nature of the field of quantum information science. 
    more » « less
  5. What responsibility do faculty leaders have to understand the ethics frameworks of their faculty colleagues? To what extent do leaders have capacity to enact that responsibility, given constraints on curricular space, expertise, basic communication skills, and the political climate? The landscape of disciplinary ethics frameworks, or the value content and structured experiences that shape professional development and disciplinary enculturation, reaches wide across the curriculum and deep into the discipline [1][2][3]. This landscape might include frameworks ranging from accrediting bodies and institutional compliance structures to state and national laws and departmental cultures. Coupled to the diversity of specializations within a single discipline, this landscape is richly complex. Yet, faculty leaders play important roles in shaping departmental and programmatic cultures, which are at least partially informed by the disciplinary value landscape. The objective of this paper is to build on previous work [4] to explore this problem of faculty leader responsibility by contrasting faculty leaders’ perspectives on disciplinary values with the values evidenced by their professional organizations. To evidence this contrast, we compare data from interviews with faculty leaders in departments of biology and computer science at a large metropolitan high research intensive HSI-serving university against data scraped from the websites of professional organizations those leaders reference as ethics frameworks. We analyze both sets of data using content analytics methods to examine qualitative and quantitative differences between them. This comparison is part of a larger institutional study looking at this problem across a wide diversity of disciplines [5]. We find an anticipated disparity between identification of the disciplinary frameworks and their content, opening space for discussion about the impact of national ethics frameworks at the local disciplinary level. But we also find an unanticipated diversity of types of ethics frameworks identified by faculty leaders, demonstrating the complexity of just how value frameworks inform disciplinary enculturation through leadership and training. Based on our findings, we articulate the relationship between responsibility and accountability [6] in the process of values-driven disciplinary enculturation. This work is relevant to ethics in that if ethics frameworks and the values they encode play a role in disciplinary enculturation, and there is a disconnect between faculty leaders perceptions of ethics frameworks and their disciplines explicit communications of their values, then the processes and practices of disciplinary enculturation could be more tightly connected to disciplinary values – resulting in more richly ethical professionals. *note: a version of this abstract is also submitted concurrently as a presentation to the Association of Practical and Professional Ethics (APPE), which does not publish abstracts or proceedings papers. [1] Tuana, Nancy. 2013. “Embedding Philosophers in the Practices of Science: Bringing Humanities to the Sciences.” Synthese 190(11): 1955-1973. [2] West, C. and Chur-Hansen, A. (2004). Ethical Enculturation: The Informal and Hidden Ethics Curricula at an Australian Medical School. Focus on Health Professional Education: a Multi-Disciplinary Journal 6(1): 85-99. [3] Nieusma, D. and Cieminski, M. (2018). Ethics Education as Enculturation: Student Learning of Personal, Social, and Professional Responsibility. 2018 ASEE Annual Conference and Exposition. Paper 23665. [4] Pinkert, L.A., Taylor, L., Beever, J., Kuebler, S.M., Klonoff, E. (2022). Disciplinary Leaders Perceptions of Ethics: An Interview-Based Study of Ethics Frameworks. 2022 ASEE Annual Conference and Exposition. https://peer.asee.org/41614. [5] National Science Foundation, “Award Abstract # 2024296 Institutional Transformation: Intersections of Moral Foundations and Ethics Frameworks in STEM Enculturation.” https://www.nsf.gov/awardsearch/showAward?AWD_ID=2024296, 2020. 
    more » « less