Researchers in many disciplines are developing novel interactive smart learning objects like exercises and visualizations. Meanwhile, Learning Management Systems (LMS) and eTextbook systems are also becoming more sophisticated in their ability to use standard protocols to make use of third party smart learning objects. But at this time, educational tool developers do not always make best use of the interoperability standards and need exemplars to guide and motivate their development efforts. In this paper we present a case study where the two large educational ecosystems use the Learning Tools Interoperability (LTI) standard to allow cross-sharing of their educational materials. At the end of our development process, Virginia Tech’s OpenDSA eTextbook system became able to import materials from Aalto University’s ACOS smart learning content server, such as python programming exercises and Parsons problems. Meanwhile, University of Pittsburgh’s Mastery Grids (which already uses the ACOS exercises) was made to support CodeWorkout programming exercises (a system already used within OpenDSA). Thus, four major projects in CS Education became inter-operable.
more »
« less
OpenDSA/Mastery Grids Exercise Interchange
OpenDSA is an e-Textbook project developed at Virginia Tech, which provides materials to support courses in a wide variety of Computer Science-related topics. OpenDSA primarily contains Java exercises. ACOS server which is a smart learning content server developed as a joint project of Aalto University and the University of Pittsburgh. It enhances the reusability of online learning activities by decoupling the content and the existing interoperability protocols including LTI. ACOS is capable of serving multiple smart contents including Python animations and exercises. In this project, we present steps toward integrating smart content served through ACOS into OpenDSA. Similarly, CodeWorkout is an open source system which helps students to practice small programming problems. Mastery Grids is also open source progress visualization environment which has open (social) learner model features designed at the University of Pittsburgh. In this project, we extended contents served by Mastery Grids by integrating CodeWorkout exercises and visualize student progress in an Open Learner Model. All of this has been possible because all of these tools support LTI, reiterating the importance of why the utilization of standards while developing applications is important.
more »
« less
- Award ID(s):
- 1740775
- PAR ID:
- 10191773
- Date Published:
- Journal Name:
- Fourth SPLICE Workshop "CS Education Infrastructure for All II: Enabling the Change" at ACM SIGCSE 2019
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)The CS Education community has developed many educational tools in recent years, such as interactive exercises. Often the developer makes them freely available for use, hosted on their own server, and usually they are directly accessible within the instructor's LMS through the LTI protocol. As convenient as this can be, instructors using these third-party tools for their courses can experience issues related to data access and privacy concerns. The tools typically collect clickstream data on student use. But they might not make it easy for the instructor to access these data, and the institution might be concerned about privacy violations. While the developers might allow and even support local installation of the tool, this can be a difficult process unless the tool carefully designed for third-party installation. And integration of small tools within larger frameworks (like a type of interactive exercise within an eTextbook framework) is also difficult without proper design. This paper describes an ongoing containerization effort for the OpenDSA eTextbook project. Our goal is both to serve our needs by creating an easier-to-manage decomposition of the many tools and sub-servers required by this complex system, and also to provide an easily installable production environment that instructors can run locally. This new system provides better access to developer-level data analysis tools and potentially removes many FERPA-related privacy concerns. We also describe our efforts to integrate Caliper Analytics into OpenDSA to expand the data collection and analysis services. We hope that our containerization architecture can help provide a roadmap for similar projects to followmore » « less
-
This paper describes updates to Database Query Analyzer (DBQA) that increase its interoperability with other learning tools using the Learning Tools Interoperability (LTI) protocol. As a result, DBQA has been integrated with Mastery Grids and allows for integration with learning management systems.more » « less
-
Despite calls over the past two decades to develop and deploy graduate STEM education models that prepare students for a variety of careers outside of academia, few innovations have emerged to meet students at their current skill and preparation levels when entering their graduate studies while also considering students’ individual desired career paths. The U.S.’s current approach to graduate STEM education does not emphasize preparing students with the professional skills and experience outside the lab. Further, students from differing socioeconomic and underserved backgrounds are often not adequately supported. Through a National Science Foundation Innovations in Graduate Education (IGE) award, the University of Pittsburgh Swanson School of Engineering is creating and validating a personalized learning model (PLM) for graduate education within the Department of Chemical and Petroleum Engineering. The goal of this model is to transform and modernize graduate STEM education through a personalized, inclusive, and student-centered approach, which will, in turn, advance existing knowledge on the relationship between personalized learning and student outcomes. The principles of personalized learning guide the PLM. The PLM is comprised of five components. The first three components provide an intentional approach to learning: Instructional Goals developed for each student based on a learner profile and individual development plans (IDP), a purposeful Task Environment that breaks the traditional three-credit coursework into modules and co-curricular professional development streams, and a resolute approach to Scaffolding Instruction that leads to mastery in the student’s area of focus. The last two components provide feedback and reflection: Assessment of Performance Learning quantifies students’ progress, and Reflection and Evaluation, where improvement opportunities help the student to develop further. Incorporating personalization at every touchpoint of a graduate student’s academic journey creates an authentic, customized, student-centered approach to graduate education. This paper describes in detail the model and the literature behind its development, along with assessments used to guide students.more » « less
-
The use of Bayesian Knowledge Tracing (BKT) models in predicting student learning and mastery, especially in math- ematics, is a well-established and proven approach in learn- ing analytics. In this work, we report on our analysis exam- ining the generalizability of BKT models across academic years attributed to ”detector rot.” We compare the gen- eralizability of Knowledge Training (KT) models by com- paring model performance in predicting student knowledge within the academic year and across academic years. Models were trained on data from two popular open-source curric- ula available through Open Educational Resources. We ob- served that the models generally were highly performant in predicting student learning within an academic year, whereas certain academic years were more generalizable than other academic years. We posit that the Knowledge Tracing mod- els are relatively stable in terms of performance across aca- demic years yet can still be susceptible to systemic changes and underlying learner behavior. As indicated by the evi- dence in this paper, we posit that learning platforms lever- aging KT models need to be mindful of systemic changes or drastic changes in certain user demographics.more » « less
An official website of the United States government

