skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Computation and Accuracy Evaluation of Comparable Scores on Culturally Responsive Assessments
Abstract Culturally responsive assessments have been proposed as potential tools to ensure equity and fairness for examinees from all backgrounds including those from traditionally underserved or minoritized groups. However, these assessments are relatively new and, with few exceptions, are yet to be implemented in large scale. Consequently, there is a lack of guidance on how one can compute comparable scores on various versions of these assessments. In this paper, the multigroup multidimensional Rasch model is repurposed for modeling data originating from various versions of a culturally responsive assessment and for analyzing such data to compute comparable scores. Two simulation studies are performed to evaluate the performance of the model for data simulated from hypothetical culturally responsive assessments and to find the conditions under which the computed scores are accurate. Recommendations are made for measurement practitioners interested in culturally responsive assessments.  more » « less
Award ID(s):
2243041
PAR ID:
10478788
Author(s) / Creator(s):
 ;  
Publisher / Repository:
Wiley-Blackwell
Date Published:
Journal Name:
Journal of Educational Measurement
Volume:
61
Issue:
1
ISSN:
0022-0655
Format(s):
Medium: X Size: p. 5-46
Size(s):
p. 5-46
Sponsoring Org:
National Science Foundation
More Like this
  1. (, Proceedings of the Connected Learning Summit)
    Kalir, Jeremiah H.; Filipiak, Danielle (Ed.)
    Abstract: The goal of this paper is to move beyond theoretical explorations of culturally responsive research to instead offer researchers concrete examples and effective strategies for designing culturally responsive instruments and protocols in STEM educational research. As a Black female researcher from a multiply marginalized background, I intentionally leverage minoritized funds of knowledge, cultural intuition, and experiential insight to offer a validated model of culturally responsive interview methods. In doing so, I propose tangible means of enacting critical theories of race, gender, and cultural responsiveness into research practice. This practice-based articulation of culturally responsive research stems from a rigorous analysis of 1 large-scale, multisite study on race, education, and STEM equity. Data from the study include protocols and subsequent revisions, sample interview questions, participant quotes, and research memos. 
    more » « less
  2. ; ; ; ; ; (, Proceedings of the ACM on Human-Computer Interaction)
    Culturally responsive STEM and computing initiatives aim to engage and embolden a diverse range of learners, center their identity and experiences in curriculum, and connect learners to each other and their communities. With an abrupt pivot to online learning at the beginning of 2020, more educational experiences have taken place virtually. We ran a virtual synchronous culturally responsive computing camp and saw that establishing the right environment online to support a good sense of connectedness was challenging. To investigate this further, we interviewed eight K-12 instructors of culturally responsive STEM and computing programs. Three themes emerged on defining and cultivating connectedness in learning experiences, the role of equity in supporting community online, and affordances of being online specific to culturally responsive perspectives. We support our thematic findings with vignettes from the camp data. In this study, we address K-12 culturally responsive STEM and computing instructors' beliefs, experiences, and approaches regarding cultivating connectedness online. This work fills a gap in understanding instructor perspectives on building in-program and broader community connections online from a culturally responsive STEM and computing lens. 
    more » « less
  3. (, Journal of Multicultural Counseling and Development)
    Abstract The purpose of this study was to examine instructional and cultural supports that school stakeholders used to meet the needs of high school Black males participating in an academy of engineering. Based on interviews, three themes emerged: (a) representation matters—culturally responsive caring adults and role models; (b) teaching navigational life skills; and (c) targeted culturally responsive supports (or lack thereof). These factors promoted a culture conducive for engaging Black males and cultivated their success. 
    more » « less
  4. ; ; ; ; ; (, Frontiers in Digital Health)
    Accurate balance assessment is important in healthcare for identifying and managing conditions affecting stability and coordination. It plays a key role in preventing falls, understanding movement disorders, and designing appropriate therapeutic interventions across various age groups and medical conditions. However, traditional balance assessment methods often suffer from subjectivity, lack of comprehensive balance assessments and remote assessment capabilities, and reliance on specialized equipment and expert analysis. In response to these challenges, our study introduces an innovative approach for estimating scores on the Modified Clinical Test of Sensory Interaction on Balance (m-CTSIB). Utilizing wearable sensors and advanced machine learning algorithms, we offer an objective, accessible, and efficient method for balance assessment. We collected comprehensive movement data from 34 participants under four different sensory conditions using an array of inertial measurement unit (IMU) sensors coupled with a specialized system to evaluate ground truth m-CTSIB balance scores for our analysis. This data was then preprocessed, and an extensive array of features was extracted for analysis. To estimate the m-CTSIB scores, we applied Multiple Linear Regression (MLR), Support Vector Regression (SVR), and XGBOOST algorithms. Our subject-wise Leave-One-Out and 5-Fold cross-validation analysis demonstrated high accuracy and a strong correlation with ground truth balance scores, validating the effectiveness and reliability of our approach. Key insights were gained regarding the significance of specific movements, feature selection, and sensor placement in balance estimation. Notably, the XGBOOST model, utilizing the lumbar sensor data, achieved outstanding results in both methods, with Leave-One-Out cross-validation showing a correlation of 0.96 and a Mean Absolute Error (MAE) of 0.23 and 5-fold cross-validation showing comparable results with a correlation of 0.92 and an MAE of 0.23, confirming the model’s consistent performance. This finding underlines the potential of our method to revolutionize balance assessment practices, particularly in settings where traditional methods are impractical or inaccessible. 
    more » « less
  5. ; ; ; (, British Journal of Mathematical and Statistical Psychology)
    Abstract Nowadays, multidimensional data are often available from educational testing. One natural issue is to identify whether more dimensional data are useful in fitting the item response data. To address this important issue, we develop a new decomposition of Widely Applicable Information Criterion (WAIC) via the posterior predictive ordinate (PPO) under the joint model for the response, response time and two additional educational testing scores. Based on this decomposition, a new model assessment criterion is then proposed, which allows us to determine which of the response time and two additional scores are most useful in fitting the response data and whether other dimensional data are further needed given that one of these dimensional data is already included in the joint model with the response data. In addition, an efficient Monte Carlo method is developed to compute PPO. An extensive simulation study is conducted to examine the empirical performance of the proposed joint model and the model assessment criterion in the psychological setting. The proposed methodology is further applied to an analysis of a real dataset from a computerized educational assessment program. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email