Understanding the factors that lead to teacher success and persistence in high-need school districts is imperative for the success of the students in those districts. Teacher success means many things to different stakeholders in high-needs communities: families, colleagues, and administrators are all positioned to benefit from increased teacher retention, leadership, and/or test scores. However, preparing and supporting teachers in their work towards these successes may be more challenging. In this research study, we worked with six administrators and ten teachers representing four high-need districts in the New York metro area to better illustrate their perspectives on what teachers need to be successful in these contexts. Interpreting qualitative data through feminist, identity, and professional learning continuum framing, we asked: How do administrators and teachers perceive the qualities of teachers who persist in high-need schools? Preliminary findings illustrate that although teachers and administrators are in agreement on the qualities required of teachers, the reality is that teachers embodying these qualities are frequently not those who end up being hired. Thus, there is tension on the school culture and goals for student learning, especially for schools in which teacher attrition is greatest.
more »
« less
Expressiveness, Cost, and Collectivism: How the Design of Preference Languages Shapes Participation in Algorithmic Decision-Making
Emerging methods for participatory algorithm design have proposed collecting and aggregating individual stakeholders’ preferences to create algorithmic systems that account for those stakeholders’ values. Drawing on two years of research across two public school districts in the United States, we study how families and school districts use students’ preferences for schools to meet their goals in the context of algorithmic student assignment systems. We find that the design of the preference language, i.e. the structure in which participants must express their needs and goals to the decision-maker, shapes the opportunities for meaningful participation. We define three properties of preference languages – expressiveness, cost, and collectivism – and discuss how these factors shape who is able to participate, and the extent to which they are able to effectively communicate their needs to the decision-maker. Reflecting on these findings, we offer implications and paths forward for researchers and practitioners who are considering applying a preference-based model for participation in algorithmic decision making.
more »
« less
- Award ID(s):
- 2131519
- PAR ID:
- 10437943
- Date Published:
- Journal Name:
- CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
- Page Range / eLocation ID:
- 1 to 16
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The United Nations Sustainable Development Goals provide a road map for countries to achieve peace and prosperity. In this study, we address two of these sustainable development goals: achieving food security and reducing inequalities. Food banks are nonprofit organizations that collect and distribute food donations to food‐insecure populations in their service regions. Food banks consider three criteria while distributing the donated food: equity, effectiveness, and efficiency. The equity criterion aims to distribute food in proportion to the food‐insecure households in a food bank's service area. The effectiveness criterion aims to minimize undistributed food, whereas the efficiency criterion minimizes the total cost of transportation. Models that assume predetermined weights on these criteria may produce inaccurate results as the preference of food banks over these criteria may vary over time, and as a function of supply and demand. In collaboration with our food bank partner in North Carolina, we develop a single‐period, weighted multi‐criteria optimization model that provides the decision‐maker the flexibility to capture their preferences over the three criteria of equity, effectiveness, and efficiency, and explore the resulting trade‐offs. We then introduce a novel algorithm that elicits the inherent preference of a food bank by analyzing its actions within a single‐period. The algorithm does not require direct interaction with the decision‐maker. The non‐interactive nature of this algorithm is especially significant for humanitarian organizations such as food banks which lack the resources to interact with modelers on a regular basis. We perform extensive numerical experiments to validate the efficiency of our algorithm. We illustrate results using historical data from our food bank partner and discuss managerial insights. We explore the implications of different decision‐maker preferences for the criteria on distribution policies.more » « less
-
Fairness metrics have become a useful tool to measure how fair or unfair a machine learning system may be for its stakeholders. In the context of recommender systems, previous research has explored how various stakeholders experience algorithmic fairness or unfairness, but it is also important to capture these experiences in the design of fairness metrics. Therefore, we conducted four focus groups with providers (those whose items, content, or profiles are being recommended) of two different domains: content creators and dating app users. We explored how our participants experience unfairness on their associated platforms, and worked with them to co-design fairness goals, definitions, and metrics that might capture these experiences. This work represents an important step towards designing fairness metrics with the stakeholders who will be impacted by their operationalizations. We analyze the efficacy and challenges of enacting these metrics in practice and explore how future work might benefit from this methodology.more » « less
-
The expanding role of reinforcement learning (RL) in safety-critical system design has promoted ω-automata as a way to express learning requirements—often non-Markovian—with greater ease of expression and interpretation than scalar reward signals. However, real-world sequential decision making situations often involve multiple, potentially conflicting, objectives. Two dominant approaches to express relative preferences over multiple objectives are: (1)weighted preference, where the decision maker provides scalar weights for various objectives, and (2)lexicographic preference, where the decision maker provides an order over the objectives such that any amount of satisfaction of a higher-ordered objective is preferable to any amount of a lower-ordered one. In this article, we study and develop RL algorithms to compute optimal strategies in Markov decision processes against multiple ω-regular objectives under weighted and lexicographic preferences. We provide a translation from multiple ω-regular objectives to a scalar reward signal that is bothfaithful(maximising reward means maximising probability of achieving the objectives under the corresponding preference) andeffective(RL quickly converges to optimal strategies). We have implemented the translations in a formal reinforcement learning tool,Mungojerrie, and we present an experimental evaluation of our technique on benchmark learning problems.more » « less
-
The demand to provide high-quality computer science (CS) education to K-12 students across the United States continues to grow due to societal transformations driven by AI and cybersecurity. However, the impact of state initiatives and mandates on district leaders’ decision making remains an under-explored area in the literature. In 2022, CSforALL began work in Tennessee, a state poised to enact CS education policy, as part of a Research Practice Partnership (RPP). This study investigates the first eight school districts who participated in the Strategic CSforALL Resource and Implementation Planning Tool (SCRIPT) workshops in 2022 and 2023, setting goals based on the SCRIPT rubric. The study takes a general qualitative approach underpinned by the Capacity, Access, Participation, and Experience (CAPE) Framework [14] to develop a coding scheme analyzing the districts’ related rubric scores and goals, and to investigate the impacts on equity indicators. The districts participated in three SCRIPT workshops held in 2022 and 2023, and this study dives deeply into the initial goals as well as analyzing the ways the SCRIPT rubric aligned to the CAPE Framework to investigate how district leaders make decisions which impact teacher and student outcomes which lead to equitable high-quality CS education.more » « less
An official website of the United States government

