skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Abstracts for assessments: Describing a summary statement.
Quantitative assessment development is a challenging process. The ways in which an assessment might be used, as well as how its score can be interpreted should be clear to intended users. This manuscript provides a discussion about important and useful elements that should be provided by assessment developers. In turn, this information can foster greater usability and portability of quantitative assessments, which can support scholarship focusing on a specific issue.  more » « less
Award ID(s):
1920621
PAR ID:
10332431
Author(s) / Creator(s):
;
Editor(s):
Olanoff, D.; Johnson, K.; Spitzer, S.
Date Published:
Journal Name:
Psychology of Mathematics Education North America
Page Range / eLocation ID:
1854-1858
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Although the natural gas pipeline network is the most efficient and secure transportation mode for natural gas, it remains susceptible to external and internal risk factors. It is vital to address the associated risk factors such as corrosion, third-party interference, natural disasters, and equipment faults, which may lead to pipeline leakage or failure. The conventional quantitative risk assessment techniques require massive historical failure data that are sometimes unavailable or vague. Experts or researchers in the same field can always provide insights into the latest failure assessment picture. In this paper, fuzzy set theory is employed by obtaining expert elicitation through linguistic variables to obtain the failure probability of the top event (pipeline failure). By applying a combination of T- and S-Norms, the fuzzy aggregation approach can enable the most conservative risk failure assessment. The findings from this study showed that internal factors, including material faults and operational errors, significantly impact the pipeline failure integrity. Future directions should include sensitivity analyses to address the uncertainty in data to ensure the reliability of assessment results. 
    more » « less
  2. Problem-solving is a typical type of assessment in engineering dynamics tests. To solve a problem, students need to set up equations and find a numerical answer. Depending on its difficulty and complexity, it can take anywhere from ten to thirty minutes to solve a quantitative problem. Due to the time constraint of in-class testing, a typical test may only contain a limited number of problems, covering an insufficient range of problem types. This can potentially reduce validity and reliability, two crucial factors which contribute to assessment results. A test with high validity should cover proper content. It should be able to distinguish high-performing students from low-performing students and every student in between. A reliable test should have a sufficient number of items to provide consistent information about students’ mastery of the materials. In this work-in-progress study, we will investigate to what extent a newly developed assessment is valid and reliable. Symbolic problem solving in this study refers to solving problems by setting up a system of equations without finding numeric solutions. Such problems usually take much less time. As a result, we can include more problems of a variety of types in a test. We evaluate the new assessment's validity and reliability. The efficient approach focused in symbolic problem-solving allows for a diverse range of problems in a single test. We will follow Standards for Educational and Psychological Testing, referred to as the Standards, for our study. The Standards were developed jointly by three professional organizations including the American Educational Research Association (AERA), the American Psychological Association (APA), and the National Council on Measurement in Education (NCME). We will use the standards to evaluate the content validity and internal consistency of a collection of symbolic problems. Examples on rectilinear kinematics and angular motion will be provided to illustrate how symbolic problem solving is used in both homework and assessments. Numerous studies in the literature have shown that symbolic questions impose greater challenges because of students’ algebraic difficulties. Thus, we will share strategies on how to prepare students to approach such problems. 
    more » « less
  3. Scientific literacy, quantitative reasoning, and systems thinking are essential components of developing a sustainability mindset, and thus should form elements of introductory courses in sustainability so that such mindsets can be cultivated from the outset of a student’s academic studies, particularly in engineering. Evaluations of selected student works (9 respondents from 22 enrolled students) suggest that engineering students demonstrate proficiency with well-structured quantitative tasks, and can make progress adopting mathematical habits such as using estimations and orders of magnitued. However, as the activities become less well prescribed, such as in drawing concept maps to illustrate earth systems cycles, they are not as fluent. Further, they need to develop more practice to do “higher order” tasks, such as interpreting, cross-checking, citing, and communicating ideas outside of their routine. Nevertheless, the results of self-assessment surveys are generally positive and suggest that students are aware of the need to achieve the higher order expectations. The results open questions indicate that several students authentically learned scientific and quantitative elements of sustainability thinking, as evidenced by their articulation of specific details about systems thinking, chemistry, and mathematics. 
    more » « less
  4. Abstract Floods are important disturbances to urban socio‐eco‐technical systems and their meteorological drivers are projected to increase through the century due to global climate change. Urban flood models are numerical models that have the capability of representing the features of urban ecosystems and the mechanisms of flooding that impact them. They have the potential to play a critical role in flood risk assessment, operational response, and resilience planning, but existing models remain limited in their capability to represent integrated flooding processes in urban areas and provide the credible quantitative information needed to support risk assessment and resilience practice. Research to advance model development, facilitate intensive watershed monitoring for model parameterization and validation, and support collaboration between researchers and practitioners should be prioritized. This will represent a substantial, expensive effort, but will still be of great value as cities are faced with urgent challenges posed by climate change in coming decades. 
    more » « less
  5. Sea level rise (SLR) will exert pressures on assets with social value, including things such as infrastructure and habitats, in the coastal zone. Assessing and ranking the vulnerability of those assets can provide insights that support planning and projects that can reduce those vulnerabilities. In this study, we develop a quantitative, data-drive framework for calculating a sea level rise vulnerability score, using publicly available spatial data, for 111,239 parcels in Puget Sound, Washington State, USA. Notably, our approach incorporates an assessment of coastal erosion, as well as coastal flooding, in an evaluation of the exposure of each parcel, and impacts to habitats are quantified alongside impacts to existing infrastructure. The results suggest that sea level rise vulnerability in Puget Sound is widely distributed, but the overall distribution of scores is heavily skewed, suggesting that adaptation actions directed at a relatively small number of parcels could yield significant reductions in vulnerability. The results are also coupled with a concurrently developed social vulnerability index, which provides additional insight regarding those people and places that may be predisposed to adverse impacts from SLR-related hazards. We find that the proposed approach offers advantages in terms of advancing equitable SLR-related risk reduction, but also that the results should be carefully interpreted considering embedded assumptions and data limitations. 
    more » « less