skip to main content


Title: Reliability and Inter-rater Reliability in Qualitative Research: Norms and Guidelines for CSCW and HCI Practice
Award ID(s):
2031951 1703049
NSF-PAR ID:
10176357
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Proceedings of the ACM on Human-Computer Interaction
Volume:
3
Issue:
CSCW
ISSN:
2573-0142
Page Range / eLocation ID:
1 to 23
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. In recent years, Artificial Intelligence (AI) systems have achieved revolutionary capabilities, providing intelligent solutions that surpass human skills in many cases. However, such capabilities come with power-hungry computation workloads. Therefore, the implementation of hardware acceleration becomes as fundamental as the software design to improve energy efficiency, silicon area, and latency of AI systems. Thus, innovative hardware platforms, architectures, and compiler-level approaches have been used to accelerate AI workloads. Crucially, innovative AI acceleration platforms are being adopted in application domains for which dependability must be paramount, such as autonomous driving, healthcare, banking, space exploration, and industry 4.0. Unfortunately, the complexity of both AI software and hardware makes the dependability evaluation and improvement extremely challenging. Studies have been conducted on both the security and reliability of AI systems, such as vulnerability assessments and countermeasures to random faults and analysis for side-channel attacks. This paper describes and discusses various reliability and security threats in AI systems, and presents representative case studies along with corresponding efficient countermeasures. 
    more » « less
  2. null (Ed.)
    Abstract System reliability is quantified by the probability that a system performs its intended function in a period of time without failures. System reliability can be predicted if all the limit-state functions of the components of the system are available, and such a prediction is usually time consuming. This work develops a time-dependent system reliability method that is extended from the component time-dependent reliability method using the envelope method and second-order reliability method. The proposed method is efficient and is intended for series systems with limit-state functions whose input variables include random variables and time. The component reliability is estimated by the second-order component reliability method with an improve envelope approach, which produces a component reliability index. The covariance between component responses is estimated with the first-order approximations, which are available from the second-order approximations of the component reliability analysis. Then, the joint distribution of all the component responses is approximated by a multivariate normal distribution with its mean vector being component reliability indexes and covariance being those between component responses. The proposed method is demonstrated and evaluated by three examples. 
    more » « less
  3. null (Ed.)
    Abstract

    System reliability is quantified by the probability that a system performs its intended function in a period of time without failure. System reliability can be predicted if all the limit-state functions of the components of the system are available, and such a prediction is usually time consuming. This work develops a time-dependent system reliability method that is extended from the component time-dependent reliability method that uses the envelop method and second order reliability method. The proposed method is efficient and is intended for series systems with limit-state functions whose input variables include random variables and time. The component reliability is estimated by the existing second order component reliability method, which produces component reliability indexes. The covariance between components responses are estimated with the first order approximations, which are available from the second order approximations of the component reliability analysis. Then the joint probability of all the component responses is approximated by a multivariate normal distribution with its mean vector being component reliability indexes and covariance being those between component responses. The proposed method is demonstrated and evaluated by three examples.

     
    more » « less