Conference PaperUnderstanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry PracticeDeng, Wesley Hanwen; Guo, Boyuan; Devrio, Alicia; Shen, Hong; Eslami, Motahhare; Holstein, KennethRecent years have seen growing interest among both researchers and practitioners in user-engaged approaches to algorithm auditing, which directly engage users in detecting problematic behaviors in algorithmic systems. However, we know little about industry practitioners’ current practices and challenges around user-engaged auditing, nor what opportunities exist for them to better leverage such approaches in practice. To investigate, we conducted a series of interviews and iterative co-design activities with practitioners who employ user-engaged auditing approaches in their work. Our findings reveal several challenges practitioners face in appropriately recruiting and incentivizing user auditors, scaffolding user audits, and deriving actionable insights from user-engaged audit reports. Furthermore, practitioners shared organizational obstacles to user-engaged auditing, surfacing a complex relationship between practitioners and user auditors. Based on these findings, we discuss opportunities for future HCI research to help realize the potential (and mitigate risks) of user-engaged auditing in industry practice.ACM2023-04-19105737701 to 189781450394215https://doi.org/10.1145/3544548.35810262040942Hamburg GermanyNational Science Foundation