skip to main content


Title: How Experienced Designers of Enterprise Applications Engage AI as a Design Material
HCI research has explored AI as a design material, suggesting that designers can envision AI’s design opportunities to improve UX. Recent research claimed that enterprise applications offer an opportunity for AI innovation at the user experience level. We conducted design workshops to explore the practices of experienced designers who work on cross-functional AI teams in the enterprise. We discussed how designers successfully work with and struggle with AI. Our findings revealed that designers can innovate at the system and service levels. We also discovered that making a case for an AI feature’s return on investment is a barrier for designers when they propose AI concepts and ideas. Our discussions produced novel insights on designers’ role on AI teams, and the boundary objects they used for collaborating with data scientists. We discuss the implications of these findings as opportunities for future research aiming to empower designers in working with data and AI.  more » « less
Award ID(s):
2007501
NSF-PAR ID:
10331776
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more » ; ; « less
Date Published:
Journal Name:
CHI '22: CHI Conference on Human Factors in Computing Systems
Page Range / eLocation ID:
1 to 13
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Cherchiglia et al. Effects of ESM Use for Classroom Teams Proceedings of the Nineteenth Annual Pre-ICIS Workshop on HCI Research in MIS, Virtual Conference, December 12, 2020 1 An Exploration of the Effects of Enterprise Social Media Use for Classroom Teams Leticia Cherchiglia Michigan State University leticia@msu.edu Wietske Van Osch HEC Montreal & Michigan State University wietske.van-osch@hec.ca Yuyang Liang Michigan State University liangyuy@msu.edu Elisavet Averkiadi Michigan State University averkiad@msu.edu ABSTRACT This paper explores the adoption of Microsoft Teams, a group-based Enterprise Social Media (ESM) tool, in the context of a hybrid Information Technology Management undergraduate course from a large midwestern university. With the primary goal of providing insights into the use and design of tools for group-based educational settings, we constructed a model to reflect our expectations that core ESM affordances would enhance students’ perceptions of Microsoft Teams’ functionality and efficiency, which in turn would increase both students’ perceptions of group productivity and students’ actual usage of Microsoft Teams for communication purposes. In our model we used three core ESM affordances from Treem and Leonardi (2013), namely editability (i.e., information can be created and/or edited after creation, usually in a collaborative fashion), persistence (i.e., information is stored permanently), and visibility (i.e., information is visible to other users). Analysis of quantitative (surveys, server-side; N=62) and qualitative (interviews; N=7) data led to intriguing results. It seems that although students considered that editability, persistency, and visibility affordances within Microsoft Teams were convenient functions of this ESM, problems when working collaboratively (such as connectivity, formatting, and searching glitches) might have prevented considerations of this ESM as fast and user-friendly (i.e., efficient). Moreover, although perceived functionality and efficiency were positively connected to group productivity, hidden/non-intuitive communication features within this ESM might help explain the surprising negative connection between efficiency and usage of this ESM for the purpose of group communication. Another explanation is that, given the plethora of competing tools specifically designed to afford seamless/optimal team communication, students preferred to use more familiar tools or tools perceived as more efficient for group communication than Microsoft Teams, a finding consistent with findings in organizational settings (Van Osch, Steinfield, and Balogh, 2015). Beyond theoretical contributions related to the impact that ESM affordances have on users’ interaction perceptions, and the impact of users’ interaction perceptions on team and system outcomes, from a strategic and practical point of view, our findings revealed several challenges for the use of Microsoft Teams (and perhaps ESM at large) in educational settings: 1) As the demand for online education grows, collaborative tools such as Microsoft Teams should strive to provide seamless experiences for multiple-user access to files and messages; 2) Microsoft Teams should improve its visual design in order to increase ease of use, user familiarity, and intuitiveness; 3) Microsoft Teams appears to have a high-learning curve, partially related to the fact that some features are hidden or take extra steps/clicks to be accessed, thus undermining their use; 4) Team communication is a complex topic which should be further studied because, given the choice, students will fall upon familiar tools therefore undermining the full potential for team collaboration through the ESM. We expect that this paper can provide insights for educators faced with the choice for an ESM tool best-suited for group-based classroom settings, as well as designers interested in adapting ESMs to educational contexts, which is a promising avenue for market expansion. 
    more » « less
  2. Abstract Designers often gather information, for instance through stakeholder or domain expert meetings, to understand their design problems and develop effective solutions. However, few previous studies have provided in-depth descriptions of novice engineering designers’ approaches to conducting information gathering meetings. In this preliminary study, we analyzed data from six capstone mechanical engineering design teams to identify the types of individuals from whom teams gathered information, when these meetings occurred, and how teams solicited information during meetings. Teams in our study exhibited a range of information gathering behaviors that aligned with recommended practices, particularly in their early meetings. We also observed relatively few instances of teams exhibiting behaviors that were less similar to recommended practices during their meetings. However, our findings revealed two key trends across teams that represented specific opportunities for improvement and that may reflect characteristic novice approaches to conducting information gathering meetings. First, teams explored domain experts’ perspectives in depth during meetings and met with additional domain experts to inform their projects. Teams' meetings with project partners contained few instances of deep exploratory information gathering behaviors in comparison. In addition, teams seemed to finalize design decisions during early design meetings and were less likely to conduct information gathering meetings during later design phases. The comprehensive descriptions of novice mechanical engineering designers’ approaches provided in our preliminary study provide an entry point for further investigations that can inform engineering training, tools, and pedagogy for conducting effective meetings. 
    more » « less
  3. AI-based design tools are proliferating in professional software to assist engineering and industrial designers in complex manufacturing and design tasks. These tools take on more agentic roles than traditional computer-aided design tools and are often portrayed as “co-creators.” Yet, working effectively with such systems requires different skills than working with complex CAD tools alone. To date, we know little about how engineering designers learn to work with AI-based design tools. In this study, we observed trained designers as they learned to work with two AI-based tools on a realistic design task. We find that designers face many challenges in learning to effectively co-create with current systems, including challenges in understanding and adjusting AI outputs and in communicating their design goals. Based on our findings, we highlight several design opportunities to better support designer-AI co-creation. 
    more » « less
  4. Context: Addressing women's under-representation in the soft-ware industry, a widely recognized concern, requires attracting as well as retaining more women. Hearing from women practitioners, particularly those positioned in multi-cultural settings, about their challenges and and adopting their lived experienced solutions can support the design of programs to resolve the under-representation issue. Goal: We investigated the challenges women face in global software development teams, particularly what motivates women to leave their company; how those challenges might break down according to demographics; and strategies to mitigate the identified challenges. Method: To achieve this goal, we conducted an ex-ploratory case study in Ericsson, a global technology company. We surveyed 94 women and employed mixed-methods to analyze the data. Results: Our findings reveal that women face socio-cultural challenges, including work-life balance issues, benevolent and hos-tile sexism, lack of recognition and peer parity, impostor syndrome, glass ceiling bias effects, the prove-it-again phenomenon, and the maternal wall. The participants of our research provided different suggestions to address/mitigate the reported challenges, including sabbatical policies, flexibility of location and time, parenthood support, soft skills training for managers, equality of payment and opportunities between genders, mentoring and role models to sup-port career growth, directives to hire more women, inclusive groups and events, women's empowerment, and recognition for women's success. The framework of challenges and suggestions can inspire further initiatives both in academia and industry to onboard and retain women. Women represent less than 24% of employees in software development industry and experience various types of prejudice and bias. Even in companies that care about Diversity & Inclusion, “untying the mooring ropes” of socio-cultural problems is hard. Hearing from women, especially those working in a multi-cultural organization, about their challenges and adopting their suggestions can be vital to design programs and resolve the under-representation issue. In this work we work closely with a large software development or-ganization which invests and believes in diversity and inclusion. We listened to women and the challenges they face in global soft-ware development teams of this company and what these women suggest reduce the problems and increase retention. Our research showed that women face work-life balance issues and encounter invisible barriers that prevent them from rising to top positions. They also suffer micro-aggression and sexism, need to show com-petence constantly, be supervised in essential tasks, and receive less work after becoming mothers. Moreover, women miss having more female colleagues, lack self-confidence and recognition. The women from the company suggested sabbatical policies, the flexibil-ity of location and time, parenthood support, soft skills training for managers, equality of opportunities, role models to support career growth, directives to hire more women, support groups, and more interaction between women, inclusive groups and events, women's empowerment by publishing their success stories in media and recognizing their achievements. Our results had been shared with the company Human Resources department and management and they considered the diagnosis helpful and will work on actions to mitigate the challenges that women still perceive. 
    more » « less
  5. null (Ed.)
    In the innovation process, design practice involves multiple iterations of framing and reframing under high levels of uncertainty and ambiguity. Additionally, as user desirability is a significant criterion for innovative design, designers' empathy in the framing and reframing process is considered a critical user-centered design ability that engineering students should develop. In this context, this study aims to discuss how problem framing and empathy manifestation interplay in the innovation process. As an exploratory study, this study investigates biomedical engineering (BME) students’ reframing processes and decisions in a one-semester design project involving problem definition and concept identification. This investigation is guided by the following research questions: 1) how do engineering students perceive the relationship between empathy and reframing in the innovation process, 2) how and how often do they make reframing decisions over the stages of problem definition and concept identification, and 3) how different are reframing processes and decisions between teams with higher and lower empathetic design tendency scores? This study was conducted in a junior-level design course, including 76 BME students. We collected and analyzed three data sources: students’ self-reflection reports about their reframing processes, empathic design tendency score, and interviews with selected teams and instructors. The results demonstrated that more than half of the students perceived the connection between empathy and their reframing decisions and that they usually had one reframing moment in the stages of problem definition and concept identification. Also, the findings illustrate triggers for their reframing moments, information sources guiding their reframing processes, changes made through reframing, and influences of reframing decisions on team project processes. Furthermore, the comparison of the selected two teams revealed two differences in reframing processes between the high and low empathic design tendency-scoring teams. The authors believe that the study expands engineering education research on engineering students’ empathy and problem-framing by illustrating students’ reframing processes throughout a design project and exploring the interplay of empathy and reframing processes. Also, based on our study findings, engineering design educators can promote student empathy development by including more project activities and evaluation criteria related to empathic design and providing formative feedback on their reframing processes. 
    more » « less