skip to main content

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Friday, December 13 until 2:00 AM ET on Saturday, December 14 due to maintenance. We apologize for the inconvenience.


Title: Evaluating an Abbreviated Version of the Circumplex Team Scan Inventory of Within-Team Interpersonal Norms
Abstract. The Circumplex Team Scan (CTS) assesses the degree to which a team’s interaction/communication norms reflect each segment (16th) of the interpersonal circle/circumplex. We developed and evaluated an abbreviated 16-item CTS-16 that uses one CTS item to measure each segment. Undergraduates ( n = 446) completing engineering course projects in 139 teams completed the CTS-16. CTS-16 items showed a good fit to confirmatory structural models (e.g., that expect greater positive covariation between items theoretically closer to the circumplex). Individuals’ ratings sufficiently reflected team-level norms to justify averaging team members’ ratings. However, individual items’ marginal reliabilities suggest using the CTS-16 to assess general circumplex-wide patterns rather than specific segments. CTS-16 ratings correlated with respondents’ and their teammates’ ratings of team climate (inclusion, justice, psychological safety). Teams with more extraverted (introverted) members were perceived as having more confident/engaged (timid/hesitant) cultures. Members predisposed to social alienation perceived their team’s culture as relatively disrespectful/unengaged, but their teammates did not corroborate those perceptions. The results overall support the validity and utility of the CTS-16 and of an interpersonal circumplex model of team culture more generally.  more » « less
Award ID(s):
1730262
PAR ID:
10434630
Author(s) / Creator(s):
;
Date Published:
Journal Name:
European Journal of Psychological Assessment
ISSN:
1015-5759
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Team formation is ubiquitous in many sectors: education, labor markets, sports, etc. A team’s success depends on its members’ latent types, which are not directly observable but can be (partially) inferred from past performances. From the viewpoint of a principal trying to select teams, this leads to a natural exploration-exploitation trade-off: retain successful teams that are discovered early, or reassign agents to learn more about their types? We study a natural model for online team formation, where a principal repeatedly partitions a group of agents into teams. Agents have binary latent types, each team comprises two members, and a team’s performance is a symmetric function of its members’ types. Over multiple rounds, the principal selects matchings over agents and incurs regret equal to the deficit in the number of successful teams versus the optimal matching for the given function. Our work provides a complete characterization of the regret landscape for all symmetric functions of two binary inputs. In particular, we develop team-selection policies that, despite being agnostic of model parameters, achieve optimal or near-optimal regret against an adaptive adversary. 
    more » « less
  2. Improving team interactions in engineering to model gender inclusivity has been at the forefront of many initiatives in both academia and industry. However, there has been limited evidence on the impact of gender-diverse teams on psychological safety. This is important because psychological safety has been shown to be a key facet for the development of innovative ideas, and has also been shown to be a cornerstone of effective teamwork. But how does the gender diversity of a team impact the development of psychological safety? The current study was developed to explore just this through an empirical study with 38 engineering design student teams over the course of an 8-week design project. These teams were designed to be half heterogeneous (either half-male and half-female, or majority male) or other half homogeneous (all male). We captured psychological safety at five time points between the homogenous and heterogenous teams and also explored individual dichotomous (peer-review) ratings of psychological safety at the end of the project. Results indicated that there was no difference in psychological safety between gender homogenous and heterogenous teams. However, females perceived themselves as more psychologically safe with other female team members compared to their ratings of male team members. Females also perceived themselves to be less psychologically safe with male team members compared to male ratings of female team members, indicating a discrepancy in perceptions between genders. These results point to the need to further explore the role of minoritized groups in psychological safety research and to explore how this effect presents itself (or is covered up) at the team level. 
    more » « less
  3. Improving team interactions in engineering to model gender inclusivity has been at the forefront of many initiatives in both academia and industry. However, there has been limited evidence on the impact of gender-diverse teams on psychological safety. This is important because psychological safety has been shown to be a key facet for the development of innovative ideas, and has also been shown to be a cornerstone of effective teamwork. But how does the gender diversity of a team impact the development of psychological safety? The current study was developed to explore just this through an empirical study with 38 engineering design student teams over the course of an 8-week design project. These teams were designed to be half heterogeneous (either half-male and half- female, or majority male) or other half homogeneous (all male). We captured psychological safety at five time points between the homogenous and heterogenous teams and also explored individual dichotomous (peer-review) ratings of psychological safety at the end of the project. Results indicated that there was no difference in psychological safety between gender homogenous and heterogenous teams. However , females perceived themselves as more psychologically safe with other female team members compared to their ratings of male team members. Females also perceived themselves to be less psychologically safe with male team members compared to male ratings of female team members, indicating a discrepancy In perceptions between genders. These results point to the need to further explore the role of minoritized groups in psychological safety research and to explore how this effect presents itself (or is covered up) at the team level. 
    more » « less
  4. Assessing team software development projects is notoriously difficult and typically based on subjective metrics. To help make assessments more rigorous, we conducted an empirical study to explore relationships between subjective metrics based on peer and instructor assessments, and objective metrics based on GitHub and chat data. We studied 23 undergraduate software teams (n= 117 students) from two undergraduate computing courses at two North American research universities. We collected data on teams’ (a) commits and issues from their GitHub code repositories, (b) chat messages from their Slack and Microsoft Teams channels, (c) peer evaluation ratings from the CATME peer evaluation system, and (d) individual assignment grades from the courses. We derived metrics from (a) and (b) to measure both individual team members’contributionsto the team, and theequalityof team members’ contributions. We then performed Pearson analyses to identify correlations among the metrics, peer evaluation ratings, and individual grades. We found significant positive correlations between team members’ GitHub contributions, chat contributions, and peer evaluation ratings. In addition, the equality of teams’ GitHub contributions was positively correlated with teams’ average peer evaluation ratings and negatively correlated with the variance in those ratings. However, no such positive correlations were detected between the equality of teams’ chat contributions and their peer evaluation ratings. Our study extends previous research results by providing evidence that (a) team members’ chat contributions, like their GitHub contributions, are positively correlated with their peer evaluation ratings; (b) team members’ chat contributions are positively correlated with their GitHub contributions; and (c) the equality of team’ GitHub contributions is positively correlated with their peer evaluation ratings. These results lend further support to the idea that combining objective and subjective metrics can make the assessment of team software projects more comprehensive and rigorous. 
    more » « less
  5. Complex problems require complex teams comprised of individuals with different backgrounds, skills and perspectives to work effectively toward their solution. Increasingly, this is being accomplished through the creation of multi-team systems (MTS) that are developed and implemented in alignment with team science-based strategies. MTS are comprised of individual teams with their own goals that are interconnected and work collaboratively toward a larger, common goal. Attitudinal (cohesion, trust, commitment), behavioral (coordination, communication, shared leadership) and cognitive (situational awareness, shared mental models) competencies support MTS effectiveness. Multisector MTS are even more complex, as team members bring aspects of their organizational culture into the MTS, and if priorities and practices are not well aligned, team function and effectiveness can suffer. Thus, for multisector MTS to work, they must begin with a foundational understanding of the component parts, that is, each organization’s culture and priorities, and how – or if – they align for the success of the collaborative. We created a multisector MTS to develop and implement a project funded by the National Science Foundation’s (NSF’s) Scholarships in Science, Technology, Engineering and Mathematics (S-STEM) program. The project’s objectives are to: increase the number of domestic low-income academically talented students with demonstrated financial need obtaining master's degrees in supported disciplines and entering the US STEM workforce; implement and evaluate the impact of our Flexible Internship-Research-Education (FIRE) model, which integrates evidence-based strategies that provide student career and educational development support, on student success; and implement, study and disseminate an MTS model for multi -organizational collaboration toward career and educational development. The partners include four universities – three Carnegie R2 public Historically Black Colleges and Universities and one Carnegie R1 private, highly selective admissions institution – and a major government employer. Six teams comprise our MTS; with the exception of one, each team has representatives from each partner organization. We sought to understand how each organization’s culture influenced – or might potentially influence – team interactions. The guiding research question for this study is: In what ways – positive or negative – do partner organizations’ cultures impact team members’ engagement with the project? We were interested in gauging how organizational culture, operationalized by performance values (rewarding individual performance vs. team performance), communications (transparent vs. need-to-know, clarity, frequency), conflict resolution and collaborative vs. competitive environments, manifested in their engagement with the MTS. We also explored how – or if – their organization’s priorities aligned with the overall project’s aims and what specific areas might be sources of support and/or challenges as the teams progressed. We conducted open-ended structured interviews with eight project team members who each served on at least one of the six teams. We are completing both content and thematic analyses to understand how team members speak about their organizational influences and engagements within and among the teams. We are finding team members are adaptable; regardless of individual or organizational priorities, when challenges arise, they can re-center on the project’s aims and work collaboratively toward student success. We expect results will illuminate factors multisector MTS teams should consider when forming collaborations. 
    more » « less