skip to main content

Title: Peer Feedback Processes in the Game Industry
A wide variety of design strategies, tools, and processes are used across the game industry. Prior work has shown that these processes are often collaborative, with experts in different domains contributing to different parts of the whole. However, the ways in which these professionals give and receive peer feedback have not yet been studied in depth. In this paper we present results from interviews with industry professionals at two game studios, describing the ways they give feedback. We propose a new, six step process that describes the full feedback cycle from making plans to receive feedback to reflecting and acting upon that feedback. This process serves as a starting point for researchers studying peer feedback in games, and allows for comparison of processes across different types of studios. It will also help studios formalize their understanding of their own processes and consider alternative processes that might better fit their needs.
Authors:
; ; ; ; ;
Award ID(s):
1821590
Publication Date:
NSF-PAR ID:
10205834
Journal Name:
Proceedings of the Annual Symposium on Computer-Human Interaction in Play
Page Range or eLocation-ID:
427 to 438
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The proposed Biology Integration Institute will bring together two major research institutions in the Upper Midwest—the University of Minnesota (UMN) and University of Wisconsin-Madison (UW)—to investigate the causes and consequences of plant biodiversity across scales in a rapidly changing world —from genes and molecules within cells and tissues to communities, ecosystems, landscapes and the biosphere. The Institute focuses on plant biodiversity, defined broadly to encompass the heterogeneity within life that occurs from the smallest to the largest biological scales. A premise of the Institute is that life is envisioned as occurring at different scales nested within several contrasting conceptions of biological hierarchies, defined by the separate but related fields of physiology, evolutionary biology and ecology. The Institute will emphasize the use of ‘spectral biology’—detection of biological properties based on the interaction of light energy with matter—and process-oriented predictive models to investigate the processes by which biological components at one scale give rise to emergent properties at higher scales. Through an iterative process that harnesses cutting edge technologies to observe a suite of carefully designed empirical systems—including the National Ecological Observatory Network (NEON) and some of the world’s longest running and state-of-the-art global change experiments—the Institute will advance biological understanding andmore »theory of the causes and consequences of changes in biodiversity and at the interface of plant physiology, ecology and evolution. INTELLECTUAL MERIT The Institute brings together a diverse, gender-balanced and highly productive team with significant leadership experience that spans biological disciplines and career stages and is poised to integrate biology in new ways. Together, the team will harness the potential of spectral biology, experiments, observations and synthetic modeling in a manner never before possible to transform understanding of how variation within and among biological scales drives plant and ecosystem responses to global change over diurnal, seasonal and millennial time scales. In doing so, it will use and advance state-of-the-art theory. The institute team posits that the designed projects will unearth transformative understanding and biological rules at each of the various scales that will enable an unprecedented capacity to discern the linkages between physiological, ecological and evolutionary processes in relation to the multi-dimensional nature of biodiversity in this time of massive planetary change. A strength of the proposed Institute is that it leverages prior federal investments in research and formalizes partnerships with foreign institutions heavily invested in related biodiversity research. Most of the planned projects leverage existing research initiatives, infrastructure, working groups, experiments, training programs, and public outreach infrastructure, all of which are already highly synergistic and collaborative, and will bring together members of the overall research and training team. BROADER IMPACTS A central goal of the proposed Institute is to train the next generation of diverse integrative biologists. Post-doctoral, graduate student and undergraduate trainees, recruited from non-traditional and underrepresented groups, including through formal engagement with Native American communities, will receive a range of mentoring and training opportunities. Annual summer training workshops will be offered at UMN and UW as well as training experiences with the Global Change and Biodiversity Research Priority Program (URPP-GCB) at the University of Zurich (UZH) and through the Canadian Airborne Biodiversity Observatory (CABO). The Institute will engage diverse K-12 audiences, the general public and Native American communities through Market Science modules, Minute Earth videos, a museum exhibit and public engagement and educational activities through the Bell Museum of Natural History, the Cedar Creek Ecosystem Science Reserve (CCESR) and the Wisconsin Tribal Conservation Association.« less
  2. The Additive Manufacturing Workforce Advancement Training Coalition and Hub (AM-WATCH) targets to address gaps in the current knowledge base of manufacturing professionals through the development of Massive Open Online Courses (MOOCs) based educational materials, delivery of professional development activities, support provided to 30+ instructors per year, and expanded outreach activities targeting K-12 and community college teachers and students. Tennessee Tech University is collaborating with the University of Louisville, Sinclair Community College, National Resource Center for Materials Technology Education, Oak Ridge National Laboratory, and industry in the development of cutting-edge and multi-dimensional educational modules and activities for instructors. Developed materials are presented to 30+ instructors through intensive two-day AM Studios every year. While instructors learn the latest trends and technologies in AM, they also grasp the ABET Student Outcomes and Continuous Improvement. This paper reports the current practices made in these studios and feedback received from the instructors.
  3. Abstract This “work in progress” paper describes a multiyear project to study the development of engineering identity in a chemical and biological engineering program at Montana State University. The project focuses on how engineering identity may be impacted by a series of interventions utilizing subject material in a senior-level capstone design course and has the senior capstone design students serve as peer-mentors to first- and second-year students. A more rapid development of an engineering identity by first- and second-year students is suspected to increase retention and persistence in this engineering program. Through a series of timed interventions scheduled to take place in the first and second year, which includes cohorts that will serve as negative controls (no intervention), we hope to ascertain the following: (1) the extent to which, relative to a control group, exposure to a peer mentor increases a students’ engineering identity development over time compared to those who do not receive peer mentoring and (2) if the quantity and/or timing of the peer interactions impact engineering identity development. While the project includes interventions for both first- and second-year students, this work in progress paper focuses on the experiences of first year freshman as a result of themore »interventions and their development of an engineering identity over the course of the semester. Early in the fall semester, freshman chemical engineering students enrolled in an introductory chemical engineering course and senior students in a capstone design course were administered a survey which contained a validated instrument to assess engineering identity. The first-year course has 107 students and the senior-level course has 92 students and approximately 50% of the students in both cohorts completed the survey. Mid-semester, after the first-year students were introduced to the concepts of process flow diagrams and material balances in their course, senior design student teams gave presentations about their capstone design projects in the introductory course. The presentations focused on the project goals, design process and highlighted the process flow diagrams. After the presentations, freshman and senior students attended small group dinners as part of a homework assignment wherein the senior students were directed to communicate information about their design projects as well as share their experiences in the chemical engineering program. Dinners occurred overall several days, with up to ten freshman and five seniors attending each event. Freshman students were encouraged to use this time to discover more about the major, inquire about future course work, and learn about ways to enrich their educational experience through extracurricular and co-curricular activities. Several weeks after the dinner experience, senior students returned to give additional presentations to the freshman students to focus on the environmental and societal impacts of their design projects. We report baseline engineering identity in this paper.« less
  4. With support from the National Science Foundation’s Division of Undergraduate Education, this five-year project led by a two-year HSI seeks to provide underrepresented students with mentored work experiences in computer information systems. Students will have access to on-campus work experiences and internships in businesses and industries. It is anticipated that some examples of potential student projects include mobile application development, cybersecurity, and computer support. It is expected that these experiences will increase undergraduate student interest, persistence, and success in computer information systems, as well as in STEM more broadly. To ensure that they are well-prepared for and gain the most from their work experiences, students will receive training on employability skills such as communication, teamwork, and project management. In addition, during their work experiences, students will be mentored by faculty, industry professionals, and peers. To strengthen the capacity of faculty to serve all students, including Hispanic students, the project will provide faculty with professional development focused on equity mindset. This framework to provide mentored work experiences will be developed and piloted at Phoenix College, in the computer information technology department and eventually expanded to other STEM fields at the institution. Following this, the project also intends to expand this frameworkmore »four other two-year HSIs in the region. Through this work, the project aims to develop a replicable model for how two-year institutions can develop work experiences that foster increased student graduation and entry into STEM career pathways. This project, which is currently in its first year, seeks to examine how a curriculum that integrates cross-sector partnerships to provide work experiences can enhance STEM learning and retention. Using mixed methods and grounded theory, the project will expand knowledge about: (1) the impact of cross-sector partnerships that support work-focused experiential teaching and learning; (2) systematic ways to maintain and better use cross-sector partnerships; and (3) the degree to which a model of work-focused learning experiences can be adopted at other two-year HSIs and by other STEM fields. Baseline data about Hispanic serving identity at the pilot institution has been collected and assessed at the institutional, departmental, and for different educator roles including faculty, support staff, and administrative leaders to produce inputs towards developing a detailed plan of action. Early results from baseline data, visualizations, and planning responses will be reported in the submission. Expected long term results of the project include: development of sustainable mechanisms to foster cross-sector partnerships; increased student retention and workforce readiness; and measurable successes for STEM students, particularly Hispanic students, at two-year HSIs.« less
  5. Mechatronics and Robotics Engineering (MRE) is one of the engineering disciplines that is experiencing tremendous, dynamic growth. MRE professionals are shaping the world by designing smart systems and processes that will improve human welfare. One’s ability to meaningfully contribute to this field requires her/him to acquire an interdisciplinary knowledge of mechanical, electrical, computer, software, and systems engineering to oversee the entire design and development process of emerging MRE systems. There have been many educational efforts around MRE, including courses, minors, and degree programs, but they have not been well integrated or widely adopted. Now is the time for MRE to coalesce as a distinct and identifiable engineering discipline. To this end, and with support from the National Science Foundation, the authors have planned three workshops, the first of which has concluded, on the future of MRE education at the bachelor’s degree and postgraduate levels. The objectives of these workshops are to generate enthusiasm and inculcate a sense of community among current and future MRE educators; promote diversity and inclusivity within the community; seek feedback from the community to serve as a foundation for future activities; and identify thought leaders for future community activities. The workshops will benefit a wide rangemore »of participants including educators currently teaching in MRE; PhD students seeking academic careers in MRE; and industry professionals desiring to shape the future MRE workforce. These workshops will significantly contribute to the quality of MRE education and increase adoption to prepare individuals with a blend of theoretical knowledge and practical hands-on learning. Workshop activities include short presentations on sample MRE programs; breakout sessions on topics such as mechatronic and robotics knowledgebase, project-based learning, advanced and open-source platforms, reducing barriers to adoption, accreditation, preparation to teach MRE, and community-building; and open discussion and feedback. In this paper, the outcomes of the first workshop, results of the qualitative and quantitative surveys collected from the participants, and their analyses are presented. Particular attention is paid to attendee demographics, changes in participant attitudes, and development of the MRE community.« less