skip to main content


Title: Computerized Text Analysis: Assessment and Research Potentials for Promoting Learning
Rapid advancements in computing have enabled automatic analyses of written texts created in educational settings. The purpose of this symposium is to survey several applications of computerized text analyses used in the research and development of productive learning environments. Four featured research projects have developed or been working on (1) equitable automated scoring models for scientific argumentation for English Language Learners, (2) a real-time, adjustable formative assessment system to promote student revision of uncertaintyinfused scientific arguments, (3) a web-based annotation tool to support student revision of scientific essays, and (4) a new research methodology that analyzes teacher-produced text in online professional development courses. These projects will provide unique insights towards assessment and research opportunities associated with a variety of computerized text analysis approaches.  more » « less
Award ID(s):
1813713
NSF-PAR ID:
10181653
Author(s) / Creator(s):
Date Published:
Journal Name:
Computersupported collaborative learning
Volume:
1
ISSN:
1573-4552
Page Range / eLocation ID:
743-750
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Developing useful intelligence on scientific and technological emergence challenges those who would manage R&D portfolios, assess research programs, or manage innovation. Recently, the U.S. Intelligence Advanced Research Projects Activity Foresight and Understanding from Scientific Exposition Program has explored means to detect emergence via text analyses. We have been involved in positing conceptual bases for emergence, framing candidate indicators, and devising implementations. We now present a software script to generate a family of Emergence Indicators for a topic of interest. This paper offers some background, then discusses the development of this script through iterative rounds of testing, and then offers example findings. Results point to promising and actionable intelligence for R&D decision-makers. 
    more » « less
  2. Developing useful intelligence on scientific and technological emergence challenges those who would manage R&D portfolios, assess research programs, or manage innovation. Recently, the U.S. Intelligence Advanced Research Projects Activity Foresight and Understanding from Scientific Exposition Program has explored means to detect emergence via text analyses. We have been involved in positing conceptual bases for emergence, framing candidate indicators, and devising implementations. We now present a software script to generate a family of Emergence Indicators for a topic of interest. This paper offers some background, then discusses the development of this script through iterative rounds of testing, and then offers example findings. Results point to promising and actionable intelligence for R&D decision-makers. 
    more » « less
  3. Abstract

    This paper describes HASbot, an automated text scoring and real‐time feedback system designed to support student revision of scientific arguments. Students submit open‐ended text responses to explain how their data support claims and how the limitations of their data affect the uncertainty of their explanations. HASbot automatically scores these text responses and returns the scores with feedback to students. Data were collected from 343 middle‐ and high‐school students taught by nine teachers across seven states in the United States. A mixed methods design was applied to investigate (a) how students’ utilization of HASbot impacted their development of uncertainty‐infused scientific arguments; (b) how students used feedback to revise their arguments, and (c) how the current design of HASbot supported or hindered students’ revisions. Paired samplettests indicate that students made significant gains from pretest to posttest in uncertainty‐infused scientific argumentation, ES = 1.52 SD,p < 0.001. Linear regression analysis results indicate that students' HASbot use significantly contributed to their posttest performance on uncertainty‐infused scientific argumentation while gender, English language learner status, and prior computer experience did not. From the analysis of videos, we identified several affordances and limitations of HASbot.

     
    more » « less
  4. ABSTRACT Traditional lecture-centered approaches alone are inadequate for preparing students for the challenges of creative problem solving in the STEM disciplines. As an alternative, learnercentered and other high-impact pedagogies are gaining prominence. The Wabash College 3D Printing and Fabrication Center (3D-PFC) supports several initiatives on campus, but one of the most successful is a computer-aided design (CAD) and fabrication-based undergraduate research internship program. The first cohort of four students participated in an eight-week program during the summer of 2015. A second group of the four students was successfully recruited to participate the following summer. This intensive materials science research experience challenged students to employ digital design and fabrication in the design, testing, and construction of inexpensive scientific instrumentation for use in introductory STEM courses at Wabash College. The student research interns ultimately produced a variety of successful new designs that could be produced for less than $25 per device and successfully detect analytes of interest down to concentrations in the parts per million (ppm) range. These student-produced instruments have enabled innovations in the way introductory instrumental analysis is taught on campus. Beyond summer work, the 3D-PFC staffed student interns during the academic year, where they collaborated on various cross-disciplinary projects with students and faculty from departments such as mathematics, physics, biology, rhetoric, history, classics, and English. Thus far, the student work has led to three campus presentations, four presentations at national professional conferences, and three peer-reviewed publications. The following report highlights initial progress as well as preliminary assessment findings. 
    more » « less
  5. Abstract  
    more » « less