skip to main content

Title: Save Your Strokes: Chinese Handwriting Practice Makes for Ineffective Use of Instructional Time in Second Language Classrooms
Handwriting practice is the most time-consuming activity for learners of Chinese as a foreign language (CFL). CFL instructors report allocating at least one third of their course time to handwriting practice although it prevents students from engaging in meaningful communication, especially in the earliest stages of learning. Given the amount of time students spend in a college course is relatively fixed, the preregistered study presented herein examines the best use of students’ time when primary goals are word acquisition and communication. This work replicates a pilot study examining CFL word recognition in an online learning environment (ASSISTments) and the effects of supplemental handwriting practice. We examined word acquisition and recognition while manipulating condition (no-handwriting practice and with-handwriting practice), and posttest test point (1 [immediate], 2 [1 day delay], and 3 [1 week delay]). Two-way repeated measures analyses of variance revealed significant main effects for both condition and posttest test point in online and on-paper measures of word recognition and handwriting. Potential implications for CFL instruction and directions for future work are discussed.
Authors:
; ;
Award ID(s):
1931523 1724889
Publication Date:
NSF-PAR ID:
10191076
Journal Name:
AERA open
Volume:
5
Issue:
4
Page Range or eLocation-ID:
1-15
ISSN:
2332-8584
Sponsoring Org:
National Science Foundation
More Like this
  1. The purpose of this research paper is to understand how diverse students are incorporated into the social structure of a large enrollment first-year engineering design course. Despite previous work demonstrating the benefits of diverse individuals in engineering, little work has examined how diverse students are incorporated into the social networks that exist within engineering classrooms. Social interactions are one of the most influential sources for integration into communities of practice. Through understanding how students interact and the structure of these interactions, we can elucidate how the engineering community includes members of underrepresented populations. Previous social network analysis (SNA) studies havemore »scrutinized student classroom interactions. These studies typically attempt to link classroom interactions to academic outcomes (i.e., grades). In this study, we start to shift the focus away from connecting student interactions to academic outcomes and examine how the structure of student interactions can encourage an inclusive environment in a formal engineering environment. SNA data was collected via an online survey (n = 502, 74% response rate) one month into the semester at a Western land-grant institution. The survey asked first-year engineering students to indicate with whom they had interacted using a pre-populated list of the class roster and open-ended questions. The number of students that were mentioned by a participant (out-degree) is interpreted as a proxy of their sociableness. Whereas, the number of times a student was mentioned by others (in-degree) is interpreted as popularity. We posit that in an inclusive network structure the social behaviors (i.e., in and out-degree) will be independent of students’ demographic characteristics (e.g., race and gender). Nonparametric hypothesis testing (i.e., Kruskal-Wallis and Dunn’s test) was used to investigate the effects of gender and race on both in and out-degree. Results indicate that the social structure of the first-year engineering community is inclusive of both gender and race. Specifically, results indicated no significant differences for in-degree based on measures of race and gender, for students who provided race and gender information. Out-degree was not significantly different based on race. However, women did demonstrate significantly higher out-degree scores (i.e., greater sociableness) than their peers. Building on previous SNA literature, the increased connections expressed by women may lead to increased learning gains or performance within engineering. Results indicated that the social structure of this first-year engineering course, as indicated by in-degree and out-degree, is not significantly different for underrepresented groups. This result begins to illustrate a more complex story than the existing literature has documented of engineering as an unwelcoming environment for underrepresented students. Future work will explore how these structures do or do not persist over time and how individuals develop attitudes towards diverse individuals as a result of these interactions. We hope that the results of this work will provide practical ways to improve engineering climate for underrepresented students.« less
  2. This work in progress paper discusses preliminary research testing the causal effectiveness of exploratory learning in undergraduate STEM courses. Exploratory learning is an active-learning technique that has been shown to improve students’ conceptual understanding, and is therefore well suited for STEM education. This method reverses the order of traditional lecture-then practice methods, by having students explore a novel problem prior to instruction. Participants (N=150) were first-year engineering students enrolled in an introductory engineering calculus course. Students were taught about two-dimensional vectors in an online, asynchronous learning module. Students were randomly assigned to one of two conditions. In the instruct-first condition,more »students viewed the instruction and then completed a Geogebra™ activity. In the explore-first condition, students completed the activity and then viewed the instruction. Thus, the exact same activities were given to students, allowing us to test the causal effectiveness of reversing the placement of the activity. Afterwards, all students completed an online quiz and a later Vector test. A number of students opened but did not complete the activity. Of those students, no effects of condition were found. For the students who completed the activity, those in the explore-first condition scored higher on the quiz than those in the instruct-first condition. Scores were trending in a similar direction on the vector test. These results demonstrate the potential of exploratory learning to improve understanding in engineering mathematics, and in an online module format. This research also suggests that Geogebra™ may be a useful tool for developing an exploration activity students can complete online.« less
  3. Because Chinese reading and writing systems are not phonetic, Mandarin Chinese learners must construct six-way mental connections in order to learn new words, linking characters, meanings, and sounds. Little research has focused on the difficulties inherent to each specific component involved in this process, especially within digital learning environments. The present work examines Chinese word acquisition within ASSISTments, an online learning platform traditionally known for mathematics education. Students were randomly assigned to one of three conditions in which researchers manipulated a learning assignment to exclude one of three bi-directional connections thought to be required for Chinese language acquisition (i.e., sound-meaningmore »and meaning-sound). Researchers then examined whether students’ performance differed significantly when the learning assignment lacked sound-character, character-meaning, or meaning-sound connection pairs, and whether certain problem types were more difficult for students than others. Assessment of problems by component type (i.e., characters, meanings, and sounds) revealed support for the relative ease of problems that provided sounds, with students exhibiting higher accuracy with fewer attempts and less need for system feedback when sounds were included. However, analysis revealed no significant differences in word acquisition by condition, as evidenced by next-day post-test scores or pre- to post-test gain scores. Implications and suggestions for future work are discussed.« less
  4. In teaching mechanics, we use multiple representations of vectors to develop concepts and analysis techniques. These representations include pictorials, diagrams, symbols, numbers and narrative language. Through years of study as students, researchers, and teachers, we develop a fluency rooted in a deep conceptual understanding of what each representation communicates. Many novice learners, however, struggle to gain such understanding and rely on superficial mimicry of the problem solving procedures we demonstrate in examples. The term representational competence refers to the ability to interpret, switch between, and use multiple representations of a concept as appropriate for learning, communication and analysis. In engineeringmore »statics, an understanding of what each vector representation communicates and how to use different representations in problem solving is important to the development of both conceptual and procedural knowledge. Science education literature identifies representational competence as a marker of true conceptual understanding. This paper presents development work for a new assessment instrument designed to measure representational competence with vectors in an engineering mechanics context. We developed the assessment over two successive terms in statics courses at a community college, a medium-sized regional university, and a large state university. We started with twelve multiple-choice questions that survey the vector representations commonly employed in statics. Each question requires the student to interpret and/or use two or more different representations of vectors and requires no calculation beyond single digit integer arithmetic. Distractor answer choices include common student mistakes and misconceptions drawn from the literature and from our teaching experience. We piloted these twelve questions as a timed section of the first exam in fall 2018 statics courses at both Whatcom Community College (WCC) and Western Washington University. Analysis of students’ unprompted use of vector representations on the open-ended problem-solving section of the same exam provides evidence of the assessment’s validity as a measurement instrument for representational competence. We found a positive correlation between students’ accurate and effective use of representations and their score on the multiple choice test. We gathered additional validity evidence by reviewing student responses on an exam wrapper reflection. We used item difficulty and item discrimination scores (point-biserial correlation) to eliminate two questions and revised the remaining questions to improve clarity and discriminatory power. We administered the revised version in two contexts: (1) again as part of the first exam in the winter 2019 Statics course at WCC, and (2) as an extra credit opportunity for statics students at Utah State University. This paper includes sample questions from the assessment to illustrate the approach. The full assessment is available to interested instructors and researchers through an online tool.« less
  5. In teaching mechanics, we use multiple representations of vectors to develop concepts and analysis techniques. These representations include pictorials, diagrams, symbols, numbers and narrative language. Through years of study as students, researchers, and teachers, we develop a fluency rooted in a deep conceptual understanding of what each representation communicates. Many novice learners, however, struggle to gain such understanding and rely on superficial mimicry of the problem solving procedures we demonstrate in examples. The term representational competence refers to the ability to interpret, switch between, and use multiple representations of a concept as appropriate for learning, communication and analysis. In engineeringmore »statics, an understanding of what each vector representation communicates and how to use different representations in problem solving is important to the development of both conceptual and procedural knowledge. Science education literature identifies representational competence as a marker of true conceptual understanding. This paper presents development work for a new assessment instrument designed to measure representational competence with vectors in an engineering mechanics context. We developed the assessment over two successive terms in statics courses at a community college, a medium-sized regional university, and a large state university. We started with twelve multiple-choice questions that survey the vector representations commonly employed in statics. Each question requires the student to interpret and/or use two or more different representations of vectors and requires no calculation beyond single digit integer arithmetic. Distractor answer choices include common student mistakes and misconceptions drawn from the literature and from our teaching experience. We piloted these twelve questions as a timed section of the first exam in fall 2018 statics courses at both Whatcom Community College (WCC) and Western Washington University. Analysis of students’ unprompted use of vector representations on the open-ended problem-solving section of the same exam provides evidence of the assessment’s validity as a measurement instrument for representational competence. We found a positive correlation between students’ accurate and effective use of representations and their score on the multiple choice test. We gathered additional validity evidence by reviewing student responses on an exam wrapper reflection. We used item difficulty and item discrimination scores (point-biserial correlation) to eliminate two questions and revised the remaining questions to improve clarity and discriminatory power. We administered the revised version in two contexts: (1) again as part of the first exam in the winter 2019 Statics course at WCC, and (2) as an extra credit opportunity for statics students at Utah State University. This paper includes sample questions from the assessment to illustrate the approach. The full assessment is available to interested instructors and researchers through an online tool.« less