We studied the learnability of English filler-gap dependencies and the “island” constraints on them by assessing the generalizations made by autoregressive (incremental) language models that use deep learning to predict the next word given preceding context. Using factorial tests inspired by experimental psycholinguistics, we found that models acquire not only the basic contingency between fillers and gaps, but also the unboundedness and hierarchical constraints implicated in the dependency. We evaluated a model’s acquisition of island constraints by demonstrating that its expectation for a filler-gap contingency is attenuated within an island environment. Our results provide empirical evidence against the argument from the poverty of the stimulus for this particular structure.
more » « less- Award ID(s):
- 2121074
- NSF-PAR ID:
- 10488147
- Publisher / Repository:
- MIT Press
- Date Published:
- Journal Name:
- Linguistic Inquiry
- ISSN:
- 0024-3892
- Page Range / eLocation ID:
- 1 to 44
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
Contingency planning, wherein an agent generates a set of possible plans conditioned on the outcome of an uncertain event, is an increasingly popular way for robots to act under uncertainty. In this work we take a game-theoretic perspective on contingency planning, tailored to multi-agent scenarios in which a robot’s actions impact the decisions of other agents and vice versa. The resulting contingency game allows the robot to efficiently interact with other agents by generating strategic motion plans conditioned on multiple possible intents for other actors in the scene. Contingency games are parameterized via a scalar variable which represents a future time when intent uncertainty will be resolved. By estimating this parameter online, we construct a game-theoretic motion planner that adapts to changing beliefs while anticipating future certainty. We show that existing variants of game-theoretic planning under uncertainty are readily obtained as special cases of contingency games. Through a series of simulated autonomous driving scenarios, we demonstrate that contingency games close the gap between certainty-equivalent games that commit to a single hypothesis and non-contingent multi-hypothesis games that do not account for future uncertainty reduction.more » « less
-
We present experimental evidence showing that different wh-filler-gap dependencies are processed differently, depending on their syntactic licensors. Our studies compared the active storage profiles for why, how, and who (serving as subject or object of the verb). The results of offline and online experiments revealed that these wh-fillers are stored in memory for different durations, and predictably so based on the hypothesised structural distance between each wh-filler and the licensor which determines its grammatical and interpretive functions. Furthermore, the results showed that once the wh-filler is licenced, it is integrated to the current structure, and no longer engenders additional memory costs. Based on these findings, we argue that the mechanism of online sentence processing may employ both storage and integration components in memory.
-
Summary Log-linear models are a classical tool for the analysis of contingency tables. In particular, the subclass of graphical log-linear models provides a general framework for modelling conditional independences. However, with the exception of special structures, marginal independence hypotheses cannot be accommodated by these traditional models. Focusing on binary variables, we present a model class that provides a framework for modelling marginal independences in contingency tables. The approach that is taken is graphical and draws on analogies with multivariate Gaussian models for marginal independence. For the graphical model representation we use bidirected graphs, which are in the tradition of path diagrams. We show how the models can be parameterized in a simple fashion, and how maximum likelihood estimation can be performed by using a version of the iterated conditional fitting algorithm. Finally we consider combining these models with symmetry restrictions.
-
This study investigates the processing of wh-dependencies in English by native speakers and advanced Mandarin Chinese-speaking learners. We examined processing at a filled gap site that was in a licit position (non-island) or located inside an island, a grammatically unlicensed position. Natives showed N400 in the non-island condition, which we take as evidence of gap prediction; no N400 emerged within the island. Learners yielded P600 in the non-island condition, suggesting learners did not predict a gap, but rather experienced syntactic integration difficulty. Like natives, learners showed no effects inside the island. Island sensitivity was also observed for both natives and learners in an offline acceptability judgment task. We also explored whether event-related potentials (ERP) responses were related to attentional control (AC), a cognitive ability that has been related to predictive processing in native speakers, in order to examine whether variability in processing in learners and native speakers is similarly explained. Results showed that increased AC was associated with larger N400s for natives and larger P600s for learners in the non-island condition, suggesting that increased AC may be related to prediction for natives and to integration effort for learners. Overall, learners demonstrated island sensitivity offline and online, suggesting that second language (L2) processing is indeed grammatically-guided. However, ERP results suggest that predictive processing in the resolution of wh-dependencies may be limited, at least for learners whose first language (L1) does not instantiate overt wh-movement.
-
null (Ed.)Thermal conductive gap filler materials are used as thermal interface materials (TIMs) in electronic devices due their numerous advantages, such as higher thermal conductivity, ease of use, and conformity. Silicone is a class of synthetic materials based on a polymeric siloxane backbone which is widely used in thermal gap filler materials. In electronic packages, silicone-based thermal gap filler materials are widely used in industries, whereas silicone-free thermal gap filler materials are emerging as new alternatives for numerous electronics applications. Certainly, characterization of these TIMs is of immense importance since it plays a critical role in heat dissipation and long-term reliability of the electronic packages. Insubstantial studies on the effects of various chemical compounds on the properties of silicone-based and silicone-free TIMs has led to this study, which focuses on the effect of thermal aging on the mechanical, thermal, and dielectric properties of silicone-based and silicone-free TIMs and the chemical compounds that cause the changes in properties of these materials. Characterization techniques such as dynamic mechanical analysis (DMA), thermomechanical analysis (TMA), differential scanning calorimetry (DSC), Fourier transform infrared spectroscopy (FTIR), and broadband dielectric spectroscopy (BbDS) are used to study the mechanical, thermal, and dielectric characteristics of these TIMs, which will guide towards a better understanding of the applicability and reliability of these TIMs. The experiments demonstrate that upon thermal aging at 125 °C, the silicone-free TIM becomes hard, while silicone-based TIM remains viscoelastic, which indicates its wide applicability to higher temperature applications for a long time. Though silicone-based TIM displays better mechanical and thermal properties at elevated temperatures, dielectric properties indicate low conductivity for silicone-free TIM, which makes it a better candidate for silicone-sensitive applications where higher electric insulation is desired.more » « less