Note: When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher.
Some full text articles may not yet be available without a charge during the embargo (administrative interval).
What is a DOI Number?
Some links on this page may take you to non-federal websites. Their policies may differ from this site.
-
Despite significant progress in video question answering (VideoQA), existing methods fall short of questions that require causal/temporal reasoning across frames. This can be attributed to imprecise motion representations. We introduce Action Temporality Modeling (ATM) for temporality reasoning via three-fold uniqueness: (1) rethinking the optical flow and realizing that optical flow is effective in capturing the long horizon temporality reasoning; (2) training the visual-text embedding by contrastive learning in an action-centric manner, leading to better action representations in both vision and text modalities; and (3) preventing the model from answering the question given the shuffled video in the fine-tuning stage, to avoid spurious correlation between appearance and motion and hence ensure faithful temporality reasoning. In the experiments, we show that ATM outperforms existing approaches in terms of the accuracy on multiple VideoQAs and exhibits better true temporality reasoning ability.more » « less
-
Acoustic resonances in open systems, which are usually associated with resonant modes characterized by complex eigenfrequencies, play a fundamental role in manipulating acoustic wave radiation and propagation. Notably, they are accompanied by considerable field enhancement, boosting interactions between waves and matter, and leading to various exciting applications. In the past two decades, acoustic metamaterials have enabled a high degree of control over tailoring acoustic resonances over a range of frequencies. Here, we provide an overview of recent advances in the area of acoustic resonances in non-Hermitian open systems, including Helmholtz resonators, metamaterials and metasurfaces, and discuss their applications in various acoustic devices, including sound absorbers, acoustic sources, vortex beam generation and imaging. We also discuss bound states in the continuum and their applications in boosting acoustic wave–matter interactions, active phononics and non-Hermitian acoustic resonances, including phononic topological insulators and the acoustic skin effect.more » « less
-
Abstract Transitioning from pluripotency to differentiated cell fates is fundamental to both embryonic development and adult tissue homeostasis. Improving our understanding of this transition would facilitate our ability to manipulate pluripotent cells into tissues for therapeutic use. Here, we show that membrane voltage (Vm) regulates the exit from pluripotency and the onset of germ layer differentiation in the embryo, a process that affects both gastrulation and left-right patterning. By examining candidate genes of congenital heart disease and heterotaxy, we identify
KCNH6 , a member of the ether-a-go-go class of potassium channels that hyperpolarizes the Vmand thus limits the activation of voltage gated calcium channels, lowering intracellular calcium. In pluripotent embryonic cells, depletion ofkcnh6 leads to membrane depolarization, elevation of intracellular calcium levels, and the maintenance of a pluripotent state at the expense of differentiation into ectodermal and myogenic lineages. Using high-resolution temporal transcriptome analysis, we identify the gene regulatory networks downstream of membrane depolarization and calcium signaling and discover that inhibition of the mTOR pathway transitions the pluripotent cell to a differentiated fate. By manipulating Vmusing a suite of tools, we establish a bioelectric pathway that regulates pluripotency in vertebrates, including human embryonic stem cells.