skip to main content


Title: Lifelong-RL: Lifelong Relaxation Labeling for Separating Entities and Aspects in Opinion Targets
Award ID(s):
1650900
NSF-PAR ID:
10040006
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Conference on Empirical Methods in Natural Language Processing
Page Range / eLocation ID:
225 to 235
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Precup, Doina ; Chandar, Sarath ; Pascanu, Razvan (Ed.)
    In this paper, we show that the process of continually learning new tasks and memorizing previous tasks introduces unknown privacy risks and challenges to bound the privacy loss. Based upon this, we introduce a formal definition of Lifelong DP, in which the participation of any data tuples in the training set of any tasks is protected, under a consistently bounded DP protection, given a growing stream of tasks. A consistently bounded DP means having only one fixed value of the DP privacy budget, regardless of the number of tasks. To preserve Lifelong DP, we propose a scalable and heterogeneous algorithm, called L2DP-ML with a streaming batch training, to efficiently train and continue releasing new versions of an L2M model, given the heterogeneity in terms of data sizes and the training order of tasks, without affecting DP protection of the private training set. An end-to-end theoretical analysis and thorough evaluations show that our mechanism is significantly better than baseline approaches in preserving Lifelong DP. The implementation of L2DP-ML is available at: https://github.com/haiphanNJIT/PrivateDeepLearning. 
    more » « less
  2. In many animals, the germline differentiates early in embryogenesis, so only mutations that accumulate in germ cells are inherited by offspring. Exceptions to this developmental process may indicate other mechanisms have evolved to limit the effects of deleterious mutation accumulation. Stony corals are animals that can live for hundreds of years and have been thought to produce gametes from somatic tissue. To clarify conflicting evidence about germline-soma distinction in corals, we sequenced high coverage, full genomes with technical replicates for parent coral branches and their sperm pools. We identified post-embryonic single nucleotide variants (SNVs) unique to each parent branch, then checked if each SNV was shared by the respective sperm pool. Twenty-six per cent of post-embryonic SNVs were shared by the sperm and 74% were not. We also identified germline SNVs, those that were present in the sperm but not in the parent. These data suggest that self-renewing stem cells differentiate into germ and soma throughout the adult life of the colony, with SNV rates and patterns differing markedly in stem, soma and germ lineages. In addition to informing the evolution of germlines in metazoans, these insights inform how corals may generate adaptive diversity necessary in the face of global climate change.

     
    more » « less