skip to main content


Title: Photonic Switched Optically Connected Memory: An Approach to Address Memory Challenges in Deep Learning
Award ID(s):
1640108
NSF-PAR ID:
10209970
Author(s) / Creator(s):
; ; ; ; ; ; ;
Date Published:
Journal Name:
Journal of Lightwave Technology
Volume:
38
Issue:
10
ISSN:
0733-8724
Page Range / eLocation ID:
2815 to 2825
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
  2. Log-Structured Merge-trees (LSM-trees) have been widely used in modern NoSQL systems. Due to their out-of-place update design, LSM-trees have introduced memory walls among the memory components of multiple LSM-trees and between the write memory and the buffer cache. Optimal memory allocation among these regions is non-trivial because it is highly workload-dependent. Existing LSM-tree implementations instead adopt static memory allocation schemes due to their simplicity and robustness, sacrificing performance. In this paper, we attempt to break down these memory walls in LSM-based storage systems. We first present a memory management architecture that enables adaptive memory management. We then present a partitioned memory component structure with new flush policies to better exploit the write memory to minimize the write cost. To break down the memory wall between the write memory and the buffer cache, we further introduce a memory tuner that tunes the memory allocation between these two regions. We have conducted extensive experiments in the context of Apache AsterixDB using the YCSB and TPC-C benchmarks and we present the results here. 
    more » « less
  3. With the increasing problem complexity, more irregular applications are deployed on high-performance clusters due to the parallel working paradigm, and yield irregular memory access behaviors across nodes. However, the irregularity of memory access behaviors is not comprehensively studied, which results in low utilization of the integrated hybrid memory system compositing of stacked DRAM and off-chip DRAM. To address this problem, we devise a novel method called Similarity-Managed Hybrid Memory System (SM-HMS) to improve the hybrid memory system performance by leveraging the memory access similarity among nodes in a cluster. Within SM-HMS, two techniques are proposed, Memory Access Similarity Measuring and Similarity-based Memory Access Behavior Sharing. To quantify the memory access similarity, memory access behaviors of each node are vectorized, and the distance between two vectors is used as the memory access similarity. The calculated memory access similarity is used to share memory access behaviors precisely across nodes. With the shared memory access behaviors, SM-HMS divides the stacked DRAM into two sections, the sliding window section and the outlier section. The shared memory access behaviors guide the replacement of the sliding window section while the outlier section is managed in the LRU manner. Our evaluation results with a set of irregular applications on various clusters consisting of up to 256 nodes have shown that SM-HMS outperforms the state-of-the-art approaches, Cameo, Chameleon, and Hyrbid2, on job finish time reduction by up to 58:6%, 56:7%, and 31:3%, with 46:1%, 41:6%, and 19:3% on average, respectively. SM-HMS can also achieve up to 98:6% (91:9% on average) of the ideal hybrid memory system performance. 
    more » « less
  4. The Deese-Roediger-McDermott (DRM) paradigm examines false memory by introducing words associated with a non-presented ‘critical lure’ as memoranda, which typically causes the lures to be remembered as frequently as studied words. Our prior work has shown enhanced veridical memory and reduced misinformation effects when arousal is induced after learning (i.e., during memory consolidation). These effects have not been examined in the DRM task, or with signal detection analysis, which can elucidate the mechanisms underlying memory alterations. Thus, 130 subjects studied and then immediately recalled six DRM lists, one after another, and then watched a 3-min arousing (n = 61) or neutral (n = 69) video. Recognition tested 70 min later showed that arousal induced after learning led to better delayed discrimination of studied words from a) critical lures, and b) other non-presented ‘weak associates.’ Furthermore, arousal reduced liberal response bias (i.e., the tendency toward accepting dubious information) for studied words relative to all foils, including critical lures and ‘weak associates.’ Thus, arousal induced after learning effectively increased the distinction between signal and noise by enhancing access to verbatim information and reducing endorsement of dubious information. These findings provide important insights into the cognitive mechanisms by which arousal modulates early memory consolidation processes. 
    more » « less