More Like this

1. DIMC: 2219TOPS/W 2569F2/b Digital In-Memory Computing Macro in 28nm Based on Approximate Arithmetic Hardware

   https://doi.org/10.1109/ISSCC42614.2022.9731659  

   Wang, Dewei ; Lin, Chuan-Tung ; Chen, Gregory K. ; Knag, Phil ; Krishnamurthy, Ram K. ; Seok, Mingoo ( February 2022 , 2022 IEEE International Solid- State Circuits Conference (ISSCC))

   In-memory-computing (IMC) SRAM architecture has gained significant attention as it achieves high energy efficiency for computing a convolutional neural network (CNN) model [1]. Recent works investigated the use of analog-mixed-signal (AMS) hardware for high area and energy efficiency [2], [3]. However, AMS hardware output is well known to be susceptible to process, voltage, and temperature (PVT) variations, limiting the computing precision and ultimately the inference accuracy of a CNN. We reconfirmed, through the simulation of a capacitor-based IMC SRAM macro that computes a 256D binary dot product, that the AMS computing hardware has a significant root-mean-square error (RMSE) of 22.5% across the worst-case voltage, temperature (Fig. 16.1.1 top left) and 3-sigma process variations (Fig. 16.1.1 top right). On the other hand, we can implement an IMC SRAM macro using robust digital logic [4], which can virtually eliminate the variability issue (Fig. 16.1.1 top). However, digital circuits require more devices than AMS counterparts (e.g., 28 transistors for a mirror full adder [FA]). As a result, a recent digital IMC SRAM shows a lower area efficiency of 6368F2/b (22nm, 4b/4b weight/activation) [5] than the AMS counterpart (1170F2/b, 65nm, 1b/1b) [3]. In light of this, we aim to adopt approximate arithmetic hardware to improve area and power efficiency and present two digital IMC macros (DIMC) with different levels of approximation (Fig. 16.1.1 bottom left). Also, we propose an approximation-aware training algorithm and a number format to minimize inference accuracy degradation induced by approximate hardware (Fig. 16.1.1 bottom right). We prototyped a 28nm test chip: for a 1b/1b CNN model for CIFAR-10 and across 0.5-to-1.1V supply, the DIMC with double-approximate hardware (DIMC-D) achieves 2569F2/b, 932-2219TOPS/W, 475-20032GOPS, and 86.96% accuracy, while for a 4b/1b CNN model, the DIMC with the single-approximate hardware (DIMC-S) achieves 3814F2/b, 458-990TOPS/W 

   more » « less
2. Amundsen Sea West Antarctic Ice Sheet History

   https://doi.org/10.14379/iodp.proc.379.2021  

   Gohl, K. ; Wellner, J.S. ; Klaus, A. ( February 2021 , Proceedings of the International Ocean Discovery Program)

   The Amundsen Sea sector of Antarctica has long been considered the most vulnerable part of the West Antarctic Ice Sheet (WAIS) because of the great water depth at the grounding line, a subglacial bed seafloor deepening toward the interior of the continent, and the absence of substantial ice shelves. Glaciers in this configuration are thought to be susceptible to rapid or runaway retreat. Ice flowing into the Amundsen Sea Embayment is undergoing the most rapid changes of any sector of the Antarctic ice sheets outside the Antarctic Peninsula, including substantial grounding-line retreat over recent decades, as observed from satellite data. Recent models suggest that a threshold leading to the collapse of WAIS in this sector may have been already crossed and that much of the ice sheet could be lost even under relatively moderate greenhouse gas emission scenarios. Drill cores from the Amundsen Sea provide tests of several key questions about controls on ice sheet stability. The cores offer a direct offshore record of glacial history in a sector that is exclusively influenced by ice draining the WAIS, which allows clear comparisons between the WAIS history and low-latitude climate records. Today, relatively warm (modified) Circumpolar Deep Water (CDW) is impinging onto the Amundsen Sea shelf and causing melting under ice shelves and at the grounding line of the WAIS in most places. Reconstructions of past CDW intrusions can assess the ties between warm water upwelling and large-scale changes in past grounding-line positions. Carrying out these reconstructions offshore from the drainage basin that currently has the most substantial negative mass balance of ice anywhere in Antarctica is thus of prime interest to future predictions. The scientific objectives for this expedition are built on hypotheses about WAIS dynamics and related paleoenvironmental and paleoclimatic conditions. The main objectives are: 1. To test the hypothesis that WAIS collapses occurred during the Neogene and Quaternary and, if so, when and under which environmental conditions; 2. To obtain ice-proximal records of ice sheet dynamics in the Amundsen Sea that correlate with global records of ice-volume changes and proxy records for atmospheric and ocean temperatures; 3. To study the stability of a marine-based WAIS margin and how warm deepwater incursions control its position on the shelf; 4. To find evidence for the earliest major grounded WAIS advances onto the middle and outer shelf; 5. To test the hypothesis that the first major WAIS growth was related to the uplift of the Marie Byrd Land dome. International Ocean Discovery Program (IODP) Expedition 379 completed two very successful drill sites on the continental rise of the Amundsen Sea. Site U1532 is located on a large sediment drift, now called the Resolution Drift, and it penetrated to 794 m with 90% recovery. We collected almost-continuous cores from recent age through the Pleistocene and Pliocene and into the upper Miocene. At Site U1533, we drilled 383 m (70% recovery) into the more condensed sequence at the lower flank of the same sediment drift. The cores of both sites contain unique records that will enable study of the cyclicity of ice sheet advance and retreat processes as well as ocean-bottom water circulation and water mass changes. In particular, Site U1532 revealed a sequence of Pliocene sediments with an excellent paleomagnetic record for high-resolution climate change studies of the previously sparsely sampled Pacific sector of the West Antarctic margin. Despite the drilling success at these sites, the overall expedition experienced three unexpected difficulties that affected many of the scientific objectives: 1. The extensive sea ice on the continental shelf prevented us from drilling any of the proposed shelf sites. 2. The drill sites on the continental rise were in the path of numerous icebergs of various sizes that frequently forced us to pause drilling or leave the hole entirely as they approached the ship. The overall downtime caused by approaching icebergs was 50% of our time spent on site. 3. A medical evacuation cut the expedition short by 1 week. Recovery of core on the continental rise at Sites U1532 and U1533 cannot be used to indicate the extent of grounded ice on the shelf or, thus, of its retreat directly. However, the sediments contained in these cores offer a range of clues about past WAIS extent and retreat. At Sites U1532 and U1533, coarse-grained sediments interpreted to be ice-rafted debris (IRD) were identified throughout all recovered time periods. A dominant feature of the cores is recorded by lithofacies cyclicity, which is interpreted to represent relatively warmer periods variably characterized by sediments with higher microfossil abundance, greater bioturbation, and higher IRD concentrations alternating with colder periods characterized by dominantly gray laminated terrigenous muds. Initial comparison of these cycles to published late Quaternary records from the region suggests that the units interpreted to be records of warmer time intervals in the core tie to global interglacial periods and the units interpreted to be deposits of colder periods tie to global glacial periods. Cores from the two drill sites recovered sediments of dominantly terrigenous origin intercalated or mixed with pelagic or hemipelagic deposits. In particular, Site U1533, which is located near a deep-sea channel originating from the continental slope, contains graded silts, sands, and gravels transported downslope from the shelf to the rise. The channel is likely the pathway of these sediments transported by turbidity currents and other gravitational downslope processes. The association of lithologic facies at both sites predominantly reflects the interplay of downslope and contouritic sediment supply with occasional input of more pelagic sediment. Despite the lack of cores from the shelf, our records from the continental rise reveal the timing of glacial advances across the shelf and thus the existence of a continent-wide ice sheet in West Antarctica during longer time periods since at least the late Miocene. Cores from both sites contain abundant coarse-grained sediments and clasts of plutonic origin transported either by downslope processes or by ice rafting. If detailed provenance studies confirm our preliminary assessment that the origin of these samples is from the plutonic bedrock of Marie Byrd Land, their thermochronological record will potentially reveal timing and rates of denudation and erosion linked to crustal uplift. The chronostratigraphy of both sites enables the generation of a seismic sequence stratigraphy for the entire Amundsen Sea continental rise, spanning the area offshore from the Amundsen Sea Embayment westward along the Marie Byrd Land margin to the easternmost Ross Sea through a connecting network of seismic lines. 

   more » « less
3. Expedition 379 Preliminary Report: Amundsen Sea West Antarctic Ice Sheet History

   https://doi.org/10.14379/iodp.pr.379.2019  

   Gohl, K. ; Wellner, J.S. ; Klaus, A. ( May 2019 , Preliminary report)

   null (Ed.)

   The Amundsen Sea sector of Antarctica has long been considered the most vulnerable part of the West Antarctic Ice Sheet (WAIS) because of the great water depth at the grounding line and the absence of substantial ice shelves. Glaciers in this configuration are thought to be susceptible to rapid or runaway retreat. Ice flowing into the Amundsen Sea Embayment is undergoing the most rapid changes of any sector of the Antarctic Ice Sheet outside the Antarctic Peninsula, including changes caused by substantial grounding-line retreat over recent decades, as observed from satellite data. Recent models suggest that a threshold leading to the collapse of WAIS in this sector may have been already crossed and that much of the ice sheet could be lost even under relatively moderate greenhouse gas emission scenarios. Drill cores from the Amundsen Sea provide tests of several key questions about controls on ice sheet stability. The cores offer a direct record of glacial history offshore from a drainage basin that receives ice exclusively from the WAIS, which allows clear comparisons between the WAIS history and low-latitude climate records. Today, warm Circumpolar Deep Water (CDW) is impinging onto the Amundsen Sea shelf and causing melting of the underside of the WAIS in most places. Reconstructions of past CDW intrusions can assess the ties between warm water upwelling and large-scale changes in past grounding-line positions. Carrying out these reconstructions offshore from the drainage basin that currently has the most substantial negative mass balance of ice anywhere in Antarctica is thus of prime interest to future predictions. The scientific objectives for this expedition are built on hypotheses about WAIS dynamics and related paleoenvironmental and paleoclimatic conditions. The main objectives are 1. To test the hypothesis that WAIS collapses occurred during the Neogene and Quaternary and, if so, when and under which environmental conditions; 2. To obtain ice-proximal records of ice sheet dynamics in the Amundsen Sea that correlate with global records of ice-volume changes and proxy records for atmospheric and ocean temperatures; 3. To study the stability of a marine-based WAIS margin and how warm deep-water incursions control its position on the shelf; 4. To find evidence for earliest major grounded WAIS advances onto the middle and outer shelf; 5. To test the hypothesis that the first major WAIS growth was related to the uplift of the Marie Byrd Land dome. International Ocean Discovery Program (IODP) Expedition 379 completed two very successful drill sites on the continental rise of the Amundsen Sea. Site U1532 is located on a large sediment drift, now called Resolution Drift, and penetrated to 794 m with 90% recovery. We collected almost-continuous cores from the Pleistocene through the Pliocene and into the late Miocene. At Site U1533, we drilled 383 m (70% recovery) into the more condensed sequence at the lower flank of the same sediment drift. The cores of both sites contain unique records that will enable study of the cyclicity of ice sheet advance and retreat processes as well as bottom-water circulation and water mass changes. In particular, Site U1532 revealed a sequence of Pliocene sediments with an excellent paleomagnetic record for high-resolution climate change studies of the previously sparsely sampled Pacific sector of the West Antarctic margin. Despite the drilling success at these sites, the overall expedition experienced three unexpected difficulties that affected many of the scientific objectives: 1. The extensive sea ice on the continental shelf prevented us from drilling any of the proposed shelf sites. 2. The drill sites on the continental rise were in the path of numerous icebergs of various sizes that frequently forced us to pause drilling or leave the hole entirely as they approached the ship. The overall downtime caused by approaching icebergs was 50% of our time spent on site. 3. An unfortunate injury to a member of the ship's crew cut the expedition short by one week. Recovery of core on the continental rise at Sites U1532 and U1533 cannot be used to precisely indicate the position of ice or retreat of the ice sheet on the shelf. However, these sediments contained in the cores offer a range of clues about past WAIS extent and retreat. At Sites U1532 and U1533, coarse-grained sediments interpreted to be ice-rafted debris (IRD) were identified throughout all recovered time periods. A dominant feature of the cores is recorded by lithofacies cyclicity, which is interpreted to represent relatively warmer periods variably characterized by higher microfossil abundance, greater bioturbation, and higher counts of IRD alternating with colder periods characterized by dominantly gray laminated terrigenous muds. Initial comparison of these cycles to published records from the region suggests that the units interpreted as records of warmer time intervals in the core tie to interglacial periods and the units interpreted as deposits of colder periods tie to glacial periods. The cores from the two drill sites recovered sediments of purely terrigenous origin intercalated or mixed with pelagic or hemipelagic deposits. In particular, Site U1533, which is located near a deep-sea channel originating from the continental slope, contains graded sands and gravel transported downslope from the shelf to the abyssal plain. The channel is likely the path of such sediments transported downslope by turbidity currents or other sediment-gravity flows. The association of lithologic facies at both sites predominantly reflects the interplay of downslope and contouritic sediment supply with occasional input of more pelagic sediment. Despite the lack of cores from the shelf, our records from the continental rise reveal the timing of glacial advances across the shelf and thus the existence of a continent-wide ice sheet in West Antarctica at least during longer time periods since the late Miocene. Cores from both sites contain abundant coarse-grained sediments and clasts of plutonic origin transported either by downslope processes or by ice rafting. If detailed provenance studies confirm our preliminary assessment that the origin of these samples is from the plutonic bedrock of Marie Byrd Land, their thermochronological record will potentially reveal timing and rates of denudation and erosion linked to crustal uplift. The chronostratigraphy of both sites enables the generation of a seismic sequence stratigraphy not only for the Amundsen Sea rise but also for the western Amundsen Sea along the Marie Byrd Land margin through a connecting network of seismic lines. 

   more » « less
4. Australia Cretaceous Climate and Tectonics

   https://doi.org/10.14379/iodp.proc.369.2019  

   Hobbs, R.W. ; Huber, B.T. ; Bogus, K.A. ( May 2019 , Proceedings of the International Ocean Discovery Program)

   null (Ed.)

   The tectonic and paleoceanographic setting of the Great Australian Bight (GAB) and the Mentelle Basin (adjacent to Naturaliste Plateau) offered an opportunity to investigate Cretaceous and Cenozoic climate change and ocean dynamics during the last phase of breakup among remnant Gondwana continents. Sediment recovered from sites in both regions during International Ocean Discovery Program Expedition 369 will provide a new perspective on Earth’s temperature variation at subpolar latitudes (60°–62°S) across the extremes of the mid-Cretaceous hot greenhouse climate and the cooling that followed. Basalts and prebreakup sediments were also recovered and will provide constraints regarding the type and age of the Mentelle Basin basement and processes operating during the break up of Gondwana. The primary goals of the expedition were to 1. Investigate the timing and causes for the rise and collapse of the Cretaceous hot greenhouse climate and how this climate mode affected the climate–ocean system and oceanic biota; 2. Determine the relative roles of productivity, ocean temperature, and ocean circulation at high southern latitudes during Cretaceous oceanic anoxic events (OAEs); 3. Investigate potential source regions for deep-water and intermediate-water masses in the southeast Indian Ocean and how these changed during Gondwana breakup; 4. Characterize how oceanographic conditions at the Mentelle Basin changed during the Cenozoic opening of the Tasman Gateway and restriction of the Indonesian Gateway; and 5. Resolve questions on the volcanic and sedimentary origins of the Australo-Antarctic Gulf and Mentelle Basin and provide stratigraphic control on the age and nature of the prebreakup successions. Hole U1512A in the GAB recovered a 691 m thick sequence of black claystone ranging from the lower Turonian to the lower Campanian. Age control is primarily based on calcareous nannofossils, but the presence of other microfossil groups provided consistent low-resolution control. Despite the lithologic uniformity, long- and short-term variations in natural gamma radiation and magnetic susceptibility show cyclic alternations that suggest an orbital control of sediment deposition, which will be useful for developing an astrochronology for the sequence. Sites U1513, U1514, U1515, and U1516 were drilled in water depths between 850 and 3900 m in the Mentelle Basin and penetrated 774, 517, 517, and 542 meters below seafloor, respectively. Under a thin layer of Pleistocene to upper Miocene sediment, Site U1513 cored a succession of Cretaceous units from the Campanian to the Valanginian, as well as a succession of basalts. Site U1514 sampled an expanded Pleistocene to Eocene sequence and terminated in the upper Albian. The Cenomanian to Turonian interval at Site U1514 is represented by deformed sedimentary rocks that probably represent a detachment zone. Site U1515 is located on the west Australian margin at 850 m water depth and was the most challenging site to core because much of the upper 350 m was either chert or poorly consolidated sand. However, the prebreakup Jurassic(?) sediments interpreted from the seismic profiles were successfully recovered. Site U1516 cored an expanded Pleistocene, Neogene, and Paleogene section and recovered a complete Cenomanian/Turonian boundary interval containing five layers with high organic carbon content. Study of the well-preserved calcareous microfossil assemblages from different paleodepths will enable generation of paleotemperature and biotic records that span the rise and collapse of the Cretaceous hot greenhouse (including OAEs 1d and 2), providing insight to resultant changes in deep-water and surface water circulation that can be used to test predictions from earth system models. Measurements of paleotemperature proxies and other data will reveal the timing, magnitude, and duration of peak hothouse conditions and any cold snaps that could have allowed growth of a polar ice sheet. The sites contain a record of the mid-Eocene to early Oligocene opening of the Tasman Gateway and the Miocene to Pliocene restriction of the Indonesian Gateway; both passages have important effects on global oceanography and climate. Advancing understanding of the paleoceanographic changes in a regional context will provide a global test on models of Cenomanian to Turonian oceanographic and climatic evolution related both to extreme Turonian warmth and the evolution of OAE 2. The Early Cretaceous volcanic rocks and underlying Jurassic(?) sediments cored in different parts of the Mentelle Basin provide information on the timing of different stages of the Gondwana breakup. The recovered cores provide sufficient new age constraints to underpin a reevaluation of the basin-wide seismic stratigraphy and tectonic models for the region. 

   more » « less
5. Improving the Quality of the TUSZ Corpus

   Rahman, Safwanur Hamid ( December 2020 , IEEE Signal Processing in Medicine and Biology Symposium (SPMB))

   Obeid, Iyad ; Selesnick, Ivan ; Picone, Joseph (Ed.)

   The Temple University Hospital Seizure Detection Corpus (TUSZ) [1] has been in distribution since April 2017. It is a subset of the TUH EEG Corpus (TUEG) [2] and the most frequently requested corpus from our 3,000+ subscribers. It was recently featured as the challenge task in the Neureka 2020 Epilepsy Challenge [3]. A summary of the development of the corpus is shown below in Table 1. The TUSZ Corpus is a fully annotated corpus, which means every seizure event that occurs within its files has been annotated. The data is selected from TUEG using a screening process that identifies files most likely to contain seizures [1]. Approximately 7% of the TUEG data contains a seizure event, so it is important we triage TUEG for high yield data. One hour of EEG data requires approximately one hour of human labor to complete annotation using the pipeline described below, so it is important from a financial standpoint that we accurately triage data. A summary of the labels being used to annotate the data is shown in Table 2. Certain standards are put into place to optimize the annotation process while not sacrificing consistency. Due to the nature of EEG recordings, some records start off with a segment of calibration. This portion of the EEG is instantly recognizable and transitions from what resembles lead artifact to a flat line on all the channels. For the sake of seizure annotation, the calibration is ignored, and no time is wasted on it. During the identification of seizure events, a hard “3 second rule” is used to determine whether two events should be combined into a single larger event. This greatly reduces the time that it takes to annotate a file with multiple events occurring in succession. In addition to the required minimum 3 second gap between seizures, part of our standard dictates that no seizure less than 3 seconds be annotated. Although there is no universally accepted definition for how long a seizure must be, we find that it is difficult to discern with confidence between burst suppression or other morphologically similar impressions when the event is only a couple seconds long. This is due to several reasons, the most notable being the lack of evolution which is oftentimes crucial for the determination of a seizure. After the EEG files have been triaged, a team of annotators at NEDC is provided with the files to begin data annotation. An example of an annotation is shown in Figure 1. A summary of the workflow for our annotation process is shown in Figure 2. Several passes are performed over the data to ensure the annotations are accurate. Each file undergoes three passes to ensure that no seizures were missed or misidentified. The first pass of TUSZ involves identifying which files contain seizures and annotating them using our annotation tool. The time it takes to fully annotate a file can vary drastically depending on the specific characteristics of each file; however, on average a file containing multiple seizures takes 7 minutes to fully annotate. This includes the time that it takes to read the patient report as well as traverse through the entire file. Once an event has been identified, the start and stop time for the seizure is stored in our annotation tool. This is done on a channel by channel basis resulting in an accurate representation of the seizure spreading across different parts of the brain. Files that do not contain any seizures take approximately 3 minutes to complete. Even though there is no annotation being made, the file is still carefully examined to make sure that nothing was overlooked. In addition to solely scrolling through a file from start to finish, a file is often examined through different lenses. Depending on the situation, low pass filters are used, as well as increasing the amplitude of certain channels. These techniques are never used in isolation and are meant to further increase our confidence that nothing was missed. Once each file in a given set has been looked at once, the annotators start the review process. The reviewer checks a file and comments any changes that they recommend. This takes about 3 minutes per seizure containing file, which is significantly less time than the first pass. After each file has been commented on, the third pass commences. This step takes about 5 minutes per seizure file and requires the reviewer to accept or reject the changes that the second reviewer suggested. Since tangible changes are made to the annotation using the annotation tool, this step takes a bit longer than the previous one. Assuming 18% of the files contain seizures, a set of 1,000 files takes roughly 127 work hours to annotate. Before an annotator contributes to the data interpretation pipeline, they are trained for several weeks on previous datasets. A new annotator is able to be trained using data that resembles what they would see under normal circumstances. An additional benefit of using released data to train is that it serves as a means of constantly checking our work. If a trainee stumbles across an event that was not previously annotated, it is promptly added, and the data release is updated. It takes about three months to train an annotator to a point where their annotations can be trusted. Even though we carefully screen potential annotators during the hiring process, only about 25% of the annotators we hire survive more than one year doing this work. To ensure that the annotators are consistent in their annotations, the team conducts an interrater agreement evaluation periodically to ensure that there is a consensus within the team. The annotation standards are discussed in Ochal et al. [4]. An extended discussion of interrater agreement can be found in Shah et al. [5]. The most recent release of TUSZ, v1.5.2, represents our efforts to review the quality of the annotations for two upcoming challenges we hosted: an internal deep learning challenge at IBM [6] and the Neureka 2020 Epilepsy Challenge [3]. One of the biggest changes that was made to the annotations was the imposition of a stricter standard for determining the start and stop time of a seizure. Although evolution is still included in the annotations, the start times were altered to start when the spike-wave pattern becomes distinct as opposed to merely when the signal starts to shift from background. This cuts down on background that was mislabeled as a seizure. For seizure end times, all post ictal slowing that was included was removed. The recent release of v1.5.2 did not include any additional data files. Two EEG files had been added because, originally, they were corrupted in v1.5.1 but were able to be retrieved and added for the latest release. The progression from v1.5.0 to v1.5.1 and later to v1.5.2, included the re-annotation of all of the EEG files in order to develop a confident dataset regarding seizure identification. Starting with v1.4.0, we have also developed a blind evaluation set that is withheld for use in competitions. The annotation team is currently working on the next release for TUSZ, v1.6.0, which is expected to occur in August 2020. It will include new data from 2016 to mid-2019. This release will contain 2,296 files from 2016 as well as several thousand files representing the remaining data through mid-2019. In addition to files that were obtained with our standard triaging process, a part of this release consists of EEG files that do not have associated patient reports. Since actual seizure events are in short supply, we are mining a large chunk of data for which we have EEG recordings but no reports. Some of this data contains interesting seizure events collected during long-term EEG sessions or data collected from patients with a history of frequent seizures. It is being mined to increase the number of files in the corpus that have at least one seizure event. We expect v1.6.0 to be released before IEEE SPMB 2020. The TUAR Corpus is an open-source database that is currently available for use by any registered member of our consortium. To register and receive access, please follow the instructions provided at this web page: https://www.isip.piconepress.com/projects/tuh_eeg/html/downloads.shtml. The data is located here: https://www.isip.piconepress.com/projects/tuh_eeg/downloads/tuh_eeg_artifact/v2.0.0/. 

   more » « less