Optical networks satisfy high bandwidth and low latency requirements for telecommunication networks and data center interconnection. To improve network resource utilization, machine learning (ML) is used to accurately model optical amplifiers such as erbium-doped fiber amplifiers (EDFAs), which impact end-to-end system performance such as quality of transmission. However, a comprehensive measurement dataset is required for ML to accurately predict an EDFA’s wavelength-dependent gain. We present an open dataset consisting of 202,752 gain spectrum measurements collected from 16 commercial-grade reconfigurable optical add–drop multiplexer (ROADM) booster and pre-amplifier EDFAs under varying gain settings and diverse channel-loading configurations over 2,785 hours in total, with a total dataset size of 3.1 GB. With this EDFA dataset, we implemented component-level deep-neural-network-based EDFA models and use transfer learning (TL) to transfer the EDFA model among 16 ROADM EDFAs, which achieve less than 0.18/0.24 dB mean absolute error for booster/pre-amplifier gain prediction using only 0.5% of the full target training set. We also showed that TL reduces the EDFA data collection requirements on a new gain setting or a different type of EDFA on the same ROADM.
more »
« less
Generalized few-shot transfer learning architecture for modeling the EDFA gain spectrum
Accurate modeling of the gain spectrum in erbium-doped fiber amplifiers (EDFAs) is essential for optimizing optical network performance, particularly as networks evolve toward multi-vendor solutions. In this work, we propose a generalized few-shot transfer learning architecture based on a semi-supervised self-normalizing neural network (SS-NN) that leverages internal EDFA features—such as VOA input/output power and attenuation—to improve gain spectrum prediction. Our SS-NN model employs a two-phase training strategy comprising unsupervised pre-training with noise-augmented measurements and supervised fine-tuning with a custom-weighted MSE loss. Furthermore, we extend the framework with transfer learning (TL) techniques that enable both homogeneous (same-feature space) and heterogeneous (different-feature sets) model adaptation across booster, pre-amplifier, and ILA EDFAs. To address feature mismatches in heterogeneous TL, we incorporate a covariance matching loss to align second-order feature statistics between the source and target domains. Extensive experiments conducted across 26 EDFAs in the COSMOS and Open Ireland testbeds demonstrate that the proposed approach significantly reduces the number of measurement requirements on the system while achieving lower mean absolute errors and improved error distributions compared to benchmark methods.
more »
« less
- Award ID(s):
- 2330333
- PAR ID:
- 10655963
- Publisher / Repository:
- IEEE/Optica
- Date Published:
- Journal Name:
- Journal of Optical Communications and Networking
- Volume:
- 17
- Issue:
- 9
- ISSN:
- 1943-0620
- Page Range / eLocation ID:
- D106
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
We present a novel ML framework for modeling the wavelength-dependent gain of multiple EDFAs, based on semi-supervised, self-normalizing neural networks, enabling one-shot transfer learning. Our experiments on 22 EDFAs in Open Ireland and COSMOS testbeds show high-accuracy transfer-learning even when operated across different amplifier types. ©2023 The Author(s)more » « less
-
Large-scale channel prediction, i.e., estimation of the pathloss from geographical/morphological/building maps, is an essential component of wireless network planning. Ray tracing (RT)-based methods have been widely used for many years, but they require significant computational effort that may become prohibitive with the increased network densification and/or use of higher frequencies in B5G/6G systems. In this paper, we propose a data-driven, model-free pathloss map prediction (PMP) method, called PMNet. PMNet uses a supervised learning approach: it is trained on a limited amount of RT data and map data. Once trained, PMNet can predict pathloss over location with high accuracy (an RMSE level of 10−2 ) in a few milliseconds. We further extend PMNet by employing transfer learning (TL). TL allows PMNet to learn a new network scenario quickly ( ×5.6 faster training) and efficiently (using ×4.5 less data) by transferring knowledge from a pre-trained model, while retaining accuracy. Our results demonstrate that PMNet is a scalable and generalizable ML-based PMP method, showing its potential to be used in several network optimization applications.more » « less
An official website of the United States government

