More Like this

1. On the Random Conjugate Kernel and Neural Tangent Kernel

   Hu, Zhengmian; Huang, Heng (January 2021, Thirty-eighth International Conference on Machine Learning (ICML 2021))
2. Probabilistic Neural-Kernel Tensor Decomposition

   https://doi.org/10.1109/ICDM50108.2020.00062  

   Tillinghast, Conor; Fang, Shikai; Zhang, Kai; Zhe, Shandian (November 2020, 2020 IEEE International Conference on Data Mining (ICDM))

   null (Ed.)
3. Adaptive Kernel Graph Neural Network

   Ju, Mingxuan; Hou, Shifu; Fan, Yujie; Zhao, Jianan; Ye, Yanfang; Zhao, Liang (January 2022, The 36th AAAI Conference on Artificial Intelligence (AAAI))
4. Adaptive Kernel Graph Neural Network

   Ju, Mingxuan; Hou, Shifu; Fan, Yujie; Zhao, Jianan; Ye, Yanfang; Zhao, Liang (January 2022, The 36th AAAI Conference on Artificial Intelligence (AAAI))
5. The Recurrent Neural Tangent Kernel

   Alemohammad, Sina; Wang, Zichao; Balestriero, Randall; Baraniuk, Richard (May 2021, The International Conference on Learning Representations)

   The study of deep neural networks (DNNs) in the infinite-width limit, via the so-called neural tangent kernel (NTK) approach, has provided new insights into the dynamics of learning, generalization, and the impact of initialization. One key DNN architecture remains to be kernelized, namely, the recurrent neural network (RNN). In this paper we introduce and study the Recurrent Neural Tangent Kernel (RNTK), which provides new insights into the behavior of overparametrized RNNs. A key property of the RNTK should greatly benefit practitioners is its ability to compare inputs of different length. To this end, we characterize how the RNTK weights different time steps to form its output under different initialization parameters and nonlinearity choices. A synthetic and 56 real-world data experiments demonstrate that the RNTK offers significant performance gains over other kernels, including standard NTKs, across a wide array of data sets. 

   more » « less