More Like this

1. Abstract Graph Neural Networks (GNNs) have shown satisfying performance on various graph learning tasks. To achieve better fitting capability, most GNNs are with a large number of parameters, which makes these GNNs computationally expensive. Therefore, it is difficult to deploy them onto edge devices with scarce computational resources, e.g., mobile phones and wearable smart devices. Knowledge Distillation (KD) is a common solution to compress GNNs, where a light-weighted model (i.e., the student model) is encouraged to mimic the behavior of a computationally expensive GNN (i.e., the teacher GNN model). Nevertheless, most existing GNN-based KD methods lack fairness consideration. As a consequence, the student model usually inherits and even exaggerates the bias from the teacher GNN. To handle such a problem, we take initial steps towards fair knowledge distillation for GNNs. Specifically, we first formulate a novel problem of fair knowledge distillation for GNN-based teacher-student frameworks. Then we propose a principled framework named RELIANT to mitigate the bias exhibited by the student model. Notably the design of RELIANT is decoupled from any specific teacher and student model structures, and thus can be easily adapted to various GNN-based KD frameworks. We perform extensive experiments on multiple real-world datasets, which corroborates that RELIANT achieves less biased GNN knowledge distillation while maintaining high prediction utility. Open-source code can be found at https://github.com/yushundong/RELIANT.

   Dong, Yushun ; Zhang, Binichi ; Yuan, Yiling ; Zou, Na ; Wang, Qi ; Li, Jundong ( January 2023 , Proceedings of the 2023 SIAM International Conference on Data Mining (SDM))
2. Model predictive control with active learning for stochastic systems with structural model uncertainty: Online model discrimination

   https://doi.org/10.1016/j.compchemeng.2019.05.012  

   Heirung, Tor Aksel ; Santos, Tito L.M. ; Mesbah, Ali ( September 2019 , Computers & Chemical Engineering)
3. Is Model Ensemble Necessary? Model-based RL via a Single Model with Lipschitz Regularized Value Function

   Zheng, Ruijie ; Wang, Xiyao ; Xu, Huazhe ; Huang, Furong ( October 2023 , The Eleventh International Conference on Learning Representations)
4. Reducing Model Structural Uncertainty in Climate Model Projections—A Rank-Based Model Combination Approach

   https://doi.org/10.1175/JCLI-D-17-0225.1  

   Bhowmik, R. Das ; Sharma, A. ; Sankarasubramanian, A. ( December 2017 , Journal of Climate)
5. Estimating rainfall time series and model parameter distributions using model data reduction and inversion techniques: ESTIMATING RAINFALL AND MODEL PARAMETERS

   https://doi.org/10.1002/2017WR020442  

   Wright, Ashley J. ; Walker, Jeffrey P. ; Pauwels, Valentijn R. ( August 2017 , Water Resources Research)