Learning Parametrised Graph Shift Operators

Dasoulas, George; Lutzeyer, Johannes F.; Vazirgiannis, Michalis

doi:10.48550/arxiv.2101.10050

Cited by 2 publications

(1 citation statement)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…• Regularization based: VBAT (Deng, Dong, and Zhu 2019), Dropedge (Rong et al 2020), GAugO (Zhao et al 2020), and PGSO (Dasoulas, Lutzeyer, and Vazirgiannis 2021). The backbone model used is GCN.…”

Section: Experiments and Analysismentioning

confidence: 99%

Adaptive Kernel Graph Neural Network

Hou

et al. 2022

AAAI

View full text Add to dashboard Cite

Graph neural networks (GNNs) have demonstrated great success in representation learning for graph-structured data. The layer-wise graph convolution in GNNs is shown to be powerful at capturing graph topology. During this process, GNNs are usually guided by pre-defined kernels such as Laplacian matrix, adjacency matrix, or their variants. However, the adoptions of pre-defined kernels may restrain the generalities to different graphs: mismatch between graph and kernel would entail sub-optimal performance. For example, GNNs that focus on low-frequency information may not achieve satisfactory performance when high-frequency information is significant for the graphs, and vice versa. To solve this problem, in this paper, we propose a novel framework - i.e., namely Adaptive Kernel Graph Neural Network (AKGNN) - which learns to adapt to the optimal graph kernel in a unified manner at the first attempt. In the proposed AKGNN, we first design a data-driven graph kernel learning mechanism, which adaptively modulates the balance between all-pass and low-pass filters by modifying the maximal eigenvalue of the graph Laplacian. Through this process, AKGNN learns the optimal threshold between high and low frequency signals to relieve the generality problem. Later, we further reduce the number of parameters by a parameterization trick and enhance the expressive power by a global readout function. Extensive experiments are conducted on acknowledged benchmark datasets and promising results demonstrate the outstanding performance of our proposed AKGNN by comparison with state-of-the-art GNNs. The source code is publicly available at: https://github.com/jumxglhf/AKGNN.

show abstract

Section: Experiments and Analysismentioning

confidence: 99%

Adaptive Kernel Graph Neural Network

Hou

et al. 2022

AAAI

View full text Add to dashboard Cite

show abstract

Adaptive Kernel Graph Neural Network

Ju¹,

Hou²,

Yu³

et al. 2021

Preprint

View full text Add to dashboard Cite

Graph neural networks (GNNs) have demonstrated great success in representation learning for graph-structured data. The layer-wise graph convolution in GNNs is shown to be powerful at capturing graph topology. During this process, GNNs are usually guided by pre-defined kernels such as Laplacian matrix, adjacency matrix, or their variants. However, the adoptions of pre-defined kernels may restrain the generalities to different graphs: mismatch between graph and kernel would entail sub-optimal performance. For example, GNNs that focus on low-frequency information may not achieve satisfactory performance when high-frequency information is significant for the graphs, and vice versa. To solve this problem, in this paper, we propose a novel framework -i.e., namely Adaptive Kernel Graph Neural Network (AKGNN)which learns to adapt to the optimal graph kernel in a unified manner at the first attempt. In the proposed AKGNN, we first design a data-driven graph kernel learning mechanism, which adaptively modulates the balance between all-pass and lowpass filters by modifying the maximal eigenvalue of the graph Laplacian. Through this process, AKGNN learns the optimal threshold between high and low frequency signals to relieve the generality problem. Later, we further reduce the number of parameters by a parameterization trick and enhance the expressive power by a global readout function. Extensive experiments are conducted on acknowledged benchmark datasets and promising results demonstrate the outstanding performance of our proposed AKGNN by comparison with state-of-the-art GNNs. The source code is publicly available at: https://github.com/jumxglhf/AKGNN.

show abstract

Learning Parametrised Graph Shift Operators

Cited by 2 publications

References 18 publications

Adaptive Kernel Graph Neural Network

Adaptive Kernel Graph Neural Network

Adaptive Kernel Graph Neural Network

Contact Info

Product

Resources

About