SVDPE¶

class dgl.transforms.SVDPE(k, feat_name='svd_pe', padding=False, random_flip=True)[source]

Bases: dgl.transforms.module.BaseTransform

SVD-based Positional Encoding, as introduced in Global Self-Attention as a Replacement for Graph Convolution

This function computes the largest $$k$$ singular values and corresponding left and right singular vectors to form positional encodings, which could be stored in ndata.

Parameters
• k (int) – Number of largest singular values and corresponding singular vectors used for positional encoding.

• feat_name (str, optional) – Name to store the computed positional encodings in ndata. Default : svd_pe

• padding (bool, optional) – If False, raise an error when $$k > N$$, where $$N$$ is the number of nodes in g. If True, add zero paddings in the end of encodings when $$k > N$$. Default : False.

• random_flip (bool, optional) – If True, randomly flip the signs of encoding vectors. Proposed to be activated during training for better generalization. Default : True.

Example

>>> import dgl
>>> from dgl import SVDPE

>>> transform = SVDPE(k=2, feat_name="svd_pe")
>>> g = dgl.graph(([0,1,2,3,4,2,3,1,4,0], [2,3,1,4,0,0,1,2,3,4]))
>>> g_ = transform(g)
>>> print(g_.ndata['svd_pe'])
tensor([[-6.3246e-01, -1.1373e-07, -6.3246e-01,  0.0000e+00],
[-6.3246e-01,  7.6512e-01, -6.3246e-01, -7.6512e-01],
[ 6.3246e-01,  4.7287e-01,  6.3246e-01, -4.7287e-01],
[-6.3246e-01, -7.6512e-01, -6.3246e-01,  7.6512e-01],
[ 6.3246e-01, -4.7287e-01,  6.3246e-01,  4.7287e-01]])