Multi_GPU GAT and Model_zoo

I want to use GAT and model_zoo (graph regression) for my own dataset.
Since my dataset is big one GPU is not enough and I should use multi GPUs.
I check both GATand Model_zoo, unfortunately I cannot use them with multi_GPUs, I’m wondering if I can change the code to make it works with multi-GPUs.

You may find the example of training transformer with DGL using multi gpu helpful. Also check PyTorch’s tutorial.