Reproducing RGCN results on WN18

Hi, i was trying out the code on using RGCN for link prediction https://github.com/dmlc/dgl/blob/master/examples/pytorch/rgcn/link_predict.py, by changing the dataset from FB15k-237 to WN18. However, the results i got for MRR (filtered) is around 0.69, which is significantly different from the results published in the paper (0.819). I am curious whether there is anything different in the training paradigm used?

Thank you.

We are investigating this problem now.

Thank you very much. Hope to hear from you soon :slight_smile:

Hi is there any updates on this issue? Thank you!

Hi, we are lacking bandwidth on this case.
BTW, did you check whether the score is Filtered-MRR or MRR?