From Graph Convolutional Network (GCN), we learned that combining local graph structure and node-level features yields good performance on node classification task. However, the way GCN aggregates is structure-dependent, which may hurt its generalizability.
Complete code and notebook of this tutorial is available here: https://docs.dgl.ai/tutorials/models/1_gnn/9_gat.html.
Just wanted to know whether that above GAT can handle multiple node features.
Sounds like you want to deal with heterogeneous graphs. We are currently working on a user friendly support for them. Nevertheless you should be able to work with different node features with some hack. Feel free if you want to have more concrete ideas, in which case you may provide more details.
Yes exactly but how to instrument GAT for handling multiple features. Refer the Blog initiated by me Multiple Node & Edge features where i got some answer but not exactly.
We are designing a Graph Representation learning model to spot patterns in detecting fraudulent transactions and also for defect detection/identification in finance domain.Here the patterns are detected/identified through connected nodes/edges of various critical parameters/indicators. Each nodes will have many features with corresponding values in it and even the Nodes/Edge label are also one of the factor in the representation learning.
Let’s say we have two kind of node features n1, n2, and two kind of edge features e1, e2, what can be the detailed node/edge feature update you would like to perform (e.g. in the form of math equations)? I’ll try to prototype it with dgl.
Please find attached an example with basic table to identify error patterns with two parameters “Err Ind” and “Err Weightage” which are derived from various other features … “Autual”, “Recorded”, “Diff”, “Diff in Value”… An UDF will be opt for this kind of scenarios and the expression may be specific to nodes/edges. Pl suggest
The table you present suggests that you have multiple node features. Then the simplest thing I may try would be to concatenate all node features first and then perform a GNN node feature update as usual. I may also do:
Thanks for your quick update. Few queries from your inference
#1 Whether deep learning on node / edge label is factored in your recommendation
#2 How to handle a node feature which has string as values and sometimes string & numeric value together
#3 Is there any provision for leanings on directed graph representation in DGL ? Still I believe we may have work around to store it as one of node/edge features.
dgl.function.copy_edge. You can concatenate edge labels with the features of source nodes and perform a similar operation as my previous proposal.reverse transformation might be helpful.Refer to your recommendation
*** Add residual connection to preserve original node feature.**
What is residual connection mean? it is just adding some more features to a node.
*** Replace a linear layer by a MLP in GNN node feature update.**
I believe you refer here as feature extraction concepts. We know message passing techniques by reduce and apply nodes. Do you refer something else? Can you please help me with some code snippets / link on feature update / MLP layer in DGL.
Does the GAT take into account edge features/attributes? If not, how to include them?
How to create the kind of graph visualization shown in the link ?
No, GAT does not take edge feature into account.
It’s possible to extend GAT so that it could handle edge information, for example:
Of course you could try other methods too.
Same question. Thank you.
I want to solve this problem, But I haven’t find ang solution. If you know, plaese send me a email(1248742467@qq.com)
Can I use the above code for node regression model.Apart from changes in the output layer is there anything which we need to change to achieve the same.
I think it’s the same.
