Skip to content

[IROS 2024]This code repository is the code for the thesis "Transformer-Based Relationship Inference Model for Household Object Organization by Integrating Graph Topological and Ontological Information"

Notifications You must be signed in to change notification settings

Li-XD-Pro/Household-Object-Organization

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Transformer-Based Relationship Inference Model for Household Object Organization by Integrating Graph Topological and Ontological Information

This code repository is the code for the thesis "Transformer-Based Relationship Inference Model for Household Object Organization by Integrating Graph Topological and Ontological Information", this thesis uses GAT to obtain the topology information of the household item relationship graph as well as BERT to obtain the ontology attribute information of the household items, after fusing the two kinds of information, it uses the Transformer model to train an item-relationship inference model. Thus, the relationship information between items can be accurately reasoned. The dataset constructed in this paper is not open source, but provides a sample data in the file "BERT_Input.json", and our dataset is sorted according to this format.

1. INSTALLATION

First, install the dependent python environments using the following commands

conda env create -f environment.yml

2.USAGE

Although we did not provide the original dataset, we provide the topological eigenvectors after encoding the original dataset with the GAT, GAE, GCN, and GraphSAGE models, which are available for download at the following address:

GAT_Embedding

GAE_Embedding

GCN_Embedding

GraphSAGE_Embedding

BERT_Input.

Download the above json file and put it in the root directory

After downloading the above files, you can run the following commands to train the model:

python train.py

About

[IROS 2024]This code repository is the code for the thesis "Transformer-Based Relationship Inference Model for Household Object Organization by Integrating Graph Topological and Ontological Information"

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages