-
Notifications
You must be signed in to change notification settings - Fork 11
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
1 changed file
with
190 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,190 @@ | ||
| <h1 align="center"> | ||
| <b>datasets-knowledge-embedding</b> | ||
| </h1> | ||
| <p align="center"> | ||
| <!-- License --> | ||
| <a href="https://github.com/simonepri/datasets-knowledge-embedding/tree/master/license"> | ||
| <img src="https://img.shields.io/github/license/simonepri/datasets-knowledge-embedding.svg" alt="Project license" /> | ||
| </a> | ||
| </p> | ||
| <p align="center"> | ||
| 📝 A collection of common datasets used in knowledge embedding | ||
| </p> | ||
|
|
||
|
|
||
| ## Datasets | ||
|
|
||
| This project collects different datasets used in various knowledge embedding related papers. | ||
| It also standardizes the format of these datasets, making it easier to use them in the evaluation of new works. | ||
|
|
||
| The datasets can be downloaded from the [release page][release]. | ||
| For licensing information, please refer to the original dataset license file. | ||
|
|
||
|
|
||
| ### COUNTRIES-S1 | ||
| This dataset was introduced in [On Approximate Reasoning Capabilities of Low-Rank Vector Spaces](https://www.aaai.org/ocs/index.php/SSS/SSS15/paper/view/10257). | ||
| The link to the original dataset as released by the authors is unknown but a copy has been taken from [here](https://github.com/TimDettmers/ConvE/tree/master/countries). | ||
|
|
||
| | Entities | Relation Types | Edges | Train Edges | Validation Edges | Test Edges | | ||
| |----------|----------------|-------|-------------|------------------|------------| | ||
| | 271 | 2 | 1159 | 1111 | 24 | 24 | | ||
|
|
||
| [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/COUNTRIES-S1.tgz) [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/COUNTRIES-S1-ID.tgz) | ||
|
|
||
|
|
||
| ### COUNTRIES-S2 | ||
| This dataset was introduced in [On Approximate Reasoning Capabilities of Low-Rank Vector Spaces](https://www.aaai.org/ocs/index.php/SSS/SSS15/paper/view/10257). | ||
| The link to the original dataset as released by the authors is unknown but a copy has been taken from [here](https://github.com/TimDettmers/ConvE/tree/master/countries). | ||
|
|
||
| | Entities | Relation Types | Edges | Train Edges | Validation Edges | Test Edges | | ||
| |----------|----------------|-------|-------------|------------------|------------| | ||
| | 271 | 2 | 1111 | 1063 | 24 | 24 | | ||
|
|
||
| [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/COUNTRIES-S2.tgz) [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/COUNTRIES-S2-ID.tgz) | ||
|
|
||
| ### COUNTRIES-S3 | ||
| This dataset was introduced in [On Approximate Reasoning Capabilities of Low-Rank Vector Spaces](https://www.aaai.org/ocs/index.php/SSS/SSS15/paper/view/10257). | ||
| The link to the original dataset as released by the authors is unknown but a copy has been taken from [here](https://github.com/TimDettmers/ConvE/tree/master/countries). | ||
|
|
||
| | Entities | Relation Types | Edges | Train Edges | Validation Edges | Test Edges | | ||
| |----------|----------------|-------|-------------|------------------|------------| | ||
| | 271 | 2 | 1033 | 985 | 24 | 24 | | ||
|
|
||
| [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/COUNTRIES-S3.tgz) [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/COUNTRIES-S3-ID.tgz) | ||
|
|
||
| ### FB15K | ||
| This dataset was introduced in [Translating Embeddings for Modeling Multi-relational Data](https://dl.acm.org/doi/10.5555/2999792.2999923). | ||
| The original dataset as release by the authors is available [here](https://everest.hds.utc.fr/doku.php?id=en:transe). | ||
|
|
||
| | Entities | Relation Types | Edges | Train Edges | Validation Edges | Test Edges | | ||
| |----------|----------------|-------|-------------|------------------|------------| | ||
| | 14951 | 1345 | 592213 | 483142 | 50000 | 59071 | | ||
|
|
||
| [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/FB15K.tgz) [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/FB15K-ID.tgz) | ||
|
|
||
| ### FB15K-237 | ||
| This dataset was introduced in [Observed versus latent features for knowledge base and text inference](https://www.aclweb.org/anthology/W15-4007/). | ||
| The original dataset as release by the authors is available [here](https://www.microsoft.com/en-us/download/details.aspx?id=52312). | ||
|
|
||
| | Entities | Relation Types | Edges | Train Edges | Validation Edges | Test Edges | | ||
| |----------|----------------|-------|-------------|------------------|------------| | ||
| | 14541 | 237 | 310116 | 272115 | 17535 | 20466 | | ||
|
|
||
| [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/FB15K-237.tgz) [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/FB15K-237-ID.tgz) | ||
|
|
||
| ### KINSHIP | ||
| This dataset was introduced in [Learning systems of concepts with an infinite relational model](https://dl.acm.org/doi/10.5555/1597538.1597600). | ||
| The original dataset as release by the authors is available [here](http://www.charleskemp.com/code/irm.html). | ||
|
|
||
| | Entities | Relation Types | Edges | Train Edges | Validation Edges | Test Edges | | ||
| |----------|----------------|-------|-------------|------------------|------------| | ||
| | 104 | 25 | 10686 | 8544 | 1068 | 1074 | | ||
|
|
||
| [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/KINSHIP.tgz) [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/KINSHIP-ID.tgz) | ||
|
|
||
| ### NATIONS | ||
| This dataset was introduced in [Learning systems of concepts with an infinite relational model](https://dl.acm.org/doi/10.5555/1597538.1597600). | ||
| The original dataset as release by the authors is available [here](http://www.charleskemp.com/code/irm.html). | ||
|
|
||
| | Entities | Relation Types | Edges | Train Edges | Validation Edges | Test Edges | | ||
| |----------|----------------|-------|-------------|------------------|------------| | ||
| | 14 | 55 | 1992 | 1592 | 199 | 201 | | ||
|
|
||
| [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/NATIONS.tgz) [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/NATIONS-ID.tgz) | ||
|
|
||
| ### UMLS | ||
| This dataset was introduced in [Learning systems of concepts with an infinite relational model](https://dl.acm.org/doi/10.5555/1597538.1597600). | ||
| The original dataset as release by the authors is available [here](http://www.charleskemp.com/code/irm.html). | ||
|
|
||
| | Entities | Relation Types | Edges | Train Edges | Validation Edges | Test Edges | | ||
| |----------|----------------|-------|-------------|------------------|------------| | ||
| | 135 | 46 | 6529 | 5216 | 652 | 661 | | ||
|
|
||
| [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/UMLS.tgz) [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/UMLS-ID.tgz) | ||
|
|
||
| ### WN18 | ||
| This dataset was introduced in [Translating Embeddings for Modeling Multi-relational Data](https://dl.acm.org/doi/10.5555/2999792.2999923). | ||
| The original dataset as release by the authors is available [here](https://everest.hds.utc.fr/doku.php?id=en:transe). | ||
|
|
||
| | Entities | Relation Types | Edges | Train Edges | Validation Edges | Test Edges | | ||
| |----------|----------------|-------|-------------|------------------|------------| | ||
| | 41105 | 18 | 151442 | 141442 | 5000 | 5000 | | ||
|
|
||
| [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/WN18.tgz) [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/WN18-ID.tgz) | ||
|
|
||
| ### WN18RR | ||
| This dataset was introduced in [Convolutional 2D Knowledge Graph Embeddings](https://arxiv.org/abs/1707.01476). | ||
| The original dataset as release by the authors is available [here](https://github.com/TimDettmers/ConvE). | ||
|
|
||
| | Entities | Relation Types | Edges | Train Edges | Validation Edges | Test Edges | | ||
| |----------|----------------|-------|-------------|------------------|------------| | ||
| | 41105 | 11 | 93003 | 86835 | 3034 | 3134 | | ||
|
|
||
| [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/WN18RR.tgz) [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/WN18RR-ID.tgz) | ||
|
|
||
| ### YAGO3-10 | ||
| This dataset was introduced in [Convolutional 2D Knowledge Graph Embeddings](https://arxiv.org/abs/1707.01476). | ||
| The original dataset as release by the authors is available [here](https://github.com/TimDettmers/ConvE). | ||
|
|
||
| | Entities | Relation Types | Edges | Train Edges | Validation Edges | Test Edges | | ||
| |----------|----------------|-------|-------------|------------------|------------| | ||
| | 123182 | 37 | 1089040 | 1079040 | 5000 | 5000 | | ||
|
|
||
| [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/YAGO3-10.tgz) [](https://github.com/simonepri/datasets-knowledge-embedding/releases/latest/download/YAGO3-10-ID.tgz) | ||
|
|
||
|
|
||
| ## Add a new dataset | ||
|
|
||
| If you want to add a new dataset to this collection, first you need to create three files called `train.tsv`, `valid.tsv`, and `test.tsv` containing respectively the edges for the three splits train, validation and test. | ||
| The files must contain tab-separated triples of the form `(head entity, relation, tail entity)`. | ||
|
|
||
| Once you did this, you can simply process the three files with the following bash script. | ||
|
|
||
| ```bash | ||
| bash build.sh train.tsv valid.tsv test.tsv . | ||
| ``` | ||
|
|
||
| The script uses the [datasets-knowledge-embedding][github:simonepri/datasets-knowledge-embedding] tool under the hood. | ||
|
|
||
|
|
||
| ## Authors | ||
|
|
||
| - **Simone Primarosa** - [simonepri][github:simonepri] | ||
|
|
||
| See also the list of [contributors][contributors] who participated in this project. | ||
|
|
||
|
|
||
| ## License | ||
|
|
||
| This project is licensed under the MIT License - see the [license][license] file for details. | ||
|
|
||
| <!-- Links --> | ||
| [license]: https://github.com/simonepri/datasets-knowledge-embedding/tree/master/license | ||
| [contributors]: https://github.com/simonepri/datasets-knowledge-embedding/contributors | ||
| [release]: https://github.com/simonepri/datasets-knowledge-embedding/releases/latest | ||
|
|
||
| [github:simonepri]: https://github.com/simonepri | ||
|
|
||
| [github:simonepri/datasets-knowledge-embedding]: https://github.com/simonepri/datasets-knowledge-embedding |