How to train on a new knowledge base?

[amirj]

It seems that a lot of people asked for training BLINK for a new knowledge base (i.e. a set of entities + descriptions), but unfortunately I couldn't find relevant information.

May I ask you to add just a quick guide here please?

[Giovani-Merlin]

I've created a new repository for training bi-encoder models, following this tutorial you can train the model in a newer (or in another language) Wikipedia dump using the BLINK code or following this tutorial

[driscoll42]

@Giovani-Merlin It seems those tutorial links you posted are no longer working, could you repost them?

[abhinavkulkarni]

@amirj: You can look at this tutorial #116

[kongmoumou]

I've created a new repository for training bi-encoder models, following this tutorial you can train the model in a newer (or in another language) Wikipedia dump using the BLINK code or following this tutorial

The link seems to be 404, could u please update to the right link @Giovani-Merlin . Thx a lot~

[viraj-lakshitha]

I've created a new repository for training bi-encoder models, following this tutorial you can train the model in a newer (or in another language) Wikipedia dump using the BLINK code or following this tutorial

@Giovani-Merlin : Can you provide access to the mentioned repository ?

[gromajus]

@Giovani-Merlin I would be also very grateful for the access to your tutorial:)

[Giovani-Merlin]

@viraj-lakshitha @gromajus @kongmoumou @driscoll42
Hello! Sorry, a bit late, but I needed to make considerable changes in the tutorials/repo as I was unsatisfied with the final results.
I've split the repo into two parts:

WBDSM for creating the dataset (for any Wikipedia dump in any language)
https://github.com/Giovani-Merlin/wbdsm for creating the dataset

Bet for training bi-encoder models:
https://github.com/Giovani-Merlin/bet

The results are fantastic. You can follow this process illustrated here https://github.com/Giovani-Merlin/bet/blob/main/docs/results.md to train a custom model or to benchmark with Zeshel dataset.

If you have any doubts/issues please use the respective repo issues part :)
Later on I will improve the tutorials/documentation

[driscoll42]

I won't have time for a few weeks, but I will definitely give this a shot. Thanks for updating it!