Reconstructing Implicit Knowledge with Language Models.
Generating statements that explicate implicit knowledge connecting sentences in text.
aclweb.org/anthology/2021…
github.com/Heidelberg-NLP…
Generating statements that explicate implicit knowledge connecting sentences in text.
aclweb.org/anthology/2021…
github.com/Heidelberg-NLP…
They make use of pre-trained language models which they refine by fine-tuning them on specifically prepared corpora that we enriched with implicit information and by constraining them with relevant concepts and connecting commonsense knowledge paths.
Manual and automatic eva. of the generations shows that by refining language models as proposed they can generate coherent & grammatically sound sentences that explicate implicit knowledge which connects sentence pairs in texts on both in-domain and out-of-domain test data
• • •
Missing some Tweet in this thread? You can try to
force a refresh
