使用分布原则对语境语言模型进行语义研究

最近做了很多研究来调查语境语言模型的属性，但令人惊讶的是，其中只有少数人考虑了这些模型在语义相似性方面的属性。在这篇文章中，我们首先关注英语的这些属性，利用替代的分布原则作为SemCor和WordNet范式关系控制下的探测机制。然后，我们建议将同样的方法调整到一个更开放的环境中，以描述静态和语境语言模型之间的差异。

原文题目：Using Distributional Principles for the Semantic Study of Contextual Language Models

原文：Many studies were recently done for investigating the properties of contextual language models but surprisingly, only a few of them consider the properties of these models in terms of semantic similarity. In this article, we first focus on these properties for English by exploiting the distributional principle of substitution as a probing mechanism in the controlled context of SemCor and WordNet paradigmatic relations. Then, we propose to adapt the same method to a more open setting for characterizing the differences between static and contextual language models.