Concept information
Preferred term
UniLM
Definition(s)
- Language model " pre-trained using three types of language modeling tasks: unidirectional, bidirectional, and sequence-to-sequence prediction." (Dong et al., 2019).
Broader concept(s)
Synonym(s)
- UNIfied pre-trained Language Model
Bibliographic citation(s)
- • Dong, L., Yang, N., Wang, W., Wei, F., Liu, X., Wang, Y., Gao, J., Zhou, M., & Hon, H.-W. (2019). Unified language model pre-training for natural language understanding and generation. arXiv:1905.03197 [cs]. http://arxiv.org/abs/1905.03197
has application field
has for input language
has repository
implements
is encoded in
is executed in
has for license
In other languages
-
French
URI
http://data.loterre.fr/ark:/67375/LTK-DQX644SX-0
{{label}}
{{#each values }} {{! loop through ConceptPropertyValue objects }}
{{#if prefLabel }}
{{/if}}
{{/each}}
{{#if notation }}{{ notation }} {{/if}}{{ prefLabel }}
{{#ifDifferentLabelLang lang }} ({{ lang }}){{/ifDifferentLabelLang}}
{{#if vocabName }}
{{ vocabName }}
{{/if}}