Concept information
Preferred term
BERT
Definition(s)
- "BERT is designed to pretrain deep bidirectional representations from unlabeled text by jointly conditioning on both left and right context in all layers." (Devlin et al., 2019).
Broader concept(s)
Synonym(s)
- Bidirectional Encoder Representations from Transformers
Bibliographic citation(s)
- • Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT : Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805 [cs]. http://arxiv.org/abs/1810.04805
base of
- ALBERT
- AlBERTo
- ALeaseBERT
- AlephBERT
- AraBERT
- ARBERT
- BanglaBERT
- BEHRT
- BERTimbau
- BERTje
- BERTopic
- BERT-PLI
- BERT-SentiX
- BERTurk
- BETO
- BioBERT
- BioMedBERT
- BlueBERT
- CharBERT
- ClinicalBERT
- convBERT
- COVID-Twitter-BERT
- Czech-B
- DeBERTa
- DistilBERT
- entityBERT
- estBERT
- FARM
- Finnish BERT
- FlauBERT
- German BERT
- GluonNLP
- golgotha
- GreekBERT
- HateBERT
- HeBERT
- HerBERT
- IndoBERT
- Kashgari
- KB-BERT
- KeyBERT
- KLUE-BERT
- KM-BERT
- KoBERT
- KR-BERT
- Legal-BERT
- MARBERT
- MathBERT
- M-BERT
- MC-BERT
- medBERT
- MobileBERT
- Mol-BERT
- MuRIL
- NetBERT
- OAG-BERT
- OpenNRE
- OuBioBERT
- ParsBERT
- PhoBERT
- ProteinBERT
- PubMedBERT
- RadBERT
- RBERT
- RoBERTa
- Romanian BERT
- ruBERT
- SBERT
- sciBERT
- Slavic BERT
- spanBERT
- srBERT
- StructBERT
- TinyBERT
- TOD-BERT
- Tohoku-BERT
- Top2Vec
- UmlsBERT
- UTH-BERT
has application field
has design country
- United States
has for input language
has repository
has download location
is implemented by
is encoded in
is executed in
has for license
In other languages
-
French
URI
http://data.loterre.fr/ark:/67375/LTK-SSWGBD85-7
{{label}}
{{#each values }} {{! loop through ConceptPropertyValue objects }}
{{#if prefLabel }}
{{/if}}
{{/each}}
{{#if notation }}{{ notation }} {{/if}}{{ prefLabel }}
{{#ifDifferentLabelLang lang }} ({{ lang }}){{/ifDifferentLabelLang}}
{{#if vocabName }}
{{ vocabName }}
{{/if}}