bert-large-uncased-whole-word-masking

Pretrained model on English language using a masked language modeling (MLM) objective. It was introduced in this paper and first released in this repository. This model is uncased: it does not make a difference between english and English. Differently to other BERT models, this model was trained with a new technique: Whole Word Masking. In this case, all of the tokens corresponding to a word are masked at once. The overall masking rate remains the same. Disclaimer: The team releasing BERT did not write a model card for this model so this model card has been written by the Hugging Face team.