AI is happening. The future is updating.indobert-base-uncased
We trained the model for 2.4M steps (180 epochs) with the final perplexity over the development set being 3.97 (similar to English BERT-base). This IndoBERT was used to examine IndoLEM - an Indonesian benchmark that comprises of seven tasks for the Indonesian language, spanning morpho-syntax, semantics, and discourse. The paper is published at the 28th COLING 2020. Please refer to https://indolem.github.io for more details about the benchmarks.
We trained the model for 2.4M steps (180 epochs) with the final perplexity over the development set being 3.97 (similar to English BERT-base). This IndoBERT was used to examine IndoLEM - an Indonesian benchmark that comprises of seven tasks for the Indonesian language, spanning morpho-syntax, semantics, and discourse. The paper is published at the 28th COLING 2020. Please refer to https://indolem.github.io for more details about the benchmarks.