AI is happening. The future is updating.alephbert-base
State-of-the-art language model for Hebrew. Based on Google's BERT architecture (Devlin et al. 2018). 1. OSCAR (Ortiz, 2019) Hebrew section (10 GB text, 20 million sentences). 2. Hebrew dump of Wikipedia (650 MB text, 3 million sentences). 3. Hebrew Tweets collected from the Twitter sample stream (7 GB text, 70 million sentences). Trained on a DGX machine (8 V100 GPUs) using the standard huggingface training procedure.
State-of-the-art language model for Hebrew. Based on Google's BERT architecture (Devlin et al. 2018). 1. OSCAR (Ortiz, 2019) Hebrew section (10 GB text, 20 million sentences). 2. Hebrew dump of Wikipedia (650 MB text, 3 million sentences). 3. Hebrew Tweets collected from the Twitter sample stream (7 GB text, 70 million sentences). Trained on a DGX machine (8 V100 GPUs) using the standard huggingface training procedure.