language: | |
- he | |
tags: | |
- language model | |
Checkpoint of the alephbertgimmel-base-512 from https://github.com/Dicta-Israel-Center-for-Text-Analysis/alephbertgimmel | |
(for testing purpose, please use original checkpoints of the authors of this model) | |
AlephBertGimmel - Modern Hebrew pretrained BERT model with a 128K token vocabulary. | |
When using AlephBertGimmel, please reference: | |
``` | |
Eylon Guetta, Avi Shmidman, Shaltiel Shmidman, Cheyn Shmuel Shmidman, Joshua Guedalia, Moshe Koppel, Dan Bareket, Amit Seker and Reut Tsarfaty, "Large Pre-Trained Models with Extra-Large Vocabularies: A Contrastive Analysis of Hebrew BERT Models and a New One to Outperform Them All", Nov 2022 [http://arxiv.org/abs/2211.15199] | |
``` |