File size: 793 Bytes
6a7a3d9
 
6558638
 
 
 
 
6a7a3d9
6558638
029fa61
6558638
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2b257bd
 
 
6558638
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
---
license: apache-2.0
language:
- he
library_name: transformers
tags:
- bert
---

> Update 2025-5-12: This model is `BEREL` version 1.0. We are now happy to provide a much improved [BEREL_3.0](https://huggingface.co/dicta-il/BEREL_3.0).


# Introducing BEREL: BERT Embeddings for Rabbinic-Encoded Language

When using BEREL, please reference:


Avi Shmidman, Joshua Guedalia, Shaltiel Shmidman, Cheyn Shmuel Shmidman, Eli Handel, Moshe Koppel, "Introducing BEREL: BERT Embeddings for Rabbinic-Encoded Language", Aug 2022 [arXiv:2208.01875]



1. Usage:

```python
from transformers import AutoTokenizer, BertForMaskedLM

tokenizer = AutoTokenizer.from_pretrained('dicta-il/BEREL')
model = BertForMaskedLM.from_pretrained('dicta-il/BEREL')

# for evaluation, disable dropout
model.eval()
```