Instructions to use deepvk/RuModernBERT-small with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use deepvk/RuModernBERT-small with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="deepvk/RuModernBERT-small")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("deepvk/RuModernBERT-small") model = AutoModelForMaskedLM.from_pretrained("deepvk/RuModernBERT-small") - Notebooks
- Google Colab
- Kaggle
Не работает сетап с Python 3.12+
#2
by astifer - opened
python3.12
transformers == 4.48.1
204 self.drop = nn.Dropout(config.embedding_dropout)
--> 206 @torch .compile(dynamic=True)
207 def compiled_embeddings(self, input_ids: torch.LongTensor) -> torch.Tensor:
208 return self.drop(self.norm(self.tok_embeddings(input_ids)))
RuntimeError: Failed to import transformers.models.modernbert.modeling_modernbert because of the following error (look up to see its traceback):
Dynamo is not supported on Python 3.12+