arthoho66
/

model_005_2000

Automatic Speech Recognition

Model card Files Files and versions

Metrics Training metrics Community

arthoho66 commited on Oct 24, 2023

Commit

aa3293f

·

1 Parent(s): 8ef1f34

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +1 -1

tokenizer_config.json CHANGED Viewed

@@ -26,7 +26,7 @@
   "tokenizer_class": "WhisperTokenizer",
   "unk_token": {
     "__type": "AddedToken",
-    "content": "",
     "lstrip": false,
     "normalized": true,
     "rstrip": false,

   "tokenizer_class": "WhisperTokenizer",
   "unk_token": {
     "__type": "AddedToken",
+    "content": "<|endoftext|>",
     "lstrip": false,
     "normalized": true,
     "rstrip": false,