stage4_training / added_tokens.json
Pavankalyan's picture
Upload tokenizer
b0b189c verified
{
"<|assistant|>": 49155,
"<|pad|>": 49152,
"<|system|>": 49153,
"<|user|>": 49154
}