ItsMaxNorm/tokenizerchess
Updated
Edit Models filters
Apps
Inference Providers
Active filters: bpe
almaghrabima/deeplatent-tokenizer
Updated
transhumanist-already-exists/karpotron-tokenizer
Updated • 2
transhumanist-already-exists/DOROFEEVA-gpt-oss-tokenizer
Updated • 1
almaghrabima/SARFTokenizer
Text Generation • Updated • 1
Velkamez/tamazight-sp-bpe
Text Generation • Updated • 73 • 1
stukenov/sozkz-vocab-bpe-32k-kk-base-v1
Text Generation • Updated
stukenov/sozkz-core-gpt2-50k-kk-base-v1
Text Generation • Updated
AstralPotato/en-ms-transformer
Translation • Updated • 2
JonathanMiddleton/daisy
Text Generation • Updated
Arko007/zenyx-v2-tokenizer
Text Generation • Updated • 1
stukenov/sozkz-core-gpt2-200k-kk-base-v1
Updated
stukenov/kzcalm-sp-tokenizer-4k-kk-v1
Updated
openeurollm/tokenizer-256k
Updated • 1
openeurollm/tokenizer-128k
Updated
LisaMegaWatts/JuliaFluxGPT
Text Generation • Updated
smcproject/malayalam-bpe-tokenizer
Updated • 2
LisaMegaWatts/JuliaGPTDistill
Text Generation • Updated
flexitok/bpe_tur_Latn_32000
Updated
flexitok/bpe_dan_Latn_16000
Updated
flexitok/bpe_swe_Latn_16000
Updated
flexitok/bpe_fas_Arab_16000
Updated
flexitok/bpe_hun_Latn_16000
Updated
flexitok/bpe_ell_Grek_16000
Updated
flexitok/bpe_ces_Latn_16000
Updated
flexitok/bpe_arb_Arab_16000
Updated
flexitok/bpe_nld_Latn_16000
Updated
flexitok/bpe_por_Latn_16000
Updated
flexitok/bpe_ita_Latn_16000
Updated
flexitok/bpe_fw_edu_16000
Updated