@alielfilali01 on Hugging Face: "Why nobdoy is talking about the new training corpus released by MBZUAI today.…"

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

posted an update Oct 9, 2024

Post

1897

Why nobdoy is talking about the new training corpus released by MBZUAI today.

TxT360 is +15 Trillion tokens corpus outperforming FineWeb on several metrics. Ablation studies were done up to 1T tokens.

Read blog here : https://huggingface.co/spaces/LLM360/TxT360
Dataset : https://huggingface.co/datasets/LLM360/TxT360

In this post