Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval
Paper • 2311.05800 • Published • 4
🦢SWIM-IR Dataset [NAACL'24]
29 million Synthetic Wikipedia-based Multilingual Retrieval Training Pairs.
-
nthakur/swim-ir-cross-lingual
Viewer • Updated • 15.4M • 362 • 9Note SWIM-IR (Cross-lingual) dataset, where the query is in the target language and the passage is in English.
nthakur/swim-ir-monolingual
Viewer • Updated • 3.17M • 163 • 10Note SWIM-IR (Monolingual) dataset, where both the query and the passage are in the target language.
nthakur/indic-swim-ir-cross-lingual
Viewer • Updated • 93k • 118 • 2Note Indic SWIM-IR (Cross-lingual) dataset, where the query is in the Indo-European language and the passage is in English.