Nandan Thakur

nthakur

AI & ML interests

NLP, IR, QA

Organizations

Posts 1

view post
Post
2914
🦢 The SWIM-IR dataset contains 29 million text-retrieval training pairs across 27 diverse languages. It is one of the largest synthetic multilingual datasets generated using PaLM 2 on Wikipedia! 🔥🔥

SWIM-IR dataset contains three subsets :
- Cross-lingual:nthakur/swim-ir-cross-lingual
- Monolingual: nthakur/swim-ir-monolingual
- Indic Cross-lingual: nthakur/indic-swim-ir-cross-lingual

Check it out:
nthakur/swim-ir-dataset-662ddaecfc20896bf14dd9b7