MTEB logo MTEB
retrieval image text

XM3600T2IRetrieval

Cite this task

@inproceedings{thapliyal2022crossmodal,
  author = {Thapliyal, Ashish V and Tuset, Jordi Pont and Chen, Xi and Soricut, Radu},
  booktitle = {Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing},
  pages = {715--729},
  title = {Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Dataset},
  year = {2022},
}

Retrieve images based on multilingual descriptions.

Domains: EncyclopaedicWritten
Languages: ArabicBengaliCzechDanishGermanModern Greek (1453-)EnglishPersianFilipinoFinnishFrenchHebrewHindiCroatianHungarianIndonesianItalianJapaneseKoreanMaoriDutchNorwegian NynorskNorwegian BokmålNorwegianPolishPortugueseCusco QuechuaRomanianRussianSpanishSwahili (macrolanguage)SwedishTeluguThaiTurkishUkrainianVietnameseChinese
Task type
Any2AnyMultilingualRetrieval
Main metric
ndcg_at_10
Source dataset
mteb/xm3600
License
cc-by-sa-4.0
Dates
2022-01-01 → 2022-12-31
Annotations
derived
Sample creation
found
Models scored …
Dataset preview mteb/xm3600 Open on HuggingFace →

Model scores

Loading…