MTEB logo MTEB
retrieval text

CodeSearchNetRetrieval

Cite this task

@article{husain2019codesearchnet,
  author = {Husain, Hamel and Wu, Ho-Hsiang and Gazit, Tiferet and Allamanis, Miltiadis and Brockschmidt, Marc},
  journal = {arXiv preprint arXiv:1909.09436},
  title = {{CodeSearchNet} challenge: Evaluating the state of semantic code search},
  year = {2019},
}

The dataset is a collection of code snippets and their corresponding natural language queries. The task is to retrieve the most relevant code snippet for a given query.

Domains: ProgrammingWritten
Languages: gojavajavascriptphppythonruby
Task type
Retrieval
Main metric
ndcg_at_10
License
mit
Dates
2019-01-01 → 2019-12-31
Annotations
derived
Sample creation
found
Models scored …
Dataset preview mteb/CodeSearchNetRetrieval Open on HuggingFace →

Model scores

Loading…