The Web Retrieval Task and its evaluation in the Third NTCIR Workshop

Koji Eguchi, Keizo Oyama, Emi Ishita, Kazuko Kuriyama, Noriko Kando

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

This paper gives an overview of the evaluation method used for the Web Retrieval Task in the Third NTCIR Workshop, which is currently in progress. In the Web Retrieval Task, we try to assess the retrieval effectiveness of each Web search engine system using a common data set, and attempt to build a re-usable test collection suitable for evaluating Web search engine systems. With these objectives, we have built 100-gigabyte and 10-gigabyte document sets, mainly gathered from the 'jp' domain. Relevance judgment is performed on the retrieved documents, which are written in Japanese or English.

Original languageEnglish
Pages (from-to)375-376
Number of pages2
JournalSIGIR Forum (ACM Special Interest Group on Information Retrieval)
Publication statusPublished - 2002
Externally publishedYes

Fingerprint

Search engines
Evaluation
World Wide Web
Search engine
Web search

All Science Journal Classification (ASJC) codes

  • Management Information Systems
  • Hardware and Architecture

Cite this

The Web Retrieval Task and its evaluation in the Third NTCIR Workshop. / Eguchi, Koji; Oyama, Keizo; Ishita, Emi; Kuriyama, Kazuko; Kando, Noriko.

In: SIGIR Forum (ACM Special Interest Group on Information Retrieval), 2002, p. 375-376.

Research output: Contribution to journalArticle

@article{45de0526d47241db8dbe0f56d0128f0e,
title = "The Web Retrieval Task and its evaluation in the Third NTCIR Workshop",
abstract = "This paper gives an overview of the evaluation method used for the Web Retrieval Task in the Third NTCIR Workshop, which is currently in progress. In the Web Retrieval Task, we try to assess the retrieval effectiveness of each Web search engine system using a common data set, and attempt to build a re-usable test collection suitable for evaluating Web search engine systems. With these objectives, we have built 100-gigabyte and 10-gigabyte document sets, mainly gathered from the 'jp' domain. Relevance judgment is performed on the retrieved documents, which are written in Japanese or English.",
author = "Koji Eguchi and Keizo Oyama and Emi Ishita and Kazuko Kuriyama and Noriko Kando",
year = "2002",
language = "English",
pages = "375--376",
journal = "SIGIR Forum (ACM Special Interest Group on Information Retrieval)",
issn = "0163-5840",
publisher = "Association for Computing Machinery (ACM)",

}

TY - JOUR

T1 - The Web Retrieval Task and its evaluation in the Third NTCIR Workshop

AU - Eguchi, Koji

AU - Oyama, Keizo

AU - Ishita, Emi

AU - Kuriyama, Kazuko

AU - Kando, Noriko

PY - 2002

Y1 - 2002

N2 - This paper gives an overview of the evaluation method used for the Web Retrieval Task in the Third NTCIR Workshop, which is currently in progress. In the Web Retrieval Task, we try to assess the retrieval effectiveness of each Web search engine system using a common data set, and attempt to build a re-usable test collection suitable for evaluating Web search engine systems. With these objectives, we have built 100-gigabyte and 10-gigabyte document sets, mainly gathered from the 'jp' domain. Relevance judgment is performed on the retrieved documents, which are written in Japanese or English.

AB - This paper gives an overview of the evaluation method used for the Web Retrieval Task in the Third NTCIR Workshop, which is currently in progress. In the Web Retrieval Task, we try to assess the retrieval effectiveness of each Web search engine system using a common data set, and attempt to build a re-usable test collection suitable for evaluating Web search engine systems. With these objectives, we have built 100-gigabyte and 10-gigabyte document sets, mainly gathered from the 'jp' domain. Relevance judgment is performed on the retrieved documents, which are written in Japanese or English.

UR - http://www.scopus.com/inward/record.url?scp=0036992516&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0036992516&partnerID=8YFLogxK

M3 - Article

SP - 375

EP - 376

JO - SIGIR Forum (ACM Special Interest Group on Information Retrieval)

JF - SIGIR Forum (ACM Special Interest Group on Information Retrieval)

SN - 0163-5840

ER -