The Web Retrieval Task and its evaluation in the Third NTCIR Workshop

Koji Eguchi, Keizo Oyama, Emi Ishida, Kazuko Kuriyama, Noriko Kando

Research output: Contribution to journalConference article

6 Citations (Scopus)

Abstract

This paper gives an overview of the evaluation method used for the Web Retrieval Task in the Third NTCIR Workshop, which is currently in progress. In the Web Retrieval Task, we try to assess the retrieval effectiveness of each Web search engine system using a common data set, and attempt to build a re-usable test collection suitable for evaluating Web search engine systems. With these objectives, we have built 100-gigabyte and 10-gigabyte document sets, mainly gathered from the 'jp' domain. Relevance judgment is performed on the retrieved documents, which are written in Japanese or English.

Original languageEnglish
Pages (from-to)375-376
Number of pages2
JournalSIGIR Forum (ACM Special Interest Group on Information Retrieval)
Publication statusPublished - Dec 1 2002
Externally publishedYes
EventProceedings of the Twenty-Fifth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval - Tampere, Finland
Duration: Aug 11 2002Aug 15 2002

Fingerprint

Search engines
Evaluation
World Wide Web
Search engine
Web search

All Science Journal Classification (ASJC) codes

  • Management Information Systems
  • Hardware and Architecture

Cite this

The Web Retrieval Task and its evaluation in the Third NTCIR Workshop. / Eguchi, Koji; Oyama, Keizo; Ishida, Emi; Kuriyama, Kazuko; Kando, Noriko.

In: SIGIR Forum (ACM Special Interest Group on Information Retrieval), 01.12.2002, p. 375-376.

Research output: Contribution to journalConference article

@article{45de0526d47241db8dbe0f56d0128f0e,
title = "The Web Retrieval Task and its evaluation in the Third NTCIR Workshop",
abstract = "This paper gives an overview of the evaluation method used for the Web Retrieval Task in the Third NTCIR Workshop, which is currently in progress. In the Web Retrieval Task, we try to assess the retrieval effectiveness of each Web search engine system using a common data set, and attempt to build a re-usable test collection suitable for evaluating Web search engine systems. With these objectives, we have built 100-gigabyte and 10-gigabyte document sets, mainly gathered from the 'jp' domain. Relevance judgment is performed on the retrieved documents, which are written in Japanese or English.",
author = "Koji Eguchi and Keizo Oyama and Emi Ishida and Kazuko Kuriyama and Noriko Kando",
year = "2002",
month = "12",
day = "1",
language = "English",
pages = "375--376",
journal = "SIGIR Forum (ACM Special Interest Group on Information Retrieval)",
issn = "0163-5840",
publisher = "Association for Computing Machinery (ACM)",

}

TY - JOUR

T1 - The Web Retrieval Task and its evaluation in the Third NTCIR Workshop

AU - Eguchi, Koji

AU - Oyama, Keizo

AU - Ishida, Emi

AU - Kuriyama, Kazuko

AU - Kando, Noriko

PY - 2002/12/1

Y1 - 2002/12/1

N2 - This paper gives an overview of the evaluation method used for the Web Retrieval Task in the Third NTCIR Workshop, which is currently in progress. In the Web Retrieval Task, we try to assess the retrieval effectiveness of each Web search engine system using a common data set, and attempt to build a re-usable test collection suitable for evaluating Web search engine systems. With these objectives, we have built 100-gigabyte and 10-gigabyte document sets, mainly gathered from the 'jp' domain. Relevance judgment is performed on the retrieved documents, which are written in Japanese or English.

AB - This paper gives an overview of the evaluation method used for the Web Retrieval Task in the Third NTCIR Workshop, which is currently in progress. In the Web Retrieval Task, we try to assess the retrieval effectiveness of each Web search engine system using a common data set, and attempt to build a re-usable test collection suitable for evaluating Web search engine systems. With these objectives, we have built 100-gigabyte and 10-gigabyte document sets, mainly gathered from the 'jp' domain. Relevance judgment is performed on the retrieved documents, which are written in Japanese or English.

UR - http://www.scopus.com/inward/record.url?scp=0036992516&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0036992516&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:0036992516

SP - 375

EP - 376

JO - SIGIR Forum (ACM Special Interest Group on Information Retrieval)

JF - SIGIR Forum (ACM Special Interest Group on Information Retrieval)

SN - 0163-5840

ER -