TY - JOUR
T1 - Evaluation Methods for Web Retrieval Tasks Considering Hyperlink Structure
AU - Eguchi, Koji
AU - Oyama, Keizo
AU - Ishida, Emi
AU - Kando, Noriko
AU - Kuriyama, Kazuko
PY - 2003/9
Y1 - 2003/9
N2 - This paper proposes the evaluation methods for measuring retrieval effectiveness of Web search engine systems, attempting to make them suitable for real Web environment. With this objective, we constructed 100-gigabyte and 10-gigabyte document sets that were mainly gathered from the '.jp' domain, and conducted an evaluation workshop at the third NTCIR Workshop from 2001 to 2002, where we assessed the retrieval effectiveness of a certain number of Web search engine systems using the common data set. Conventional evaluation workshops assessed the relevance of the retrieved documents, which were submitted by the workshop participants, by considering the contents of individual pages. On the other hand, we assessed the relevance of the retrieved pages by considering the relationship between the pages referenced by hyperlinks.
AB - This paper proposes the evaluation methods for measuring retrieval effectiveness of Web search engine systems, attempting to make them suitable for real Web environment. With this objective, we constructed 100-gigabyte and 10-gigabyte document sets that were mainly gathered from the '.jp' domain, and conducted an evaluation workshop at the third NTCIR Workshop from 2001 to 2002, where we assessed the retrieval effectiveness of a certain number of Web search engine systems using the common data set. Conventional evaluation workshops assessed the relevance of the retrieved documents, which were submitted by the workshop participants, by considering the contents of individual pages. On the other hand, we assessed the relevance of the retrieved pages by considering the relationship between the pages referenced by hyperlinks.
UR - http://www.scopus.com/inward/record.url?scp=1642352671&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=1642352671&partnerID=8YFLogxK
M3 - Article
AN - SCOPUS:1642352671
VL - E86-D
SP - 1804
EP - 1813
JO - IEICE Transactions on Information and Systems
JF - IEICE Transactions on Information and Systems
SN - 0916-8532
IS - 9
ER -