Overview of WebCLEF 2006

Krisztian Balog; Leif Azzopardi; Jaap Kamps; Maarten De Rijke

doi:10.1007/978-3-540-74999-8_101

Overview of WebCLEF 2006

Krisztian Balog, Leif Azzopardi, Jaap Kamps, Maarten De Rijke

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution book

4 Citations (Scopus)

Abstract

We report on the CLEF 2006 WebCLEF track devoted to cross lingual web retrieval. We provide details about the retrieval tasks, the used topic set, and the results of the participants. WebCLEF 2006 used a stream of know-item topics consisting of: (i) manual topics (including a selection of WebCLEF 2005 topics, and a set of new topics) and (ii) automatically generated topics (generated using two techniques). The results over all topics show that current CLIR systems are very effective, retrieving on average the target page in the top ranks. Manually constructed topics result in higher performance than and automatically generated ones. And finally, the resulting scores on automatic topics provide a reasonable ranking of the systems, showing that automatically generated topics are an attractive alternative in situations where manual topics are not readily available.

Original language	English
Title of host publication	Evaluation of Multilingual and Multi-modal Information Retrieval
Subtitle of host publication	7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, September 20-22, 2006, Revised Selected Papers
Editors	Carol Peters, Paul Clough, Frederic C. Gey, Jussi Karlgren, Bernardo Magnini, Douglas W. Oard, Maarten de Rijke, Mazimilian Stempfhuber
Place of Publication	Berlin, Heidelberg
Publisher	Springer-Verlag
Pages	803-819
Number of pages	17
ISBN (Print)	978-3-540-74998-1
DOIs	https://doi.org/10.1007/978-3-540-74999-8_101
Publication status	Published - 6 Sep 2007
Externally published	Yes

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer Verlag
Volume	4730

Keywords

WebCLEF
cross lingual web retrieval

Access to Document

10.1007/978-3-540-74999-8_101

Cite this

Balog, K., Azzopardi, L., Kamps, J., & De Rijke, M. (2007). Overview of WebCLEF 2006. In C. Peters, P. Clough, F. C. Gey, J. Karlgren, B. Magnini, D. W. Oard, M. de Rijke, & M. Stempfhuber (Eds.), Evaluation of Multilingual and Multi-modal Information Retrieval: 7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, September 20-22, 2006, Revised Selected Papers (pp. 803-819). (Lecture Notes in Computer Science; Vol. 4730). Springer-Verlag. https://doi.org/10.1007/978-3-540-74999-8_101

Balog, Krisztian ; Azzopardi, Leif ; Kamps, Jaap ; De Rijke, Maarten. / Overview of WebCLEF 2006. Evaluation of Multilingual and Multi-modal Information Retrieval: 7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, September 20-22, 2006, Revised Selected Papers. editor / Carol Peters ; Paul Clough ; Frederic C. Gey ; Jussi Karlgren ; Bernardo Magnini ; Douglas W. Oard ; Maarten de Rijke ; Mazimilian Stempfhuber. Berlin, Heidelberg : Springer-Verlag, 2007. pp. 803-819 (Lecture Notes in Computer Science).

@inproceedings{451ba5e1d5864c3abb87f12889853328,

title = "Overview of WebCLEF 2006",

abstract = "We report on the CLEF 2006 WebCLEF track devoted to cross lingual web retrieval. We provide details about the retrieval tasks, the used topic set, and the results of the participants. WebCLEF 2006 used a stream of know-item topics consisting of: (i) manual topics (including a selection of WebCLEF 2005 topics, and a set of new topics) and (ii) automatically generated topics (generated using two techniques). The results over all topics show that current CLIR systems are very effective, retrieving on average the target page in the top ranks. Manually constructed topics result in higher performance than and automatically generated ones. And finally, the resulting scores on automatic topics provide a reasonable ranking of the systems, showing that automatically generated topics are an attractive alternative in situations where manual topics are not readily available.",

keywords = "WebCLEF, cross lingual web retrieval",

author = "Krisztian Balog and Leif Azzopardi and Jaap Kamps and {De Rijke}, Maarten",

year = "2007",

month = sep,

day = "6",

doi = "10.1007/978-3-540-74999-8_101",

language = "English",

isbn = "978-3-540-74998-1",

series = "Lecture Notes in Computer Science",

publisher = "Springer-Verlag",

pages = "803--819",

editor = "Carol Peters and Paul Clough and Gey, {Frederic C.} and Jussi Karlgren and Bernardo Magnini and Oard, {Douglas W.} and {de Rijke}, {Maarten } and Mazimilian Stempfhuber",

booktitle = "Evaluation of Multilingual and Multi-modal Information Retrieval",

}

Balog, K, Azzopardi, L, Kamps, J & De Rijke, M 2007, Overview of WebCLEF 2006. in C Peters, P Clough, FC Gey, J Karlgren, B Magnini, DW Oard, M de Rijke & M Stempfhuber (eds), Evaluation of Multilingual and Multi-modal Information Retrieval: 7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, September 20-22, 2006, Revised Selected Papers. Lecture Notes in Computer Science, vol. 4730, Springer-Verlag, Berlin, Heidelberg, pp. 803-819. https://doi.org/10.1007/978-3-540-74999-8_101

Overview of WebCLEF 2006. / Balog, Krisztian; Azzopardi, Leif; Kamps, Jaap; De Rijke, Maarten.

Evaluation of Multilingual and Multi-modal Information Retrieval: 7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, September 20-22, 2006, Revised Selected Papers. ed. / Carol Peters; Paul Clough; Frederic C. Gey; Jussi Karlgren; Bernardo Magnini; Douglas W. Oard; Maarten de Rijke; Mazimilian Stempfhuber. Berlin, Heidelberg : Springer-Verlag, 2007. p. 803-819 (Lecture Notes in Computer Science; Vol. 4730).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution book

TY - GEN

T1 - Overview of WebCLEF 2006

AU - Balog, Krisztian

AU - Azzopardi, Leif

AU - Kamps, Jaap

AU - De Rijke, Maarten

PY - 2007/9/6

Y1 - 2007/9/6

N2 - We report on the CLEF 2006 WebCLEF track devoted to cross lingual web retrieval. We provide details about the retrieval tasks, the used topic set, and the results of the participants. WebCLEF 2006 used a stream of know-item topics consisting of: (i) manual topics (including a selection of WebCLEF 2005 topics, and a set of new topics) and (ii) automatically generated topics (generated using two techniques). The results over all topics show that current CLIR systems are very effective, retrieving on average the target page in the top ranks. Manually constructed topics result in higher performance than and automatically generated ones. And finally, the resulting scores on automatic topics provide a reasonable ranking of the systems, showing that automatically generated topics are an attractive alternative in situations where manual topics are not readily available.

AB - We report on the CLEF 2006 WebCLEF track devoted to cross lingual web retrieval. We provide details about the retrieval tasks, the used topic set, and the results of the participants. WebCLEF 2006 used a stream of know-item topics consisting of: (i) manual topics (including a selection of WebCLEF 2005 topics, and a set of new topics) and (ii) automatically generated topics (generated using two techniques). The results over all topics show that current CLIR systems are very effective, retrieving on average the target page in the top ranks. Manually constructed topics result in higher performance than and automatically generated ones. And finally, the resulting scores on automatic topics provide a reasonable ranking of the systems, showing that automatically generated topics are an attractive alternative in situations where manual topics are not readily available.

KW - WebCLEF

KW - cross lingual web retrieval

UR - http://dl.acm.org/citation.cfm?id=2393955.2394073

U2 - 10.1007/978-3-540-74999-8_101

DO - 10.1007/978-3-540-74999-8_101

M3 - Conference contribution book

SN - 978-3-540-74998-1

T3 - Lecture Notes in Computer Science

SP - 803

EP - 819

BT - Evaluation of Multilingual and Multi-modal Information Retrieval

A2 - Peters, Carol

A2 - Clough, Paul

A2 - Gey, Frederic C.

A2 - Karlgren, Jussi

A2 - Magnini, Bernardo

A2 - Oard, Douglas W.

A2 - de Rijke, Maarten

A2 - Stempfhuber, Mazimilian

PB - Springer-Verlag

CY - Berlin, Heidelberg

ER -

Balog K, Azzopardi L, Kamps J, De Rijke M. Overview of WebCLEF 2006. In Peters C, Clough P, Gey FC, Karlgren J, Magnini B, Oard DW, de Rijke M, Stempfhuber M, editors, Evaluation of Multilingual and Multi-modal Information Retrieval: 7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, September 20-22, 2006, Revised Selected Papers. Berlin, Heidelberg: Springer-Verlag. 2007. p. 803-819. (Lecture Notes in Computer Science). https://doi.org/10.1007/978-3-540-74999-8_101

Overview of WebCLEF 2006

Abstract

Publication series

Keywords

Access to Document

Other files and links

Cite this