Evaluating Ad-Hoc Object Retrieval
Published: 2010 November
Buchtitel: Proceedings of the International Workshop on Evaluation of Semantic Technologies (IWEST 2010)
Verlag: 9th International Semantic Web Conference (ISWC2010)
Erscheinungsort: Shanghai, PR China
In contrast to traditional search, semantic search aims at the retrieval of information from factual assertions about real-world objects rather than searching over web-pages with textual descriptions. One of the key tasks to address in this context is ad-hoc object retrieval, i.e. the retrieval of objects in response to user formulated keyword queries. Despite the significant commercial interest, this kind of semantic search has not been evaluated in a thorough and systematic manner. In this work, we discuss the first evaluation campaign that specifically targets the task of ad-hoc object retrieval. We also discuss the submitted systems, the factors that contributed to positive results and the potential for future improvements in semantic search.