EPrints@IIT Delhi >
Faculty Research Publicatons  >
Electrical Engineering >

Please use this identifier to cite or link to this item: http://eprint.iitd.ac.in/handle/2074/1383

Title: A subjective measure of web search quality
Authors: Beg, M M Sufyan
Keywords: World Wide Web
Search engines
Performance evaluation
User feedback
Biased meta-search
Issue Date: 2005
Citation: Information Sciences, 169(3-4), 365-381
Abstract: In an Internet search, the user uses a query language to describe the nature of documents, and, in response, a search engine locates the documents that “best match” the description. A number of search engines are available to Internet users today and more are likely to appear in the future. These systems differ from one another in the indexing technique they use to construct the repository of documents and the search algorithm they employ to generate the response. As a result, the results for the same query from different search engines vary considerably. In this work, our aim is to outline a procedure for assessing the quality of search results obtained through several popular search engines. This procedure would enable us to compare the performance of the popular search engines like AltaVista, DirectHit, Excite, Google, HotBot, Lycos and Yahoo, etc. We measure the “satisfaction” a user gets when presented with the search results. We watch the actions of the user on the search results presented before him in response to his query, and infer the feedback of the user therefrom. The implicit ranking thus provided by the user is compared with the original ranking given by the search engine. The correlation coefficient thus obtained is averaged for a set of queries. We show our results pertaining to 7 public search engines and 15 ad hoc queries. Our emphasis is more to demonstrate the procedure of quality measurement than to carry out the actual performance measurement of these search engines.
URI: http://eprint.iitd.ac.in/dspace/handle/2074/1383
Appears in Collections:Electrical Engineering

Files in This Item:

File Description SizeFormat
begsub2005.pdf513.46 kBAdobe PDFView/Open
View Statistics

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.


Valid XHTML 1.0! DSpace Software Copyright © 2002-2010  Duraspace - Feedback