Overlap among major Web search engines

Amanda Spink, Bernard Jansen, Chris Blakely, Sherry Koshman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Citations (Scopus)

Abstract

Our study examined the overlap among results retrieved by three major Web search engines for a large set of more than 10,316 queries. Previous smaller studies have discussed the lack of overlap in results returned by Web search engines for the same queries. Our large-scale study measured the overlap of first page results (both non-sponsored and sponsored) across three major Web search engines - Google, Ask Jeeves and Yahoo - using a large number of randomly selected Dogpile.com queries submitted within a 24 hour - 36 hour period. We then compared the results to results retrieved for the same queries from the meta-search engine Dogpile.com. The percent of total results unique to only one of the three major Web search engines was 85%. 12% of total search results were found on two of the three Web search engines, and 3% of results were found across all three Web search engines. This small level of overlap reflects major differences in Web search engines retrieval and ranking results. Results point to the value of meta-search engines in Web retrieval to overcome the biases of individual search engines.

Original languageEnglish
Title of host publicationProceedings - Third International Conference onInformation Technology: New Generations, ITNG 2006
Pages370-374
Number of pages5
Volume2006
DOIs
Publication statusPublished - 2006
Externally publishedYes
EventThird International Conference on Information Technology: New Generations, ITNG 2006 - Las Vegas, NV
Duration: 10 Apr 200612 Apr 2006

Other

OtherThird International Conference on Information Technology: New Generations, ITNG 2006
CityLas Vegas, NV
Period10/4/0612/4/06

    Fingerprint

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Spink, A., Jansen, B., Blakely, C., & Koshman, S. (2006). Overlap among major Web search engines. In Proceedings - Third International Conference onInformation Technology: New Generations, ITNG 2006 (Vol. 2006, pp. 370-374). [1611621] https://doi.org/10.1109/ITNG.2006.117