Overlap among major Web search engines

Amanda Spink, Bernard Jansen, Chris Blakely, Sherry Koshman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Citations (Scopus)

Abstract

Our study examined the overlap among results retrieved by three major Web search engines for a large set of more than 10,316 queries. Previous smaller studies have discussed the lack of overlap in results returned by Web search engines for the same queries. Our large-scale study measured the overlap of first page results (both non-sponsored and sponsored) across three major Web search engines - Google, Ask Jeeves and Yahoo - using a large number of randomly selected Dogpile.com queries submitted within a 24 hour - 36 hour period. We then compared the results to results retrieved for the same queries from the meta-search engine Dogpile.com. The percent of total results unique to only one of the three major Web search engines was 85%. 12% of total search results were found on two of the three Web search engines, and 3% of results were found across all three Web search engines. This small level of overlap reflects major differences in Web search engines retrieval and ranking results. Results point to the value of meta-search engines in Web retrieval to overcome the biases of individual search engines.

Original languageEnglish
Title of host publicationProceedings - Third International Conference onInformation Technology: New Generations, ITNG 2006
Pages370-374
Number of pages5
Volume2006
DOIs
Publication statusPublished - 2006
Externally publishedYes
EventThird International Conference on Information Technology: New Generations, ITNG 2006 - Las Vegas, NV
Duration: 10 Apr 200612 Apr 2006

Other

OtherThird International Conference on Information Technology: New Generations, ITNG 2006
CityLas Vegas, NV
Period10/4/0612/4/06

Fingerprint

Search engines
World Wide Web

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Spink, A., Jansen, B., Blakely, C., & Koshman, S. (2006). Overlap among major Web search engines. In Proceedings - Third International Conference onInformation Technology: New Generations, ITNG 2006 (Vol. 2006, pp. 370-374). [1611621] https://doi.org/10.1109/ITNG.2006.117

Overlap among major Web search engines. / Spink, Amanda; Jansen, Bernard; Blakely, Chris; Koshman, Sherry.

Proceedings - Third International Conference onInformation Technology: New Generations, ITNG 2006. Vol. 2006 2006. p. 370-374 1611621.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Spink, A, Jansen, B, Blakely, C & Koshman, S 2006, Overlap among major Web search engines. in Proceedings - Third International Conference onInformation Technology: New Generations, ITNG 2006. vol. 2006, 1611621, pp. 370-374, Third International Conference on Information Technology: New Generations, ITNG 2006, Las Vegas, NV, 10/4/06. https://doi.org/10.1109/ITNG.2006.117
Spink A, Jansen B, Blakely C, Koshman S. Overlap among major Web search engines. In Proceedings - Third International Conference onInformation Technology: New Generations, ITNG 2006. Vol. 2006. 2006. p. 370-374. 1611621 https://doi.org/10.1109/ITNG.2006.117
Spink, Amanda ; Jansen, Bernard ; Blakely, Chris ; Koshman, Sherry. / Overlap among major Web search engines. Proceedings - Third International Conference onInformation Technology: New Generations, ITNG 2006. Vol. 2006 2006. pp. 370-374
@inproceedings{6e23fbd1749d4dfea918308423e9304b,
title = "Overlap among major Web search engines",
abstract = "Our study examined the overlap among results retrieved by three major Web search engines for a large set of more than 10,316 queries. Previous smaller studies have discussed the lack of overlap in results returned by Web search engines for the same queries. Our large-scale study measured the overlap of first page results (both non-sponsored and sponsored) across three major Web search engines - Google, Ask Jeeves and Yahoo - using a large number of randomly selected Dogpile.com queries submitted within a 24 hour - 36 hour period. We then compared the results to results retrieved for the same queries from the meta-search engine Dogpile.com. The percent of total results unique to only one of the three major Web search engines was 85{\%}. 12{\%} of total search results were found on two of the three Web search engines, and 3{\%} of results were found across all three Web search engines. This small level of overlap reflects major differences in Web search engines retrieval and ranking results. Results point to the value of meta-search engines in Web retrieval to overcome the biases of individual search engines.",
author = "Amanda Spink and Bernard Jansen and Chris Blakely and Sherry Koshman",
year = "2006",
doi = "10.1109/ITNG.2006.117",
language = "English",
isbn = "0769524974",
volume = "2006",
pages = "370--374",
booktitle = "Proceedings - Third International Conference onInformation Technology: New Generations, ITNG 2006",

}

TY - GEN

T1 - Overlap among major Web search engines

AU - Spink, Amanda

AU - Jansen, Bernard

AU - Blakely, Chris

AU - Koshman, Sherry

PY - 2006

Y1 - 2006

N2 - Our study examined the overlap among results retrieved by three major Web search engines for a large set of more than 10,316 queries. Previous smaller studies have discussed the lack of overlap in results returned by Web search engines for the same queries. Our large-scale study measured the overlap of first page results (both non-sponsored and sponsored) across three major Web search engines - Google, Ask Jeeves and Yahoo - using a large number of randomly selected Dogpile.com queries submitted within a 24 hour - 36 hour period. We then compared the results to results retrieved for the same queries from the meta-search engine Dogpile.com. The percent of total results unique to only one of the three major Web search engines was 85%. 12% of total search results were found on two of the three Web search engines, and 3% of results were found across all three Web search engines. This small level of overlap reflects major differences in Web search engines retrieval and ranking results. Results point to the value of meta-search engines in Web retrieval to overcome the biases of individual search engines.

AB - Our study examined the overlap among results retrieved by three major Web search engines for a large set of more than 10,316 queries. Previous smaller studies have discussed the lack of overlap in results returned by Web search engines for the same queries. Our large-scale study measured the overlap of first page results (both non-sponsored and sponsored) across three major Web search engines - Google, Ask Jeeves and Yahoo - using a large number of randomly selected Dogpile.com queries submitted within a 24 hour - 36 hour period. We then compared the results to results retrieved for the same queries from the meta-search engine Dogpile.com. The percent of total results unique to only one of the three major Web search engines was 85%. 12% of total search results were found on two of the three Web search engines, and 3% of results were found across all three Web search engines. This small level of overlap reflects major differences in Web search engines retrieval and ranking results. Results point to the value of meta-search engines in Web retrieval to overcome the biases of individual search engines.

UR - http://www.scopus.com/inward/record.url?scp=33750820386&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33750820386&partnerID=8YFLogxK

U2 - 10.1109/ITNG.2006.117

DO - 10.1109/ITNG.2006.117

M3 - Conference contribution

AN - SCOPUS:33750820386

SN - 0769524974

SN - 9780769524979

VL - 2006

SP - 370

EP - 374

BT - Proceedings - Third International Conference onInformation Technology: New Generations, ITNG 2006

ER -