Monsters at the gate: When softbots visit web search engines

Bernard Jansen, Amanda S. Spink, Jan Pedersen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

There has been little research investigating how Web agents search for information. We focused on three research questions: (i) How do agents interact with Web search engines? (2). What type of information are Web agents looking for and in what quantity?, and (3) What is the duration and frequency of Web agent interactions The queries examined for this study were submitted to Alta Vista on 8 September 2002, spanning a 24-hour period. Findings include: (1) when agents interact with Web search engines they use simpler queries than those submitted by human searchers, (2) Web agents are searching for a wide variety of information, with 60% of the terms used being unique, and (3) agent - Web search engine interaction is typically over several hours with multiple instances of interaction per second. Implications for Web agents and search engines are discussed.

Original languageEnglish
Title of host publicationProceedings of the International Conference on Internet Computing
EditorsP. Langendoerfer, O. Droegehorn
Pages620-626
Number of pages7
Volume2
Publication statusPublished - 2003
Externally publishedYes
EventProceedings of the International Conference on Internet Computing, IC'03 - Las Vegas, NV
Duration: 23 Jun 200326 Jun 2003

Other

OtherProceedings of the International Conference on Internet Computing, IC'03
CityLas Vegas, NV
Period23/6/0326/6/03

    Fingerprint

Keywords

  • Agents
  • Softbots
  • Web searching

ASJC Scopus subject areas

  • Computer Networks and Communications

Cite this

Jansen, B., Spink, A. S., & Pedersen, J. (2003). Monsters at the gate: When softbots visit web search engines. In P. Langendoerfer, & O. Droegehorn (Eds.), Proceedings of the International Conference on Internet Computing (Vol. 2, pp. 620-626)