Monsters at the gate

When softbots visit web search engines

Bernard Jansen, Amanda S. Spink, Jan Pedersen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

There has been little research investigating how Web agents search for information. We focused on three research questions: (i) How do agents interact with Web search engines? (2). What type of information are Web agents looking for and in what quantity?, and (3) What is the duration and frequency of Web agent interactions The queries examined for this study were submitted to Alta Vista on 8 September 2002, spanning a 24-hour period. Findings include: (1) when agents interact with Web search engines they use simpler queries than those submitted by human searchers, (2) Web agents are searching for a wide variety of information, with 60% of the terms used being unique, and (3) agent - Web search engine interaction is typically over several hours with multiple instances of interaction per second. Implications for Web agents and search engines are discussed.

Original languageEnglish
Title of host publicationProceedings of the International Conference on Internet Computing
EditorsP. Langendoerfer, O. Droegehorn
Pages620-626
Number of pages7
Volume2
Publication statusPublished - 2003
Externally publishedYes
EventProceedings of the International Conference on Internet Computing, IC'03 - Las Vegas, NV
Duration: 23 Jun 200326 Jun 2003

Other

OtherProceedings of the International Conference on Internet Computing, IC'03
CityLas Vegas, NV
Period23/6/0326/6/03

Fingerprint

Search engines
World Wide Web

Keywords

  • Agents
  • Softbots
  • Web searching

ASJC Scopus subject areas

  • Computer Networks and Communications

Cite this

Jansen, B., Spink, A. S., & Pedersen, J. (2003). Monsters at the gate: When softbots visit web search engines. In P. Langendoerfer, & O. Droegehorn (Eds.), Proceedings of the International Conference on Internet Computing (Vol. 2, pp. 620-626)

Monsters at the gate : When softbots visit web search engines. / Jansen, Bernard; Spink, Amanda S.; Pedersen, Jan.

Proceedings of the International Conference on Internet Computing. ed. / P. Langendoerfer; O. Droegehorn. Vol. 2 2003. p. 620-626.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Jansen, B, Spink, AS & Pedersen, J 2003, Monsters at the gate: When softbots visit web search engines. in P Langendoerfer & O Droegehorn (eds), Proceedings of the International Conference on Internet Computing. vol. 2, pp. 620-626, Proceedings of the International Conference on Internet Computing, IC'03, Las Vegas, NV, 23/6/03.
Jansen B, Spink AS, Pedersen J. Monsters at the gate: When softbots visit web search engines. In Langendoerfer P, Droegehorn O, editors, Proceedings of the International Conference on Internet Computing. Vol. 2. 2003. p. 620-626
Jansen, Bernard ; Spink, Amanda S. ; Pedersen, Jan. / Monsters at the gate : When softbots visit web search engines. Proceedings of the International Conference on Internet Computing. editor / P. Langendoerfer ; O. Droegehorn. Vol. 2 2003. pp. 620-626
@inproceedings{e07ef44ad8b94e798f766fd98530560a,
title = "Monsters at the gate: When softbots visit web search engines",
abstract = "There has been little research investigating how Web agents search for information. We focused on three research questions: (i) How do agents interact with Web search engines? (2). What type of information are Web agents looking for and in what quantity?, and (3) What is the duration and frequency of Web agent interactions The queries examined for this study were submitted to Alta Vista on 8 September 2002, spanning a 24-hour period. Findings include: (1) when agents interact with Web search engines they use simpler queries than those submitted by human searchers, (2) Web agents are searching for a wide variety of information, with 60{\%} of the terms used being unique, and (3) agent - Web search engine interaction is typically over several hours with multiple instances of interaction per second. Implications for Web agents and search engines are discussed.",
keywords = "Agents, Softbots, Web searching",
author = "Bernard Jansen and Spink, {Amanda S.} and Jan Pedersen",
year = "2003",
language = "English",
volume = "2",
pages = "620--626",
editor = "P. Langendoerfer and O. Droegehorn",
booktitle = "Proceedings of the International Conference on Internet Computing",

}

TY - GEN

T1 - Monsters at the gate

T2 - When softbots visit web search engines

AU - Jansen, Bernard

AU - Spink, Amanda S.

AU - Pedersen, Jan

PY - 2003

Y1 - 2003

N2 - There has been little research investigating how Web agents search for information. We focused on three research questions: (i) How do agents interact with Web search engines? (2). What type of information are Web agents looking for and in what quantity?, and (3) What is the duration and frequency of Web agent interactions The queries examined for this study were submitted to Alta Vista on 8 September 2002, spanning a 24-hour period. Findings include: (1) when agents interact with Web search engines they use simpler queries than those submitted by human searchers, (2) Web agents are searching for a wide variety of information, with 60% of the terms used being unique, and (3) agent - Web search engine interaction is typically over several hours with multiple instances of interaction per second. Implications for Web agents and search engines are discussed.

AB - There has been little research investigating how Web agents search for information. We focused on three research questions: (i) How do agents interact with Web search engines? (2). What type of information are Web agents looking for and in what quantity?, and (3) What is the duration and frequency of Web agent interactions The queries examined for this study were submitted to Alta Vista on 8 September 2002, spanning a 24-hour period. Findings include: (1) when agents interact with Web search engines they use simpler queries than those submitted by human searchers, (2) Web agents are searching for a wide variety of information, with 60% of the terms used being unique, and (3) agent - Web search engine interaction is typically over several hours with multiple instances of interaction per second. Implications for Web agents and search engines are discussed.

KW - Agents

KW - Softbots

KW - Web searching

UR - http://www.scopus.com/inward/record.url?scp=1842585862&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=1842585862&partnerID=8YFLogxK

M3 - Conference contribution

VL - 2

SP - 620

EP - 626

BT - Proceedings of the International Conference on Internet Computing

A2 - Langendoerfer, P.

A2 - Droegehorn, O.

ER -