Web searching agents, What are they doing out there?

Bernard Jansen, Amanda S. Spink, Jan Pedersen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

The Web has become a worldwide repository of information, which individuals, companies, and organizations utilize to solve or address various information problems. Many of these Web users utilize automated agents to gather this information for them. It is assumed that this approach represents a more sophisticated method of searching. However, there is little research investigating how Web agents search for online information. In this research, we examine how agents search for information on Web search engines, including the session, query, term, duration and frequency' of interactions. For this study, we analyzed queries that 2,717 agents submitted to the Aha Vista search engine on 8 September 2002. Findings include: (1) agents interacting with Web search engines use queries comparable to human searchers, (2) Web agents are searching for a relatively limited variety of information, with only 18% of the terms used being unique, and (3) agent - Web search engine interaction typically spans several hours with multiple instances of interaction per second.

Original languageEnglish
Title of host publicationProceedings of the IEEE International Conference on Systems, Man and Cybernetics
Pages1410-1416
Number of pages7
Volume2
Publication statusPublished - 2003
Externally publishedYes
EventSystem Security and Assurance - Washington, DC, United States
Duration: 5 Oct 20038 Oct 2003

Other

OtherSystem Security and Assurance
CountryUnited States
CityWashington, DC
Period5/10/038/10/03

Fingerprint

Search engines
Industry

Keywords

  • Automated web searching
  • Information retrieval agents
  • Softbots

ASJC Scopus subject areas

  • Hardware and Architecture
  • Control and Systems Engineering

Cite this

Jansen, B., Spink, A. S., & Pedersen, J. (2003). Web searching agents, What are they doing out there? In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (Vol. 2, pp. 1410-1416)

Web searching agents, What are they doing out there? / Jansen, Bernard; Spink, Amanda S.; Pedersen, Jan.

Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. Vol. 2 2003. p. 1410-1416.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Jansen, B, Spink, AS & Pedersen, J 2003, Web searching agents, What are they doing out there? in Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. vol. 2, pp. 1410-1416, System Security and Assurance, Washington, DC, United States, 5/10/03.
Jansen B, Spink AS, Pedersen J. Web searching agents, What are they doing out there? In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. Vol. 2. 2003. p. 1410-1416
Jansen, Bernard ; Spink, Amanda S. ; Pedersen, Jan. / Web searching agents, What are they doing out there?. Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. Vol. 2 2003. pp. 1410-1416
@inproceedings{8578d46389b74befa8299107972e314b,
title = "Web searching agents, What are they doing out there?",
abstract = "The Web has become a worldwide repository of information, which individuals, companies, and organizations utilize to solve or address various information problems. Many of these Web users utilize automated agents to gather this information for them. It is assumed that this approach represents a more sophisticated method of searching. However, there is little research investigating how Web agents search for online information. In this research, we examine how agents search for information on Web search engines, including the session, query, term, duration and frequency' of interactions. For this study, we analyzed queries that 2,717 agents submitted to the Aha Vista search engine on 8 September 2002. Findings include: (1) agents interacting with Web search engines use queries comparable to human searchers, (2) Web agents are searching for a relatively limited variety of information, with only 18{\%} of the terms used being unique, and (3) agent - Web search engine interaction typically spans several hours with multiple instances of interaction per second.",
keywords = "Automated web searching, Information retrieval agents, Softbots",
author = "Bernard Jansen and Spink, {Amanda S.} and Jan Pedersen",
year = "2003",
language = "English",
volume = "2",
pages = "1410--1416",
booktitle = "Proceedings of the IEEE International Conference on Systems, Man and Cybernetics",

}

TY - GEN

T1 - Web searching agents, What are they doing out there?

AU - Jansen, Bernard

AU - Spink, Amanda S.

AU - Pedersen, Jan

PY - 2003

Y1 - 2003

N2 - The Web has become a worldwide repository of information, which individuals, companies, and organizations utilize to solve or address various information problems. Many of these Web users utilize automated agents to gather this information for them. It is assumed that this approach represents a more sophisticated method of searching. However, there is little research investigating how Web agents search for online information. In this research, we examine how agents search for information on Web search engines, including the session, query, term, duration and frequency' of interactions. For this study, we analyzed queries that 2,717 agents submitted to the Aha Vista search engine on 8 September 2002. Findings include: (1) agents interacting with Web search engines use queries comparable to human searchers, (2) Web agents are searching for a relatively limited variety of information, with only 18% of the terms used being unique, and (3) agent - Web search engine interaction typically spans several hours with multiple instances of interaction per second.

AB - The Web has become a worldwide repository of information, which individuals, companies, and organizations utilize to solve or address various information problems. Many of these Web users utilize automated agents to gather this information for them. It is assumed that this approach represents a more sophisticated method of searching. However, there is little research investigating how Web agents search for online information. In this research, we examine how agents search for information on Web search engines, including the session, query, term, duration and frequency' of interactions. For this study, we analyzed queries that 2,717 agents submitted to the Aha Vista search engine on 8 September 2002. Findings include: (1) agents interacting with Web search engines use queries comparable to human searchers, (2) Web agents are searching for a relatively limited variety of information, with only 18% of the terms used being unique, and (3) agent - Web search engine interaction typically spans several hours with multiple instances of interaction per second.

KW - Automated web searching

KW - Information retrieval agents

KW - Softbots

UR - http://www.scopus.com/inward/record.url?scp=0242660407&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0242660407&partnerID=8YFLogxK

M3 - Conference contribution

VL - 2

SP - 1410

EP - 1416

BT - Proceedings of the IEEE International Conference on Systems, Man and Cybernetics

ER -