Web searching agents, What are they doing out there?

Bernard Jansen, Amanda S. Spink, Jan Pedersen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

The Web has become a worldwide repository of information, which individuals, companies, and organizations utilize to solve or address various information problems. Many of these Web users utilize automated agents to gather this information for them. It is assumed that this approach represents a more sophisticated method of searching. However, there is little research investigating how Web agents search for online information. In this research, we examine how agents search for information on Web search engines, including the session, query, term, duration and frequency' of interactions. For this study, we analyzed queries that 2,717 agents submitted to the Aha Vista search engine on 8 September 2002. Findings include: (1) agents interacting with Web search engines use queries comparable to human searchers, (2) Web agents are searching for a relatively limited variety of information, with only 18% of the terms used being unique, and (3) agent - Web search engine interaction typically spans several hours with multiple instances of interaction per second.

Original languageEnglish
Title of host publicationProceedings of the IEEE International Conference on Systems, Man and Cybernetics
Pages1410-1416
Number of pages7
Volume2
Publication statusPublished - 2003
Externally publishedYes
EventSystem Security and Assurance - Washington, DC, United States
Duration: 5 Oct 20038 Oct 2003

Other

OtherSystem Security and Assurance
CountryUnited States
CityWashington, DC
Period5/10/038/10/03

    Fingerprint

Keywords

  • Automated web searching
  • Information retrieval agents
  • Softbots

ASJC Scopus subject areas

  • Hardware and Architecture
  • Control and Systems Engineering

Cite this

Jansen, B., Spink, A. S., & Pedersen, J. (2003). Web searching agents, What are they doing out there? In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (Vol. 2, pp. 1410-1416)