An analysis of searchers' perceptions of sponsored and non-sponsored links using nested design

Zhang Ying, Bernard Jansen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper examines the effects of sponsored links' reputation. We pursued this study through a mature design of experiment method - the nested design - in order to investigate this fast growing segment of online advertising. In this study, we firstly analyze the adaptability of the nested design to find out whether the reputation of sponsored links will bias searchers. We then carefully contrived a user study to investigate this phenomenon. We used 56 participants engaged in six ecommerce Web searching tasks. The tasks were extracted from the transaction log of a Web search engine so that they could represent actual ecommerce searching information needs. We controlled the study by switching non-sponsored and sponsored links on half of the tasks for each participant. By doing this, we could use the nested design statistical method to detect the impact of the sponsored links' reputation on the final evaluations of these results. During the study, we collected 2,435 interactions with links from search engine results page and 961 utterance evaluations of these links. The results indicate that the reputation or the location of the sponsored links will show strong significance on the final evaluation of the search engine performance. We give some perspectives and discussion which could benefit search engine providers to improve their services.

Original languageEnglish
Title of host publicationProceedings of the ASIST Annual Meeting
Volume44
Publication statusPublished - 2007
Externally publishedYes
Event3rd Electronic edition of the Annual Meeting of the American Society for Information Science and Technology - Milwaukee, WI
Duration: 19 Oct 200724 Oct 2007

Other

Other3rd Electronic edition of the Annual Meeting of the American Society for Information Science and Technology
CityMilwaukee, WI
Period19/10/0724/10/07

Fingerprint

Search engines
search engine
reputation
evaluation
statistical method
Design of experiments
transaction
Marketing
Statistical methods
experiment
trend
interaction
performance

ASJC Scopus subject areas

  • Information Systems
  • Library and Information Sciences

Cite this

An analysis of searchers' perceptions of sponsored and non-sponsored links using nested design. / Ying, Zhang; Jansen, Bernard.

Proceedings of the ASIST Annual Meeting. Vol. 44 2007.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ying, Z & Jansen, B 2007, An analysis of searchers' perceptions of sponsored and non-sponsored links using nested design. in Proceedings of the ASIST Annual Meeting. vol. 44, 3rd Electronic edition of the Annual Meeting of the American Society for Information Science and Technology, Milwaukee, WI, 19/10/07.
@inproceedings{44878748f6814be7b4c1eaf7fe10c5db,
title = "An analysis of searchers' perceptions of sponsored and non-sponsored links using nested design",
abstract = "This paper examines the effects of sponsored links' reputation. We pursued this study through a mature design of experiment method - the nested design - in order to investigate this fast growing segment of online advertising. In this study, we firstly analyze the adaptability of the nested design to find out whether the reputation of sponsored links will bias searchers. We then carefully contrived a user study to investigate this phenomenon. We used 56 participants engaged in six ecommerce Web searching tasks. The tasks were extracted from the transaction log of a Web search engine so that they could represent actual ecommerce searching information needs. We controlled the study by switching non-sponsored and sponsored links on half of the tasks for each participant. By doing this, we could use the nested design statistical method to detect the impact of the sponsored links' reputation on the final evaluations of these results. During the study, we collected 2,435 interactions with links from search engine results page and 961 utterance evaluations of these links. The results indicate that the reputation or the location of the sponsored links will show strong significance on the final evaluation of the search engine performance. We give some perspectives and discussion which could benefit search engine providers to improve their services.",
author = "Zhang Ying and Bernard Jansen",
year = "2007",
language = "English",
isbn = "0877155399",
volume = "44",
booktitle = "Proceedings of the ASIST Annual Meeting",

}

TY - GEN

T1 - An analysis of searchers' perceptions of sponsored and non-sponsored links using nested design

AU - Ying, Zhang

AU - Jansen, Bernard

PY - 2007

Y1 - 2007

N2 - This paper examines the effects of sponsored links' reputation. We pursued this study through a mature design of experiment method - the nested design - in order to investigate this fast growing segment of online advertising. In this study, we firstly analyze the adaptability of the nested design to find out whether the reputation of sponsored links will bias searchers. We then carefully contrived a user study to investigate this phenomenon. We used 56 participants engaged in six ecommerce Web searching tasks. The tasks were extracted from the transaction log of a Web search engine so that they could represent actual ecommerce searching information needs. We controlled the study by switching non-sponsored and sponsored links on half of the tasks for each participant. By doing this, we could use the nested design statistical method to detect the impact of the sponsored links' reputation on the final evaluations of these results. During the study, we collected 2,435 interactions with links from search engine results page and 961 utterance evaluations of these links. The results indicate that the reputation or the location of the sponsored links will show strong significance on the final evaluation of the search engine performance. We give some perspectives and discussion which could benefit search engine providers to improve their services.

AB - This paper examines the effects of sponsored links' reputation. We pursued this study through a mature design of experiment method - the nested design - in order to investigate this fast growing segment of online advertising. In this study, we firstly analyze the adaptability of the nested design to find out whether the reputation of sponsored links will bias searchers. We then carefully contrived a user study to investigate this phenomenon. We used 56 participants engaged in six ecommerce Web searching tasks. The tasks were extracted from the transaction log of a Web search engine so that they could represent actual ecommerce searching information needs. We controlled the study by switching non-sponsored and sponsored links on half of the tasks for each participant. By doing this, we could use the nested design statistical method to detect the impact of the sponsored links' reputation on the final evaluations of these results. During the study, we collected 2,435 interactions with links from search engine results page and 961 utterance evaluations of these links. The results indicate that the reputation or the location of the sponsored links will show strong significance on the final evaluation of the search engine performance. We give some perspectives and discussion which could benefit search engine providers to improve their services.

UR - http://www.scopus.com/inward/record.url?scp=47349096614&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=47349096614&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:47349096614

SN - 0877155399

SN - 9780877155393

VL - 44

BT - Proceedings of the ASIST Annual Meeting

ER -