Freshness-driven adaptive caching for dynamic content Web sites

Wen Syan Li, Oliver Po, Wang Pin Hsiung, K. Selçuk Candan, Divyakant Agrawal

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Both response time and content freshness are essential to e-commerce applications on the Web. One option to achieve good response time is to build a high performance Web site by deploying the state of art IT infrastructures with large network and server capacities. With such a system architecture, freshness of the content delivered is limited by the network latency since when users receive the contents, the contents may have changed at the server. With the wide availability of content delivery networks, many e-commerce Web applications utilize edge cache servers to cache and deliver dynamic contents at locations much closer to users, avoiding network latency. By caching a large number of dynamic content pages in the edge cache servers, response time can be reduced, benefiting from higher cache hit rates. However, this is achieved at the expense of higher invalidation cost. On the other hand, a higher invalidation cost leads to a longer invalidation cycle (time to perform invalidation check on the pages in caches) at the expense of freshness of cached dynamic content. In this paper, we propose a freshness-driven adaptive dynamic content caching technique, which monitors response time and invalidation cycle length and dynamically adjusts caching policies. We have implemented the proposed technique within NEC's CachePortal Web acceleration solution. We have conducted experiments to evaluate effectiveness of the proposed freshness-driven adaptive dynamic content caching technique. The experimental results show that the proposed technique consistently maintains the best content freshness to users. The experimental results also show that even a Web site with dynamic content caching enabled can further benefit from deployment of our solution with improvement of its content freshness up to 10 times especially during heavy user request traffic and long network latency delay.

Original languageEnglish
Pages (from-to)269-296
Number of pages28
JournalData and Knowledge Engineering
Volume47
Issue number2
DOIs
Publication statusPublished - 1 Nov 2003
Externally publishedYes

Fingerprint

Websites
Servers
Response time (computer systems)
Web site content
Costs
Availability
Experiments
Response time

Keywords

  • Dynamic content
  • Freshness
  • Network latency
  • Response time
  • Web acceleration

ASJC Scopus subject areas

  • Artificial Intelligence

Cite this

Li, W. S., Po, O., Hsiung, W. P., Selçuk Candan, K., & Agrawal, D. (2003). Freshness-driven adaptive caching for dynamic content Web sites. Data and Knowledge Engineering, 47(2), 269-296. https://doi.org/10.1016/S0169-023X(03)00093-4

Freshness-driven adaptive caching for dynamic content Web sites. / Li, Wen Syan; Po, Oliver; Hsiung, Wang Pin; Selçuk Candan, K.; Agrawal, Divyakant.

In: Data and Knowledge Engineering, Vol. 47, No. 2, 01.11.2003, p. 269-296.

Research output: Contribution to journalArticle

Li, WS, Po, O, Hsiung, WP, Selçuk Candan, K & Agrawal, D 2003, 'Freshness-driven adaptive caching for dynamic content Web sites', Data and Knowledge Engineering, vol. 47, no. 2, pp. 269-296. https://doi.org/10.1016/S0169-023X(03)00093-4
Li, Wen Syan ; Po, Oliver ; Hsiung, Wang Pin ; Selçuk Candan, K. ; Agrawal, Divyakant. / Freshness-driven adaptive caching for dynamic content Web sites. In: Data and Knowledge Engineering. 2003 ; Vol. 47, No. 2. pp. 269-296.
@article{f42de06010784f87b8418c17939a7645,
title = "Freshness-driven adaptive caching for dynamic content Web sites",
abstract = "Both response time and content freshness are essential to e-commerce applications on the Web. One option to achieve good response time is to build a high performance Web site by deploying the state of art IT infrastructures with large network and server capacities. With such a system architecture, freshness of the content delivered is limited by the network latency since when users receive the contents, the contents may have changed at the server. With the wide availability of content delivery networks, many e-commerce Web applications utilize edge cache servers to cache and deliver dynamic contents at locations much closer to users, avoiding network latency. By caching a large number of dynamic content pages in the edge cache servers, response time can be reduced, benefiting from higher cache hit rates. However, this is achieved at the expense of higher invalidation cost. On the other hand, a higher invalidation cost leads to a longer invalidation cycle (time to perform invalidation check on the pages in caches) at the expense of freshness of cached dynamic content. In this paper, we propose a freshness-driven adaptive dynamic content caching technique, which monitors response time and invalidation cycle length and dynamically adjusts caching policies. We have implemented the proposed technique within NEC's CachePortal Web acceleration solution. We have conducted experiments to evaluate effectiveness of the proposed freshness-driven adaptive dynamic content caching technique. The experimental results show that the proposed technique consistently maintains the best content freshness to users. The experimental results also show that even a Web site with dynamic content caching enabled can further benefit from deployment of our solution with improvement of its content freshness up to 10 times especially during heavy user request traffic and long network latency delay.",
keywords = "Dynamic content, Freshness, Network latency, Response time, Web acceleration",
author = "Li, {Wen Syan} and Oliver Po and Hsiung, {Wang Pin} and {Sel{\cc}uk Candan}, K. and Divyakant Agrawal",
year = "2003",
month = "11",
day = "1",
doi = "10.1016/S0169-023X(03)00093-4",
language = "English",
volume = "47",
pages = "269--296",
journal = "Data and Knowledge Engineering",
issn = "0169-023X",
publisher = "Elsevier",
number = "2",

}

TY - JOUR

T1 - Freshness-driven adaptive caching for dynamic content Web sites

AU - Li, Wen Syan

AU - Po, Oliver

AU - Hsiung, Wang Pin

AU - Selçuk Candan, K.

AU - Agrawal, Divyakant

PY - 2003/11/1

Y1 - 2003/11/1

N2 - Both response time and content freshness are essential to e-commerce applications on the Web. One option to achieve good response time is to build a high performance Web site by deploying the state of art IT infrastructures with large network and server capacities. With such a system architecture, freshness of the content delivered is limited by the network latency since when users receive the contents, the contents may have changed at the server. With the wide availability of content delivery networks, many e-commerce Web applications utilize edge cache servers to cache and deliver dynamic contents at locations much closer to users, avoiding network latency. By caching a large number of dynamic content pages in the edge cache servers, response time can be reduced, benefiting from higher cache hit rates. However, this is achieved at the expense of higher invalidation cost. On the other hand, a higher invalidation cost leads to a longer invalidation cycle (time to perform invalidation check on the pages in caches) at the expense of freshness of cached dynamic content. In this paper, we propose a freshness-driven adaptive dynamic content caching technique, which monitors response time and invalidation cycle length and dynamically adjusts caching policies. We have implemented the proposed technique within NEC's CachePortal Web acceleration solution. We have conducted experiments to evaluate effectiveness of the proposed freshness-driven adaptive dynamic content caching technique. The experimental results show that the proposed technique consistently maintains the best content freshness to users. The experimental results also show that even a Web site with dynamic content caching enabled can further benefit from deployment of our solution with improvement of its content freshness up to 10 times especially during heavy user request traffic and long network latency delay.

AB - Both response time and content freshness are essential to e-commerce applications on the Web. One option to achieve good response time is to build a high performance Web site by deploying the state of art IT infrastructures with large network and server capacities. With such a system architecture, freshness of the content delivered is limited by the network latency since when users receive the contents, the contents may have changed at the server. With the wide availability of content delivery networks, many e-commerce Web applications utilize edge cache servers to cache and deliver dynamic contents at locations much closer to users, avoiding network latency. By caching a large number of dynamic content pages in the edge cache servers, response time can be reduced, benefiting from higher cache hit rates. However, this is achieved at the expense of higher invalidation cost. On the other hand, a higher invalidation cost leads to a longer invalidation cycle (time to perform invalidation check on the pages in caches) at the expense of freshness of cached dynamic content. In this paper, we propose a freshness-driven adaptive dynamic content caching technique, which monitors response time and invalidation cycle length and dynamically adjusts caching policies. We have implemented the proposed technique within NEC's CachePortal Web acceleration solution. We have conducted experiments to evaluate effectiveness of the proposed freshness-driven adaptive dynamic content caching technique. The experimental results show that the proposed technique consistently maintains the best content freshness to users. The experimental results also show that even a Web site with dynamic content caching enabled can further benefit from deployment of our solution with improvement of its content freshness up to 10 times especially during heavy user request traffic and long network latency delay.

KW - Dynamic content

KW - Freshness

KW - Network latency

KW - Response time

KW - Web acceleration

UR - http://www.scopus.com/inward/record.url?scp=0141569572&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0141569572&partnerID=8YFLogxK

U2 - 10.1016/S0169-023X(03)00093-4

DO - 10.1016/S0169-023X(03)00093-4

M3 - Article

AN - SCOPUS:0141569572

VL - 47

SP - 269

EP - 296

JO - Data and Knowledge Engineering

JF - Data and Knowledge Engineering

SN - 0169-023X

IS - 2

ER -