Multiple query optimization in middleware using query teamwork

Kevin O'Gorman, A. El Abbadi, D. Agrawal

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Multiple concurrent queries occur in many database settings. This paper describes the use of middleware as an optimization tool for such queries. Since common subexpressions derive from common data and the data is usually greatest at the source, the middleware exploits the presence of sharable access patterns to underlying data, especially scans of large portions of tables or indexes, in environments where query queuing or batching is an acceptable approach. The results show that simultaneous queries with such sharable accesses have a tendency to form synchronous groups (teams) which benefit each other through the operation of the disk cache, in effect using it as an implicit pipeline. The middleware exploits this tendency by queuing and scheduling the queries to promote this interaction, using an algorithm designed to promote such teamwork. This is implemented as middleware for use with a commercial database engine. The results include tests using the query mix from the TPC Benchmark™R, achieving a speed-up of 2.34 over the default scheduling provided by one database. Other results show that the success depends on the details of the computing environment.

Original languageEnglish
Pages (from-to)361-391
Number of pages31
JournalSoftware - Practice and Experience
Volume35
Issue number4
DOIs
Publication statusPublished - 10 Apr 2005
Externally publishedYes

Fingerprint

Middleware
Scheduling
Pipelines
Engines

Keywords

  • Middleware
  • Multiple query optimization
  • Query teamwork

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Software

Cite this

Multiple query optimization in middleware using query teamwork. / O'Gorman, Kevin; El Abbadi, A.; Agrawal, D.

In: Software - Practice and Experience, Vol. 35, No. 4, 10.04.2005, p. 361-391.

Research output: Contribution to journalArticle

O'Gorman, Kevin ; El Abbadi, A. ; Agrawal, D. / Multiple query optimization in middleware using query teamwork. In: Software - Practice and Experience. 2005 ; Vol. 35, No. 4. pp. 361-391.
@article{5555b5e5bf2340379555f6a7cb63a072,
title = "Multiple query optimization in middleware using query teamwork",
abstract = "Multiple concurrent queries occur in many database settings. This paper describes the use of middleware as an optimization tool for such queries. Since common subexpressions derive from common data and the data is usually greatest at the source, the middleware exploits the presence of sharable access patterns to underlying data, especially scans of large portions of tables or indexes, in environments where query queuing or batching is an acceptable approach. The results show that simultaneous queries with such sharable accesses have a tendency to form synchronous groups (teams) which benefit each other through the operation of the disk cache, in effect using it as an implicit pipeline. The middleware exploits this tendency by queuing and scheduling the queries to promote this interaction, using an algorithm designed to promote such teamwork. This is implemented as middleware for use with a commercial database engine. The results include tests using the query mix from the TPC Benchmark™R, achieving a speed-up of 2.34 over the default scheduling provided by one database. Other results show that the success depends on the details of the computing environment.",
keywords = "Middleware, Multiple query optimization, Query teamwork",
author = "Kevin O'Gorman and {El Abbadi}, A. and D. Agrawal",
year = "2005",
month = "4",
day = "10",
doi = "10.1002/spe.640",
language = "English",
volume = "35",
pages = "361--391",
journal = "Software - Practice and Experience",
issn = "0038-0644",
publisher = "John Wiley and Sons Ltd",
number = "4",

}

TY - JOUR

T1 - Multiple query optimization in middleware using query teamwork

AU - O'Gorman, Kevin

AU - El Abbadi, A.

AU - Agrawal, D.

PY - 2005/4/10

Y1 - 2005/4/10

N2 - Multiple concurrent queries occur in many database settings. This paper describes the use of middleware as an optimization tool for such queries. Since common subexpressions derive from common data and the data is usually greatest at the source, the middleware exploits the presence of sharable access patterns to underlying data, especially scans of large portions of tables or indexes, in environments where query queuing or batching is an acceptable approach. The results show that simultaneous queries with such sharable accesses have a tendency to form synchronous groups (teams) which benefit each other through the operation of the disk cache, in effect using it as an implicit pipeline. The middleware exploits this tendency by queuing and scheduling the queries to promote this interaction, using an algorithm designed to promote such teamwork. This is implemented as middleware for use with a commercial database engine. The results include tests using the query mix from the TPC Benchmark™R, achieving a speed-up of 2.34 over the default scheduling provided by one database. Other results show that the success depends on the details of the computing environment.

AB - Multiple concurrent queries occur in many database settings. This paper describes the use of middleware as an optimization tool for such queries. Since common subexpressions derive from common data and the data is usually greatest at the source, the middleware exploits the presence of sharable access patterns to underlying data, especially scans of large portions of tables or indexes, in environments where query queuing or batching is an acceptable approach. The results show that simultaneous queries with such sharable accesses have a tendency to form synchronous groups (teams) which benefit each other through the operation of the disk cache, in effect using it as an implicit pipeline. The middleware exploits this tendency by queuing and scheduling the queries to promote this interaction, using an algorithm designed to promote such teamwork. This is implemented as middleware for use with a commercial database engine. The results include tests using the query mix from the TPC Benchmark™R, achieving a speed-up of 2.34 over the default scheduling provided by one database. Other results show that the success depends on the details of the computing environment.

KW - Middleware

KW - Multiple query optimization

KW - Query teamwork

UR - http://www.scopus.com/inward/record.url?scp=15744363199&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=15744363199&partnerID=8YFLogxK

U2 - 10.1002/spe.640

DO - 10.1002/spe.640

M3 - Article

VL - 35

SP - 361

EP - 391

JO - Software - Practice and Experience

JF - Software - Practice and Experience

SN - 0038-0644

IS - 4

ER -