KPart: A Hybrid Cache Partitioning-Sharing Technique for Commodity Multicores

Nosayba El-Sayed, Anurag Mukkara, Po An Tsai, Harshad Kasture, Xiaosong Ma, Daniel Sanchez

Research output: Chapter in Book/Report/Conference proceedingConference contribution

27 Citations (Scopus)

Abstract

Cache partitioning is now available in commercial hardware. In theory, software can leverage cache partitioning to use the last-level cache better and improve performance. In practice, however, current systems implement way-partitioning, which offers a limited number of partitions and often hurts performance. These limitations squander the performance potential of smart cache management. We present KPart, a hybrid cache partitioning-sharing technique that sidesteps the limitations of way-partitioning and unlocks significant performance on current systems. KPart first groups applications into clusters, then partitions the cache among these clusters. To build clusters, KPart relies on a novel technique to estimate the performance loss an application suffers when sharing a partition. KPart automatically chooses the number of clusters, balancing the isolation benefits of way-partitioning with its potential performance impact. KPart uses detailed profiling information to make these decisions. This information can be gathered either offline, or online at low overhead using a novel profiling mechanism. We evaluate KPart in a real system and in simulation. KPart improves throughput by 24% on average (up to 79%) on an Intel Broadwell-D system, whereas prior per-application partitioning policies improve throughput by just 1.7% on average and hurt 30% of workloads. Simulation results show that KPart achieves most of the performance of more advanced partitioning techniques that are not yet available in hardware.

Original languageEnglish
Title of host publicationProceedings - 24th IEEE International Symposium on High Performance Computer Architecture, HPCA 2018
PublisherIEEE Computer Society
Pages104-117
Number of pages14
Volume2018-February
ISBN (Electronic)9781538636596
DOIs
Publication statusPublished - 27 Mar 2018
Event24th IEEE International Symposium on High Performance Computer Architecture, HPCA 2018 - Vienna, Austria
Duration: 24 Feb 201828 Feb 2018

Other

Other24th IEEE International Symposium on High Performance Computer Architecture, HPCA 2018
CountryAustria
CityVienna
Period24/2/1828/2/18

    Fingerprint

Keywords

  • Application clustering
  • Cache partitioning
  • Multicore architecture
  • Performance isolation

ASJC Scopus subject areas

  • Hardware and Architecture

Cite this

El-Sayed, N., Mukkara, A., Tsai, P. A., Kasture, H., Ma, X., & Sanchez, D. (2018). KPart: A Hybrid Cache Partitioning-Sharing Technique for Commodity Multicores. In Proceedings - 24th IEEE International Symposium on High Performance Computer Architecture, HPCA 2018 (Vol. 2018-February, pp. 104-117). IEEE Computer Society. https://doi.org/10.1109/HPCA.2018.00019