CIVSched: A communication-aware inter-VM scheduling technique for decreased network latency between co-located VMs

Bei Guan, Jingzheng Wu, Yongji Wang, Samee U. Khan

Research output: Contribution to journalArticle

20 Citations (Scopus)

Abstract

Server consolidation in cloud computing environments makes it possible for multiple servers or desktops to run on a single physical server for high resource utilization, low cost, and reduced energy consumption. However, the scheduler in the virtual machine monitor (VMM), such as Xen credit scheduler, is agnostic about the communication behavior between the guest operating systems (OS). The aforementioned behavior leads to increased network communication latency in consolidated environments. In particular, the CPU resources management has a critical impact on the network latency between co-located virtual machines (VMs) when there are CPU- and I/O-intensive workloads running simultaneously. This paper presents the design and implementation of a communication-aware inter-VM scheduling (CIVSched) technique that takes into account the communication behavior betweeninter-VMs running on the same virtualization platform. The CIVSched technique inspects the network packets transmitted between local co-resident domains to identify the target VM and process that will receive the packets. Thereafter, the target VM and process are preferentially scheduled by the VMM and the guest OS. The cooperation of these two schedulers makes the network packets to be timely received by the target application. Experimental results on the Xen virtualization platform depict that the CIVSched technique can reduce the average response time of network traffic by approximately 19 percent for the highly consolidated environment, while keeping the inherent fairness of the VMM scheduler.

Original languageEnglish
Pages (from-to)320-332
Number of pages13
JournalIEEE Transactions on Cloud Computing
Volume2
Issue number3
DOIs
Publication statusPublished - 1 Jan 2014
Externally publishedYes

Fingerprint

Computer networks
Scheduling
Communication
Servers
Packet networks
Program processors
Virtual machine
Cloud computing
Consolidation
Telecommunication networks
Energy utilization
Costs

Keywords

  • Communication-aware scheduling
  • inter-VM
  • resource management
  • vCPU scheduling
  • Xen

ASJC Scopus subject areas

  • Software
  • Information Systems
  • Hardware and Architecture
  • Computer Science Applications
  • Computer Networks and Communications

Cite this

CIVSched : A communication-aware inter-VM scheduling technique for decreased network latency between co-located VMs. / Guan, Bei; Wu, Jingzheng; Wang, Yongji; Khan, Samee U.

In: IEEE Transactions on Cloud Computing, Vol. 2, No. 3, 01.01.2014, p. 320-332.

Research output: Contribution to journalArticle

@article{168871cd834e406f96fa1a0ed1560800,
title = "CIVSched: A communication-aware inter-VM scheduling technique for decreased network latency between co-located VMs",
abstract = "Server consolidation in cloud computing environments makes it possible for multiple servers or desktops to run on a single physical server for high resource utilization, low cost, and reduced energy consumption. However, the scheduler in the virtual machine monitor (VMM), such as Xen credit scheduler, is agnostic about the communication behavior between the guest operating systems (OS). The aforementioned behavior leads to increased network communication latency in consolidated environments. In particular, the CPU resources management has a critical impact on the network latency between co-located virtual machines (VMs) when there are CPU- and I/O-intensive workloads running simultaneously. This paper presents the design and implementation of a communication-aware inter-VM scheduling (CIVSched) technique that takes into account the communication behavior betweeninter-VMs running on the same virtualization platform. The CIVSched technique inspects the network packets transmitted between local co-resident domains to identify the target VM and process that will receive the packets. Thereafter, the target VM and process are preferentially scheduled by the VMM and the guest OS. The cooperation of these two schedulers makes the network packets to be timely received by the target application. Experimental results on the Xen virtualization platform depict that the CIVSched technique can reduce the average response time of network traffic by approximately 19 percent for the highly consolidated environment, while keeping the inherent fairness of the VMM scheduler.",
keywords = "Communication-aware scheduling, inter-VM, resource management, vCPU scheduling, Xen",
author = "Bei Guan and Jingzheng Wu and Yongji Wang and Khan, {Samee U.}",
year = "2014",
month = "1",
day = "1",
doi = "10.1109/TCC.2014.2328582",
language = "English",
volume = "2",
pages = "320--332",
journal = "IEEE Transactions on Cloud Computing",
issn = "2168-7161",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "3",

}

TY - JOUR

T1 - CIVSched

T2 - A communication-aware inter-VM scheduling technique for decreased network latency between co-located VMs

AU - Guan, Bei

AU - Wu, Jingzheng

AU - Wang, Yongji

AU - Khan, Samee U.

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Server consolidation in cloud computing environments makes it possible for multiple servers or desktops to run on a single physical server for high resource utilization, low cost, and reduced energy consumption. However, the scheduler in the virtual machine monitor (VMM), such as Xen credit scheduler, is agnostic about the communication behavior between the guest operating systems (OS). The aforementioned behavior leads to increased network communication latency in consolidated environments. In particular, the CPU resources management has a critical impact on the network latency between co-located virtual machines (VMs) when there are CPU- and I/O-intensive workloads running simultaneously. This paper presents the design and implementation of a communication-aware inter-VM scheduling (CIVSched) technique that takes into account the communication behavior betweeninter-VMs running on the same virtualization platform. The CIVSched technique inspects the network packets transmitted between local co-resident domains to identify the target VM and process that will receive the packets. Thereafter, the target VM and process are preferentially scheduled by the VMM and the guest OS. The cooperation of these two schedulers makes the network packets to be timely received by the target application. Experimental results on the Xen virtualization platform depict that the CIVSched technique can reduce the average response time of network traffic by approximately 19 percent for the highly consolidated environment, while keeping the inherent fairness of the VMM scheduler.

AB - Server consolidation in cloud computing environments makes it possible for multiple servers or desktops to run on a single physical server for high resource utilization, low cost, and reduced energy consumption. However, the scheduler in the virtual machine monitor (VMM), such as Xen credit scheduler, is agnostic about the communication behavior between the guest operating systems (OS). The aforementioned behavior leads to increased network communication latency in consolidated environments. In particular, the CPU resources management has a critical impact on the network latency between co-located virtual machines (VMs) when there are CPU- and I/O-intensive workloads running simultaneously. This paper presents the design and implementation of a communication-aware inter-VM scheduling (CIVSched) technique that takes into account the communication behavior betweeninter-VMs running on the same virtualization platform. The CIVSched technique inspects the network packets transmitted between local co-resident domains to identify the target VM and process that will receive the packets. Thereafter, the target VM and process are preferentially scheduled by the VMM and the guest OS. The cooperation of these two schedulers makes the network packets to be timely received by the target application. Experimental results on the Xen virtualization platform depict that the CIVSched technique can reduce the average response time of network traffic by approximately 19 percent for the highly consolidated environment, while keeping the inherent fairness of the VMM scheduler.

KW - Communication-aware scheduling

KW - inter-VM

KW - resource management

KW - vCPU scheduling

KW - Xen

UR - http://www.scopus.com/inward/record.url?scp=84908394684&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84908394684&partnerID=8YFLogxK

U2 - 10.1109/TCC.2014.2328582

DO - 10.1109/TCC.2014.2328582

M3 - Article

AN - SCOPUS:84908394684

VL - 2

SP - 320

EP - 332

JO - IEEE Transactions on Cloud Computing

JF - IEEE Transactions on Cloud Computing

SN - 2168-7161

IS - 3

ER -