Bittorrent locality and transit trafficreduction: When, why, and at what cost?

Ruben Cuevas, Nikolaos Laoutaris, Xiaoyuan Yang, Georgos Siganos, Pablo Rodriguez

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

A substantial amount of work has recently gone into localizing BitTorrent traffic within an ISP in order to avoid excessive and often times unnecessary transit costs. Several architectures and systems have been proposed and the initial results from specific ISPs and a few torrents have been encouraging. In this work we attempt to deepen and scale our understanding of locality and its potential. Looking at specific ISPs, we consider tens of thousands of concurrent torrents, and thus capture ISP-wide implications that cannot be appreciated by looking at only a handful of torrents. Second, we go beyond individual case studies and present results for few thousands ISPs represented in our data set of up to 40K torrents involving more than 3.9M concurrent peers and more than 20M in the course of a day spread in 11K ASes. Finally, we develop scalable methodologies that allow us to process this huge data set and derive accurate traffic matrices of torrents. Using the previous methods we obtain the following main findings: i) Although there are a large number of very small ISPs without enough resources for localizing traffic, by analyzing the 100 largest ISPs we show that Locality policies are expected to significantly reduce the transit traffic with respect to the default random overlay construction method in these ISPs; ii) contrary to the popular belief, increasing the access speed of the clients of an ISP does not necessarily help to localize more traffic; iii) by studying several real ISPs, we have shown that soft speed-aware locality policies guarantee win-win situations for ISPs and end users. Furthermore, the maximum transit traffic savings that an ISP can achieve without limiting the number of inter-ISP overlay links is bounded by 'unlocalizable' torrents with few local clients. The application of restrictions in the number of inter-ISP links leads to a higher transit traffic reduction but the QoS of clients downloading 'unlocalizable' torrents would be severely harmed.

Original languageEnglish
Article number6497045
Pages (from-to)1177-1189
Number of pages13
JournalIEEE Transactions on Parallel and Distributed Systems
Volume25
Issue number5
DOIs
Publication statusPublished - 1 Jan 2014
Externally publishedYes

Fingerprint

Telecommunication traffic
Telecommunication links
Costs
Quality of service

Keywords

  • BitTorrent
  • locality
  • measurements
  • P2P

ASJC Scopus subject areas

  • Hardware and Architecture
  • Signal Processing
  • Computational Theory and Mathematics

Cite this

Bittorrent locality and transit trafficreduction : When, why, and at what cost? / Cuevas, Ruben; Laoutaris, Nikolaos; Yang, Xiaoyuan; Siganos, Georgos; Rodriguez, Pablo.

In: IEEE Transactions on Parallel and Distributed Systems, Vol. 25, No. 5, 6497045, 01.01.2014, p. 1177-1189.

Research output: Contribution to journalArticle

Cuevas, Ruben ; Laoutaris, Nikolaos ; Yang, Xiaoyuan ; Siganos, Georgos ; Rodriguez, Pablo. / Bittorrent locality and transit trafficreduction : When, why, and at what cost?. In: IEEE Transactions on Parallel and Distributed Systems. 2014 ; Vol. 25, No. 5. pp. 1177-1189.
@article{f03a0c872f574a5bb70ac19c99424d9a,
title = "Bittorrent locality and transit trafficreduction: When, why, and at what cost?",
abstract = "A substantial amount of work has recently gone into localizing BitTorrent traffic within an ISP in order to avoid excessive and often times unnecessary transit costs. Several architectures and systems have been proposed and the initial results from specific ISPs and a few torrents have been encouraging. In this work we attempt to deepen and scale our understanding of locality and its potential. Looking at specific ISPs, we consider tens of thousands of concurrent torrents, and thus capture ISP-wide implications that cannot be appreciated by looking at only a handful of torrents. Second, we go beyond individual case studies and present results for few thousands ISPs represented in our data set of up to 40K torrents involving more than 3.9M concurrent peers and more than 20M in the course of a day spread in 11K ASes. Finally, we develop scalable methodologies that allow us to process this huge data set and derive accurate traffic matrices of torrents. Using the previous methods we obtain the following main findings: i) Although there are a large number of very small ISPs without enough resources for localizing traffic, by analyzing the 100 largest ISPs we show that Locality policies are expected to significantly reduce the transit traffic with respect to the default random overlay construction method in these ISPs; ii) contrary to the popular belief, increasing the access speed of the clients of an ISP does not necessarily help to localize more traffic; iii) by studying several real ISPs, we have shown that soft speed-aware locality policies guarantee win-win situations for ISPs and end users. Furthermore, the maximum transit traffic savings that an ISP can achieve without limiting the number of inter-ISP overlay links is bounded by 'unlocalizable' torrents with few local clients. The application of restrictions in the number of inter-ISP links leads to a higher transit traffic reduction but the QoS of clients downloading 'unlocalizable' torrents would be severely harmed.",
keywords = "BitTorrent, locality, measurements, P2P",
author = "Ruben Cuevas and Nikolaos Laoutaris and Xiaoyuan Yang and Georgos Siganos and Pablo Rodriguez",
year = "2014",
month = "1",
day = "1",
doi = "10.1109/TPDS.2013.109",
language = "English",
volume = "25",
pages = "1177--1189",
journal = "IEEE Transactions on Parallel and Distributed Systems",
issn = "1045-9219",
publisher = "IEEE Computer Society",
number = "5",

}

TY - JOUR

T1 - Bittorrent locality and transit trafficreduction

T2 - When, why, and at what cost?

AU - Cuevas, Ruben

AU - Laoutaris, Nikolaos

AU - Yang, Xiaoyuan

AU - Siganos, Georgos

AU - Rodriguez, Pablo

PY - 2014/1/1

Y1 - 2014/1/1

N2 - A substantial amount of work has recently gone into localizing BitTorrent traffic within an ISP in order to avoid excessive and often times unnecessary transit costs. Several architectures and systems have been proposed and the initial results from specific ISPs and a few torrents have been encouraging. In this work we attempt to deepen and scale our understanding of locality and its potential. Looking at specific ISPs, we consider tens of thousands of concurrent torrents, and thus capture ISP-wide implications that cannot be appreciated by looking at only a handful of torrents. Second, we go beyond individual case studies and present results for few thousands ISPs represented in our data set of up to 40K torrents involving more than 3.9M concurrent peers and more than 20M in the course of a day spread in 11K ASes. Finally, we develop scalable methodologies that allow us to process this huge data set and derive accurate traffic matrices of torrents. Using the previous methods we obtain the following main findings: i) Although there are a large number of very small ISPs without enough resources for localizing traffic, by analyzing the 100 largest ISPs we show that Locality policies are expected to significantly reduce the transit traffic with respect to the default random overlay construction method in these ISPs; ii) contrary to the popular belief, increasing the access speed of the clients of an ISP does not necessarily help to localize more traffic; iii) by studying several real ISPs, we have shown that soft speed-aware locality policies guarantee win-win situations for ISPs and end users. Furthermore, the maximum transit traffic savings that an ISP can achieve without limiting the number of inter-ISP overlay links is bounded by 'unlocalizable' torrents with few local clients. The application of restrictions in the number of inter-ISP links leads to a higher transit traffic reduction but the QoS of clients downloading 'unlocalizable' torrents would be severely harmed.

AB - A substantial amount of work has recently gone into localizing BitTorrent traffic within an ISP in order to avoid excessive and often times unnecessary transit costs. Several architectures and systems have been proposed and the initial results from specific ISPs and a few torrents have been encouraging. In this work we attempt to deepen and scale our understanding of locality and its potential. Looking at specific ISPs, we consider tens of thousands of concurrent torrents, and thus capture ISP-wide implications that cannot be appreciated by looking at only a handful of torrents. Second, we go beyond individual case studies and present results for few thousands ISPs represented in our data set of up to 40K torrents involving more than 3.9M concurrent peers and more than 20M in the course of a day spread in 11K ASes. Finally, we develop scalable methodologies that allow us to process this huge data set and derive accurate traffic matrices of torrents. Using the previous methods we obtain the following main findings: i) Although there are a large number of very small ISPs without enough resources for localizing traffic, by analyzing the 100 largest ISPs we show that Locality policies are expected to significantly reduce the transit traffic with respect to the default random overlay construction method in these ISPs; ii) contrary to the popular belief, increasing the access speed of the clients of an ISP does not necessarily help to localize more traffic; iii) by studying several real ISPs, we have shown that soft speed-aware locality policies guarantee win-win situations for ISPs and end users. Furthermore, the maximum transit traffic savings that an ISP can achieve without limiting the number of inter-ISP overlay links is bounded by 'unlocalizable' torrents with few local clients. The application of restrictions in the number of inter-ISP links leads to a higher transit traffic reduction but the QoS of clients downloading 'unlocalizable' torrents would be severely harmed.

KW - BitTorrent

KW - locality

KW - measurements

KW - P2P

UR - http://www.scopus.com/inward/record.url?scp=84898684128&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84898684128&partnerID=8YFLogxK

U2 - 10.1109/TPDS.2013.109

DO - 10.1109/TPDS.2013.109

M3 - Article

AN - SCOPUS:84898684128

VL - 25

SP - 1177

EP - 1189

JO - IEEE Transactions on Parallel and Distributed Systems

JF - IEEE Transactions on Parallel and Distributed Systems

SN - 1045-9219

IS - 5

M1 - 6497045

ER -