Lord of the links

A framework for discovering missing links in the Internet topology

Yihua He, Georgos Siganos, Michalis Faloutsos, Srikanth Krishnamurthy

Research output: Contribution to journalArticle

65 Citations (Scopus)

Abstract

The topology of the Internet at the Autonomous System (AS) level is not yet fully discovered despite significant research activity. The community still does not know how many links are missing, where these links are and finally, whether the missing links will change our conceptual model of the Internet topology. An accurate and complete model of the topology would be important for protocol design, performance evaluation and analyses. The goal of our work is to develop methodologies and tools to identify and validate such missing links between ASes. In this work, we develop several methods and identify a significant number of missing links, particularly of the peer-to-peer type. Interestingly, most of the missing AS links that we find exist as peer-to-peer links at the Internet Exchange Points (IXPs). First, in more detail, we provide a large-scale comprehensive synthesis of the available sources of information. We cross-validate and compare BGP routing tables, Internet Routing Registries, and traceroute data, while we extract significant new information from the less-studied Internet Exchange Points (IXPs). We identify 40% more edges and approximately 300% more peer-to-peer edges compared to commonly used data sets. All of these edges have been verified by either BGP tables or traceroute. Second, we identify properties of the new edges and quantify their effects on important topological properties. Given the new peer-to-peer edges, we find that for some ASes more than 50% of their paths stop going through their ISPs assuming policy-aware routing. A surprising observation is that the degree of an AS may be a poor indicator of which ASes it will peer with.

Original languageEnglish
Pages (from-to)391-404
Number of pages14
JournalIEEE/ACM Transactions on Networking
Volume17
Issue number2
DOIs
Publication statusPublished - 1 Jan 2009
Externally publishedYes

Fingerprint

Topology
Internet
Network protocols

Keywords

  • BGP
  • Inter-domain
  • Internet
  • Measurement
  • Missing links
  • Routing
  • Topology

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Software
  • Computer Science Applications
  • Computer Networks and Communications

Cite this

Lord of the links : A framework for discovering missing links in the Internet topology. / He, Yihua; Siganos, Georgos; Faloutsos, Michalis; Krishnamurthy, Srikanth.

In: IEEE/ACM Transactions on Networking, Vol. 17, No. 2, 01.01.2009, p. 391-404.

Research output: Contribution to journalArticle

He, Yihua ; Siganos, Georgos ; Faloutsos, Michalis ; Krishnamurthy, Srikanth. / Lord of the links : A framework for discovering missing links in the Internet topology. In: IEEE/ACM Transactions on Networking. 2009 ; Vol. 17, No. 2. pp. 391-404.
@article{dc8eb3e818e941a3b7c9ffc48bbfe147,
title = "Lord of the links: A framework for discovering missing links in the Internet topology",
abstract = "The topology of the Internet at the Autonomous System (AS) level is not yet fully discovered despite significant research activity. The community still does not know how many links are missing, where these links are and finally, whether the missing links will change our conceptual model of the Internet topology. An accurate and complete model of the topology would be important for protocol design, performance evaluation and analyses. The goal of our work is to develop methodologies and tools to identify and validate such missing links between ASes. In this work, we develop several methods and identify a significant number of missing links, particularly of the peer-to-peer type. Interestingly, most of the missing AS links that we find exist as peer-to-peer links at the Internet Exchange Points (IXPs). First, in more detail, we provide a large-scale comprehensive synthesis of the available sources of information. We cross-validate and compare BGP routing tables, Internet Routing Registries, and traceroute data, while we extract significant new information from the less-studied Internet Exchange Points (IXPs). We identify 40{\%} more edges and approximately 300{\%} more peer-to-peer edges compared to commonly used data sets. All of these edges have been verified by either BGP tables or traceroute. Second, we identify properties of the new edges and quantify their effects on important topological properties. Given the new peer-to-peer edges, we find that for some ASes more than 50{\%} of their paths stop going through their ISPs assuming policy-aware routing. A surprising observation is that the degree of an AS may be a poor indicator of which ASes it will peer with.",
keywords = "BGP, Inter-domain, Internet, Measurement, Missing links, Routing, Topology",
author = "Yihua He and Georgos Siganos and Michalis Faloutsos and Srikanth Krishnamurthy",
year = "2009",
month = "1",
day = "1",
doi = "10.1109/TNET.2008.926512",
language = "English",
volume = "17",
pages = "391--404",
journal = "IEEE/ACM Transactions on Networking",
issn = "1063-6692",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "2",

}

TY - JOUR

T1 - Lord of the links

T2 - A framework for discovering missing links in the Internet topology

AU - He, Yihua

AU - Siganos, Georgos

AU - Faloutsos, Michalis

AU - Krishnamurthy, Srikanth

PY - 2009/1/1

Y1 - 2009/1/1

N2 - The topology of the Internet at the Autonomous System (AS) level is not yet fully discovered despite significant research activity. The community still does not know how many links are missing, where these links are and finally, whether the missing links will change our conceptual model of the Internet topology. An accurate and complete model of the topology would be important for protocol design, performance evaluation and analyses. The goal of our work is to develop methodologies and tools to identify and validate such missing links between ASes. In this work, we develop several methods and identify a significant number of missing links, particularly of the peer-to-peer type. Interestingly, most of the missing AS links that we find exist as peer-to-peer links at the Internet Exchange Points (IXPs). First, in more detail, we provide a large-scale comprehensive synthesis of the available sources of information. We cross-validate and compare BGP routing tables, Internet Routing Registries, and traceroute data, while we extract significant new information from the less-studied Internet Exchange Points (IXPs). We identify 40% more edges and approximately 300% more peer-to-peer edges compared to commonly used data sets. All of these edges have been verified by either BGP tables or traceroute. Second, we identify properties of the new edges and quantify their effects on important topological properties. Given the new peer-to-peer edges, we find that for some ASes more than 50% of their paths stop going through their ISPs assuming policy-aware routing. A surprising observation is that the degree of an AS may be a poor indicator of which ASes it will peer with.

AB - The topology of the Internet at the Autonomous System (AS) level is not yet fully discovered despite significant research activity. The community still does not know how many links are missing, where these links are and finally, whether the missing links will change our conceptual model of the Internet topology. An accurate and complete model of the topology would be important for protocol design, performance evaluation and analyses. The goal of our work is to develop methodologies and tools to identify and validate such missing links between ASes. In this work, we develop several methods and identify a significant number of missing links, particularly of the peer-to-peer type. Interestingly, most of the missing AS links that we find exist as peer-to-peer links at the Internet Exchange Points (IXPs). First, in more detail, we provide a large-scale comprehensive synthesis of the available sources of information. We cross-validate and compare BGP routing tables, Internet Routing Registries, and traceroute data, while we extract significant new information from the less-studied Internet Exchange Points (IXPs). We identify 40% more edges and approximately 300% more peer-to-peer edges compared to commonly used data sets. All of these edges have been verified by either BGP tables or traceroute. Second, we identify properties of the new edges and quantify their effects on important topological properties. Given the new peer-to-peer edges, we find that for some ASes more than 50% of their paths stop going through their ISPs assuming policy-aware routing. A surprising observation is that the degree of an AS may be a poor indicator of which ASes it will peer with.

KW - BGP

KW - Inter-domain

KW - Internet

KW - Measurement

KW - Missing links

KW - Routing

KW - Topology

UR - http://www.scopus.com/inward/record.url?scp=67349176052&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=67349176052&partnerID=8YFLogxK

U2 - 10.1109/TNET.2008.926512

DO - 10.1109/TNET.2008.926512

M3 - Article

VL - 17

SP - 391

EP - 404

JO - IEEE/ACM Transactions on Networking

JF - IEEE/ACM Transactions on Networking

SN - 1063-6692

IS - 2

ER -