The Internet AS-Level Topology Archive
Perl Shell Gnuplot
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
newscripts
stats
.gitignore
README.md
bgpdump
collectors.txt
daily.sh
dailyextract.sh
dailyunion.sh
extractor.pl
getlink.sh
monthly.gnuplot
monthly.sh
monthlyunion.sh
plot.sh
rawfile-checker.sh
runtopojob.sh
sanitizer.pl
topolite.conf.sh
uniq.pl
uniqc.pl
uniqs.pl

README.md

topo-lite

NEW! new scripts are in newscripts.

  • puller.pl : wget BGP data from collectors.txt.
  • extractor.pl : extract AS-AS links, prefix origins and monitors.

NOTE: collectors.txt is stale and to be updated.

=========

Extract AS topology from 4 BGP data collection projects

  • Configuration

    • all scripts read ${TOPOLITEPATH}/topolite.conf.sh, so ${TOPOLITEPATH} should be exported.
    • topolite.conf.sh : declare paths to scripts, BGP raw data, topology data, log ...
    • the following commands need to be found in $PATH: bgpdump, gzip, bzip2, cat, find, perl, grep, sed, date, gnuplot
  • topo-lite runs via crontab:

0 1 * * * /lab/topology/topolite/scripts/daily.sh
0 23 * * 5 /lab/topology/topolite/scripts/monthly.sh
  • Scripts:

    • bgpdump : A modified version of bgpdump.
    • extractor.pl : extract AS-AS links from a BGP raw data file (with bgpdump for MRT format data)
    • getlink.sh : extract links from a directory of raw data with extractor.pl
    • runtopojob.sh : run getlink.sh to process NEWLY downloaded raw data
    • dailyextract.sh : run getlink.sh to process raw data on given days
    • dailyunion.sh : aggregate links from individual collectors into a daily union file
    • monthlyunion.sh : aggregate links from individual daily files into a monthly union file
    • uniq.pl : a uniq tool by utilizing perl's hash
    • uniqs.pl : a uniq tool seperating IPv4 and IPv6 topology data
    • uniqc.pl : a uniq -c tool
    • plot.sh : generate the evolution graph of Internet topology
    • monthly.gnuplot : gnuplot script for drawing the evolution graph
    • daily.sh : daily routine
    • monthly.sh : monthly routine
  • Repositories of BGP data collection projects: