Add scripts to download and process BGP dumps

[naumenkogs]

See README.md.

There is probably a better way to do it in rust :)

This isn't really working now, will submit working code soon.

Also, rust coming soon so maybe don't bother reviewing Python quagga_aggregate.py stuff (except if you're willing to verify the approach)

[practicalswift]

providers = range(1, 24)
date = datetime.date.today()

dumps_dir = "dumps/"

for provider in providers:
    provider = ("{:02d}".format(provider))
    link = "http://data.ris.ripe.net/rrc{0}/latest-bview.gz".format(provider)

This will skip the RIPE NCC (rrc00) and LACNIC (rcc24) measurements. Is that intentional? :)

[naumenkogs]

This will skip the RIPE NCC (rrc00) and LACNIC (rcc24) measurements. Is that intentional? :)

Nope, will fix 🥇

[sipa]

@naumenkogs Was merging this intentional? I thought you were going to rewrite some part in Rust, and address the comment above?

[naumenkogs]

@sipa
No, this was accidental =\

I see 2 options:

• revert this commit
• let me submit that small fix, and update remote_dumps/readme with "EXPERIMENTAL"

What would you prefer?

[sipa]

No need to revert. Let's improve it later.