Skip to content

v2.1.0

Choose a tag to compare

@gleich gleich released this 14 May 17:23
· 5 commits to main since this release
a598c68

What's new

Typed Download functions for each stream

Each real-time stream now has a matching Download* function that fetches the corresponding Parquet snapshot without needing to pass a raw stream name string.

Firehose

  • DownloadProxy(date, hour, opts) — proxy feed snapshot
  • DownloadAnonymizer(date, hour, opts) — anonymizer feed snapshot
  • DownloadTorrent(date, hour, opts) — torrent feed snapshot

Helios

  • DownloadHeliosHTTP(date, hour, opts) — Helios HTTP capture snapshot
  • DownloadHeliosTLS(date, hour, opts) — Helios TLS capture snapshot

All five accept "latest" or a YYYY-MM-DD date, an optional hour pointer for hourly snapshots, and follow the 307 redirect to the presigned URL automatically. The caller must close the returned io.ReadCloser.

Examples

Added example programs for each new function under _examples/enterprise/firehose/ and _examples/enterprise/helios/.