Passive DNS collection using Bro
Branch: go-rewrite
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
assets
test_data
.gitignore
.travis.yml
Makefile
README.md
aggregate.go skip records with null bytes in queries Jan 3, 2019
aggregate_test.go
assets.go
dns-ans-query.bro
local_test.txt
main.go
read.go
read_ascii.go
read_json.go
read_test.go
store.go
store_pg.go
store_sql_common.go
store_sqlite.go
store_test.go
version.go
web.go

README.md

Passive DNS for Bro

Build Status

This is an extremely simple implementation of a passive DNS collection system that utilizes Bro for DNS log collection.

Passive DNS collection can be used for various security or troubleshooting purposes. Many queries to raw DNS logs can be done faster by using the aggregated data in the passive DNS database, which is more compact.

This tool uses the Bro DNS logs to build a database of unique query+type+answer tuples.

It produces a table like this:

pdns=# select * from dns where answer='74.125.225.18' order by last desc limit 4;
      query       | type |    answer     | count | ttl |     first     |    last
------------------+------+---------------+-------+-----+---------------+------------
 www.google.com   | A    | 74.125.225.18 |  7517 | 198 | 2014-09-03 .. | 2014-10-30 ..
 t0.gstatic.com   | A    | 74.125.225.18 |   266 | 300 | 2014-09-03 .. | 2014-10-30 ..
 googlegroups.com | A    | 74.125.225.18 |   266 | 300 | 2014-09-03 .. | 2014-10-30 ..
 t3.gstatic.com   | A    | 74.125.225.18 |   291 | 300 | 2014-09-03 .. | 2014-10-30 ..

This is helpful because the PTR record itself for 74.125.225.18 is ord08s12-in-f18.1e100.net.

Examples of questions this database can answer faster than the raw logs:

  • Did anything ever resolve example.com, and if so, when was the first time?
  • What IPs has example.com resolved to?
  • What other names resolve to this IP?

Requirements

  • go compiler ( to build )
  • postgresql ( optional )

Build

$ go build

Index logs

export PDNS_STORE_TYPE="postgresql"
export PDNS_STORE_URI="postgres://pdns:foo@localhost/pdns?sslmode=disable"

# or 
export PDNS_STORE_TYPE="sqlite"
export PDNS_STORE_URI="/path/to/passivedns.sqlite"

find /usr/local/bro/logs -name dns* | sort -n | xargs -n 50 bro-pdns index

Query Database

# suffix search:
$ bro-pdns like tuples google.com
$ bro-pdns like individual google.com

# exact match
$ bro-pdns find tuples google.com
$ bro-pdns find individual google.com

Start HTTP server

$ bro-pdns web

Query HTTP API

$ curl localhost:8080/dns/like/tuples/google.com
$ curl localhost:8080/dns/like/individual/google.com
$ curl localhost:8080/dns/find/tuples/google.com
$ curl localhost:8080/dns/find/individual/google.com