Skip to content
Tools and service for differentially private processing of tabular and relational data
Python ANTLR Other
Branch: master
Clone or download

Latest commit

Fetching latest commit…
Cannot retrieve the latest commit at this time.

Files

Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
devops
docs
evaluation
samples
sdk
service
tests
utils
.gitattributes
.gitignore
README.md

README.md

WhiteNoise: Tools for Differential Privacy

The WhiteNoise tools allow researchers and analysts to:

  • Use SQL dialect to ceate differentially private results over tabular data stores
  • Host a service to compose queries from heterogeneous differential privacy modules (including non-SQL) against shared privacy buget
  • Perform black-box stochastic testing against differential privacy modules

The WhiteNoise system is currently aimed at scenarios where the researcher is trusted by the data owner. Future releases will focus on hardened scenarios where the researcher or analyst is untrusted.

New mechanisms and algorithms will be available in coming weeks.

Data Access

The data access library intercepts SQL queries and processes the queries to return differentially private results. It is implemented in Python and designed to operate like any ODBC or DBAPI source. We provide support for PostgreSQL, SQL Server, Spark, Presto, and Pandas. Detailed documentation, as well as information about plugging in to other database backends, can be found here.

Service

The reference execution service provides a REST endpoint that can serve requests against shared data sources. It is designed to allow pluggable composition of many heterogeneous differential privacy modules. Heterogeneous requests against the same data source will compose privacy budget. We include SQL dialect, differentially-private graph (core), and a Logistic Regression module from IBM's diffprivlib. More information, including information about creating and integrating your own privacy modules, can be found here.

Evaluator

The stochastic evaluator drives black-box privacy algorithms, checking for privacy violations, accuracy, and bias. It was inspired by Google's stochastic evaluator, and is implemented in Python. Future releases will support more intelligent search of query input and data input space.

Installation:

The burdock library can be installed from PyPi:

pip install opendp-whitenoise

Documentation

Documentation for SDK functionality: Service API documentation:

Getting started

Samples

Samples of DP SQL functionality: Samples of interacting with the burdock service: Working with SQL Engines: Working with Spark DataFrames:

Experimental

Services getting started

Running opendp-whitenoise code through a service layer:

Service samples

TODO

You can’t perform that action at this time.