Skip to content

flowerinthenight/athena2csv

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

34 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CircleCI

Overview

This tool can download an Athena SQL query results in CSV format.

Installation

Using Homebrew:

$ brew tap flowerinthenight/tap
$ brew install athena2csv

If you have a Go environment:

$ go get -u -v github.com/flowerinthenight/athena2csv

Run the tool

Running this tool will create an S3 bucket queryathena2csv-query-bucket.

Required environment variables:

# The following should have at least Athena read and S3 read/write access.
AWS_REGION={your-aws-region}
AWS_ACCESS_KEY_ID={aws-key-id}
AWS_SECRET_ACCESS_KEY={aws-secret}

If your query string is quite long, you can write it in a file:

$ athena2csv --database aws-billing --query-file query.txt

If your query is not that long, you can input directly in command line:

$ athena2csv --database aws-billing "select \"identity/lineitemid\" \
      from \"aws_billing\".\"mobingilabs_aws_billing_formatted_development\" \
      limit 10"

Output file is downloaded to the current directory, named output.csv.