Skip to content
A foreign data wrapper for accessing csv and JSON files on cloud filesystems.
Python
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
cloudfs_fdw Preliminary README Sep 20, 2019
README.md Preliminary README Sep 20, 2019
setup.py Inital commit Sep 13, 2019

README.md

cloudfs_fdw

A foreign data wrapper for accessing CSV and JSON files on cloud filesystems.

Installation

CREATE EXTENSION multicorn;

CREATE SERVER <server> FOREIGN DATA WRAPPER multicorn OPTIONS (wrapper 'cloudfs_fdw.cloudfs_fdw.cloudfs_fdw');

CREATE USER MAPPING FOR <user> SERVER <server>;

Create table

CREATE FOREIGN TABLE <schema>.<table> (...) SERVER <server> OPTIONS (<options>);

See this for general information how SQL/MED in PostgreSQL works, and this for CREATE FOREIGN TABLE syntax.

Available Options

S3 compatible

  • source 's3'
  • bucket <bucket>
  • filepath <filename>
  • host <host>, default: localhost
  • port <port>, default: 443
  • region <region>
  • aws_access_key <access_key>
  • aws_secret_key <secret_key>

HTTP / HTTPS

  • source 'http/https'
  • url <URL>

Filesystem

  • source 'file'
  • filepath <filepath>>

JSON

  • format 'json'
  • json_path <json_path>

CSV

  • format 'csv'
  • header <true/false>
  • delimiter <delimiter>, default: ,
  • quote_char <quote_char>, default: "

Compression

'.gz' and '.zip' compressed files are decompressed automagically.

You can’t perform that action at this time.