Skip to content
OmniSci Data Library Transfer - Automated import and export of sets of OmniSci dashboards, tables, and views
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
docs
odlt
tests
.gitignore
LICENSE.md
MANIFEST.in
README.rst
setup.py

README.rst

OmniSci Data Library Transfer Utility

This package provides the ability to import OmniSci Library packages into OmniSci Core using pymapd.

Installation

python setup.py install

Directory Setup

Both dashboards and datasets can be imported, and views can be created at the same time.

Successful import depends on the folder structure of the source data, set up as follows:

/meaningfulname
    /tables
        /tablename1
            schema.sql
            /data
                data1-1.csv.gz
                data1-2.csv.gz
        /tablename2
            schema.sql
            /data
                data2-1.csv.gz
                data2-2.csv
    /views
        aview.sql
        anotherview.sql
        yetanotherview.sql
    /dashboards
        dashboard.json
        anotherdashboard.json

Examples

Importing

Assuming the directory structure from above:

from odlt.importer import LibraryImport
imp = LibraryImport()
imp.connect()
localpath = '/home/myuser/meaningfulname'
corepath = '/opt/mapd/meaningfulname'
imp.import_all(localpath=localpath, corepath=corepath)

ToDo

  • Write tests
  • AWS S3 Support
  • Google Cloud Storage Support
  • Support for exporting
  • Support fetching data from alternate sources
  • Incremental updates to table data
You can’t perform that action at this time.