SQLAlchemy Dremio

This is fix dremio arrow flight connection upgrade.

Forked from https://github.com/narendrans/sqlalchemy_dremio

A SQLAlchemy dialect for Dremio via Flight interfaces.

• Installation
  • Pre-Requisites
• Usage
  • Arrow Flight
• Testing
• Superset Integration

Installation

pip3 install sqlalchemy_dremio

Usage

Arrow Flight

- This is experiemental. Not recommended for production usage.

Connection String example: dremio+flight://user:password@host:port/dremio

Refer https://github.com/dremio-hub/dremio-flight-connector for configuring flight endpoint in Dremio.

Testing

Set the environment variable DREMIO_CONNECTION_STRING:

Linux: export DREMIO_CONNECTION_URL="dremio://dremio:dremio123@localhost:31010/dremio"

And then run:

export DREMIO_CONNECTION_URL="dremio+flight://dremio:dremio123@localhost:32010/dremio"

sudo python3 setup.py install
py.test test

releasing

sudo rm -rf build/ dist/ sqlalchemy_dremio_flight.egg-info/

python3 -m pip install build

python3 -m build --sdist

twine check dist/*

twine upload dist/*

Superset Integration

This SQLAlchemy can be used for connecting Dremio with Superset. Please check superset website for more instructions on the setup.

Development

pip install -r requirements_dev.txt

build

sudo python3 setup.py install
twine upload dist/*