Skip to content

gabriellichacz/hive_druid_connector

Repository files navigation

Hive connector written in Python 3.10 using PyHive.

druidInsertIntoFromUrl example

from DruidConnector import *
import time

druidUrl = druidConnect("192.168.1.112", "8082", 'sql')

insertData = druidInsertIntoFromUrl(druidUrl, 'wikipedia', 'timestamp', 'https://druid.apache.org/data/wikipedia.json.gz', 'json', [
        ['added', 'long'],
        ['channel', 'string'],
        ['cityName', 'string'],
        ['comment', 'string'],
        ['commentLength', 'long'],
        ['countryIsoCode', 'string'],
        ['countryName', 'string'],
        ['deleted', 'long'],
        ['delta', 'long'],
        ['deltaBucket', 'string'],
        ['diffUrl', 'string'],
        ['flags', 'string'],
        ['isAnonymous', 'string'],
        ['isMinor', 'string'],
        ['isNew', 'string'],
        ['isRobot', 'string'],
        ['isUnpatrolled', 'string'],
        ['metroCode', 'string'],
        ['namespace', 'string'],
        ['page', 'string'],
        ['regionIsoCode', 'string'],
        ['regionName', 'string'],
        ['timestamp', 'string'],
        ['user', 'string']
    ]
)
print(insertData)

About

Hive and Druid Database Python connector using Pyhive

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages