Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

implement Trino source #585

Merged
merged 12 commits into from
Apr 22, 2024
Merged

implement Trino source #585

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
925423a
implemented type system for Trino
domnikl Jan 19, 2024
95630aa
hard-coded schema
domnikl Feb 2, 2024
b338022
WIP Trino in Python
domnikl Feb 9, 2024
c81077d
Merge remote-tracking branch 'upstream/main' into trino-source
domnikl Mar 15, 2024
5fca5ca
update deps for Trino source
domnikl Mar 15, 2024
d374400
added tests for Trino and connecting without auth
domnikl Apr 12, 2024
3099395
fixed copy/paste for trino tests
domnikl Apr 12, 2024
aaab7de
Merge remote-tracking branch 'upstream/main' into trino-source
domnikl Apr 12, 2024
6979c65
implemented partitioning for Trino
domnikl Apr 19, 2024
52da49a
fetch results for Trino more efficiently
domnikl Apr 19, 2024
b279cdb
Trino use count_query for get_total_rows
domnikl Apr 22, 2024
cbe16b5
added Trino documentation
domnikl Apr 22, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
86 changes: 82 additions & 4 deletions Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 2 additions & 0 deletions Justfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,7 @@ test-feature-gate:
cargo c --features src_oracle
cargo c --features src_csv
cargo c --features src_dummy
cargo c --features src_trino
cargo c --features dst_arrow
cargo c --features dst_arrow2

Expand Down Expand Up @@ -62,6 +63,7 @@ seed-db-more:
ORACLE_URL_SCRIPT=`echo ${ORACLE_URL#oracle://} | sed "s/:/\//"`
cat scripts/oracle.sql | sqlplus $ORACLE_URL_SCRIPT
mysql --protocol tcp -h$MARIADB_HOST -P$MARIADB_PORT -u$MARIADB_USER -p$MARIADB_PASSWORD $MARIADB_DB < scripts/mysql.sql
trino $TRINO_URL --catalog=$TRINO_CATALOG < scripts/trino.sql

# benches
flame-tpch conn="POSTGRES_URL":
Expand Down
1 change: 1 addition & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -94,6 +94,7 @@ For more planned data sources, please check out our [discussion](https://github.
- [x] Oracle
- [x] Big Query
- [ ] ODBC (WIP)
- [ ] Trino (WIP)
- [ ] ...

## Destinations
Expand Down
1 change: 1 addition & 0 deletions connectorx-cpp/Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,4 +34,5 @@ srcs = [
"connectorx/src_mssql",
"connectorx/src_oracle",
"connectorx/src_bigquery",
"connectorx/src_trino",
]
69 changes: 69 additions & 0 deletions connectorx-python/Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

1 change: 1 addition & 0 deletions connectorx-python/Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -75,5 +75,6 @@ srcs = [
"connectorx/src_mssql",
"connectorx/src_oracle",
"connectorx/src_bigquery",
"connectorx/src_trino",
]
integrated-auth-gssapi = ["connectorx/integrated-auth-gssapi"]
Loading
Loading