diff --git a/.travis.yml b/.travis.yml index 60fea38d..3f7114fb 100644 --- a/.travis.yml +++ b/.travis.yml @@ -50,20 +50,20 @@ deploy: provider: releases api_key: secure: |- - u8cr+1uVDUU2k1/OIEJzzUVfHezB8yHfCtupxJgOy7xp3cwInetJ6l5AO1+2FWTEzhiS0PN5srqLdk0mZxAAUBWVDv2 - RTxZ9c6iduNLxuaL1BFX6D/lgVJ/zGW69ghOcn8Pa40V2OAocB2JxiKb3Mob9PBC0CBirlr1V9RI2+cIwP2JGb0WJYf - Mg6JSF9zYqQiXYPhCjVLKE7wDVeO2M0SfI1kURcM+4iDMB1DPfMy7G0ATKoefq8xzSl7/8DwvOT+r3T1L1QO0fk1z62 - V2toJzcBfiXK3kU8b2+YPGnyx8YEqcsWfciKaBJqFHiAtGMlq/ea7isHsG+BiJxVUR0hcLqJvi+S4HbldchP35mMgnG - EP6vwtTExTgsWuH84ApH4uDCwJZkqngLrUpblt26f7iye9F8e5zG0mGfkxgZBrJgYkJPod7ntH0nYGb0Y4ZC+px/oIe - D5t7yvmwxGT3ARvNS7vOlgl7IQ3dRn4hcrMjqPQmwet6nmo1vv9RtUrY6vTJeh8blkPRjExbC/lCfKkT6AOr1OUuR3f - shq9MLKBeFQBahsH7T5sWaW/m2MeAbVBCG+r9qyN17dlDnQiD8KDjVQeu73lvwTUMdFZzDMfoiGrV31tTddSMfYa/CX - 9p2j0tcPrxJW/fgX10YLJ44Zgy/26CVGYLJ1NYAZed3D7U= + 1Uktls+mY/4S14EJpL/T75Fe2WanXUH9n/ayNOlaX57aU6BWrgxdNDX5vwrKIZSpu7NvzFVR+5G0p4QM4K5zJ5X0udC + j3YDl5mWNJClTlLICD2SWhaHrhdU3zSAR1fKDV/3t7g13DPu6cDC65Y15wjOYW95rEqQFUNPdr69eofn+1mSc+pdBdU + +L+biQHKR8WsTylZYMl7kJzgRwSzt2iPk5bnGi2speuowXU/PD4rByAEyeJGV5qRgDwAzXUjoLVpPYocovUkaVmPJzQ + GKHv7M61Y9qzjr7f7i4Gwy9XLLt8KWn8jouax7lNhi5bCj4HqZc7zOaM9OmMX4XujgHT/hHxPvAPJtAidN6030M1ARI + YljO78baUKb5OCjCOY+sP8vewjyCjYMCJjZwz02tFLdxe4etFwijoGA5U8PWNvrzYxDR6XVNu6sr+OkkmBrk8pPSI+0 + mB/pe1KSBCdwB7NaviHIe3YMgI3Uppm0U3jP+fFEowgMSbiCuDKeB5YRN4yTAlSl5y09pXUFK3XZeEgQg/eKg5FM17e + ILFIDI3uWsUC5LoDNmGXpx6LALVGbLWJLwNMnjZ67UudnRzd94YYj9wyD0InhnBIOR9UQr7ahuICK0sDIrnNl+7C6zQ + ZmxvROw6SHkHszcfbCWl78rBy7J6QnOGfYbreuBriOJoJg= file: - artifacts/exasol-cloud-storage-extension-${JAR_VERSION}.jar - artifacts/checksum.sha256.txt skip_cleanup: true on: - repo: exasol/cloud-storage-etl-udfs + repo: exasol/cloud-storage-extension tags: true condition: $RELEASE = true && $TRAVIS_TAG =~ ^[0-9]+\.[0-9]+\.[0-9]+(-rc[0-9]+)?$ diff --git a/AUTHORS.md b/AUTHORS.md index f2b4abca..609ef30c 100644 --- a/AUTHORS.md +++ b/AUTHORS.md @@ -15,4 +15,4 @@ These are the people whose contributions have made the project possible: * Hari Nair (CommScope) -[contributors]: https://github.com/exasol/cloud-storage-etl-udfs/graphs/contributors +[contributors]: https://github.com/exasol/cloud-storage-extension/graphs/contributors diff --git a/README.md b/README.md index be354088..19791a10 100644 --- a/README.md +++ b/README.md @@ -89,12 +89,12 @@ These plugins help with project development. | [SBT Explicit Dependencies][sbt-expdep-link]| Checks which direct libraries required to compile your code | Apache License 2.0 | | [SBT Git][sbt-git-link] | A plugin for Git integration, used to version the release jars | BSD 2-Clause License | -[travis-badge]: https://img.shields.io/travis/exasol/cloud-storage-etl-udfs/master.svg?logo=travis -[travis-link]: https://travis-ci.com/exasol/cloud-storage-etl-udfs -[coveralls-badge]: https://img.shields.io/coveralls/exasol/cloud-storage-etl-udfs.svg -[coveralls-link]: https://coveralls.io/github/exasol/cloud-storage-etl-udfs -[gh-release-badge]: https://img.shields.io/github/release/exasol/cloud-storage-etl-udfs.svg?logo=github -[gh-release-link]: https://github.com/exasol/cloud-storage-etl-udfs/releases/latest +[travis-badge]: https://img.shields.io/travis/exasol/cloud-storage-extension/master.svg?logo=travis +[travis-link]: https://travis-ci.com/exasol/cloud-storage-extension +[coveralls-badge]: https://img.shields.io/coveralls/exasol/cloud-storage-extension.svg +[coveralls-link]: https://coveralls.io/github/exasol/cloud-storage-extension +[gh-release-badge]: https://img.shields.io/github/release/exasol/cloud-storage-extension.svg?logo=github +[gh-release-link]: https://github.com/exasol/cloud-storage-extension/releases/latest [exasol]: https://www.exasol.com/en/ [avro]: https://avro.apache.org/ [orc]: https://orc.apache.org/ diff --git a/doc/changes/changelog.md b/doc/changes/changelog.md index ea2d474c..59fc918c 100644 --- a/doc/changes/changelog.md +++ b/doc/changes/changelog.md @@ -8,69 +8,69 @@ > 2020 MAY 25 * Adds `OVERWRITE` user parameter to be used with Export UDF. - [#36](https://github.com/exasol/cloud-storage-etl-udfs/issues/36) - [#81](https://github.com/exasol/cloud-storage-etl-udfs/pull/81) + [#36](https://github.com/exasol/cloud-storage-extension/issues/36) + [#81](https://github.com/exasol/cloud-storage-extension/pull/81) * Adds compression codec as an additional extension to the exported file. - [#82](https://github.com/exasol/cloud-storage-etl-udfs/issues/82) - [#83](https://github.com/exasol/cloud-storage-etl-udfs/pull/83) + [#82](https://github.com/exasol/cloud-storage-extension/issues/82) + [#83](https://github.com/exasol/cloud-storage-extension/pull/83) ## v0.7.0 > 2020 MAR 27 * Adds import JSON formatted data from AWS Kinesis Streams. - [#74](https://github.com/exasol/cloud-storage-etl-udfs/issues/74) - [#77](https://github.com/exasol/cloud-storage-etl-udfs/pull/77) + [#74](https://github.com/exasol/cloud-storage-extension/issues/74) + [#77](https://github.com/exasol/cloud-storage-extension/pull/77) ## v0.6.2 > 2020 MAR 16 * Adds Delta Lake format import integration. - [#31](https://github.com/exasol/cloud-storage-etl-udfs/issues/31) - [#78](https://github.com/exasol/cloud-storage-etl-udfs/pull/78) + [#31](https://github.com/exasol/cloud-storage-extension/issues/31) + [#78](https://github.com/exasol/cloud-storage-extension/pull/78) * Adds initial system requirements document for the upcoming Amazon Kinesis Connector. - [#72](https://github.com/exasol/cloud-storage-etl-udfs/issues/72) - [#73](https://github.com/exasol/cloud-storage-etl-udfs/pull/73) + [#72](https://github.com/exasol/cloud-storage-extension/issues/72) + [#73](https://github.com/exasol/cloud-storage-extension/pull/73) * Improve the user guide document with an additional Exasol connection object usage example. - [#66](https://github.com/exasol/cloud-storage-etl-udfs/issues/66) - [#76](https://github.com/exasol/cloud-storage-etl-udfs/pull/76) + [#66](https://github.com/exasol/cloud-storage-extension/issues/66) + [#76](https://github.com/exasol/cloud-storage-extension/pull/76) * Updated dependencies to make the project run with IntelliJ IDEA. - [#70](https://github.com/exasol/cloud-storage-etl-udfs/issues/70) - [#71](https://github.com/exasol/cloud-storage-etl-udfs/pull/71) + [#70](https://github.com/exasol/cloud-storage-extension/issues/70) + [#71](https://github.com/exasol/cloud-storage-extension/pull/71) ## v0.6.1 > 2020 FEB 17 * Add Azure Data Lake Gen2 Storage support. - [#58](https://github.com/exasol/cloud-storage-etl-udfs/issues/58) - [#69](https://github.com/exasol/cloud-storage-etl-udfs/pull/69) + [#58](https://github.com/exasol/cloud-storage-extension/issues/58) + [#69](https://github.com/exasol/cloud-storage-extension/pull/69) * Fixes a bug with regex pattern matching on the paths. - [#65](https://github.com/exasol/cloud-storage-etl-udfs/issues/65) - [#67](https://github.com/exasol/cloud-storage-etl-udfs/pull/67) + [#65](https://github.com/exasol/cloud-storage-extension/issues/65) + [#67](https://github.com/exasol/cloud-storage-extension/pull/67) * Adds list of dependencies with their licenses to the README.md. - [#63](https://github.com/exasol/cloud-storage-etl-udfs/issues/63) - [#64](https://github.com/exasol/cloud-storage-etl-udfs/pull/64) + [#63](https://github.com/exasol/cloud-storage-extension/issues/63) + [#64](https://github.com/exasol/cloud-storage-extension/pull/64) * Refactors code linting and styling checks. - [#51](https://github.com/exasol/cloud-storage-etl-udfs/issues/51) - [#62](https://github.com/exasol/cloud-storage-etl-udfs/pull/62) + [#51](https://github.com/exasol/cloud-storage-extension/issues/51) + [#62](https://github.com/exasol/cloud-storage-extension/pull/62) * Adds a logo to the project. - [#60](https://github.com/exasol/cloud-storage-etl-udfs/pull/60) + [#60](https://github.com/exasol/cloud-storage-extension/pull/60) * Fixes bug related to BigDecimal. - [#56](https://github.com/exasol/cloud-storage-etl-udfs/issues/56) - [#57](https://github.com/exasol/cloud-storage-etl-udfs/pull/57) + [#56](https://github.com/exasol/cloud-storage-extension/issues/56) + [#57](https://github.com/exasol/cloud-storage-extension/pull/57) ## v0.6.0 @@ -79,151 +79,151 @@ * Improves Azure Blob Storage parameters, do not enforce requirement of `AZURE_ACCOUNT_NAME` and `AZURE_CONTAINER_NAME` properties since they are available in the path. - [#50](https://github.com/exasol/cloud-storage-etl-udfs/issues/50) - [#55](https://github.com/exasol/cloud-storage-etl-udfs/pull/55) + [#50](https://github.com/exasol/cloud-storage-extension/issues/50) + [#55](https://github.com/exasol/cloud-storage-extension/pull/55) * Adds support for Exasol named connection object - [#24](https://github.com/exasol/cloud-storage-etl-udfs/issues/24) - [#54](https://github.com/exasol/cloud-storage-etl-udfs/pull/54) + [#24](https://github.com/exasol/cloud-storage-extension/issues/24) + [#54](https://github.com/exasol/cloud-storage-extension/pull/54) * Fixes bug when importing Parquet `INT64 (TIMESTAMP_MILLIS)` type values. - [#52](https://github.com/exasol/cloud-storage-etl-udfs/issues/52) - [#53](https://github.com/exasol/cloud-storage-etl-udfs/pull/53) + [#52](https://github.com/exasol/cloud-storage-extension/issues/52) + [#53](https://github.com/exasol/cloud-storage-extension/pull/53) ## v0.5.0 > 2019 OCT 31 :jack_o_lantern: * Adds Apache Kafka consumer UDF to import Avro formatted data from Kafka - clusters. [#40](https://github.com/exasol/cloud-storage-etl-udfs/issues/40) - [#39](https://github.com/exasol/cloud-storage-etl-udfs/pull/39) - [#48](https://github.com/exasol/cloud-storage-etl-udfs/pull/48) + clusters. [#40](https://github.com/exasol/cloud-storage-extension/issues/40) + [#39](https://github.com/exasol/cloud-storage-extension/pull/39) + [#48](https://github.com/exasol/cloud-storage-extension/pull/48) * Adds several new Kafka consumer settings as user provided UDF parameters. - [#41](https://github.com/exasol/cloud-storage-etl-udfs/issues/41) - [#43](https://github.com/exasol/cloud-storage-etl-udfs/pull/43) + [#41](https://github.com/exasol/cloud-storage-extension/issues/41) + [#43](https://github.com/exasol/cloud-storage-extension/pull/43) * Refactors the UDF user properties handling in order to make more robust and - maintainable. [#46](https://github.com/exasol/cloud-storage-etl-udfs/pull/46) + maintainable. [#46](https://github.com/exasol/cloud-storage-extension/pull/46) * Reworks the documentation to incorporate the new Kafka import changes. - [#45](https://github.com/exasol/cloud-storage-etl-udfs/issues/45) - [#47](https://github.com/exasol/cloud-storage-etl-udfs/pull/47) + [#45](https://github.com/exasol/cloud-storage-extension/issues/45) + [#47](https://github.com/exasol/cloud-storage-extension/pull/47) ## v0.4.4 > 2019 OCT 27 * Adds Shared Access Signature (SAS) token authentication when using Azure Blob - Storage. [#42](https://github.com/exasol/cloud-storage-etl-udfs/issues/42) - [#44](https://github.com/exasol/cloud-storage-etl-udfs/pull/44) + Storage. [#42](https://github.com/exasol/cloud-storage-extension/issues/42) + [#44](https://github.com/exasol/cloud-storage-extension/pull/44) ## v0.4.3 > 2019 JUL 01 * Deserialize Orc BYTE format as a Long value. - [#33](https://github.com/exasol/cloud-storage-etl-udfs/issues/33) - [#38](https://github.com/exasol/cloud-storage-etl-udfs/pull/38) + [#33](https://github.com/exasol/cloud-storage-extension/issues/33) + [#38](https://github.com/exasol/cloud-storage-extension/pull/38) * Improve import process. - [#34](https://github.com/exasol/cloud-storage-etl-udfs/issues/34) - [#38](https://github.com/exasol/cloud-storage-etl-udfs/pull/38) + [#34](https://github.com/exasol/cloud-storage-extension/issues/34) + [#38](https://github.com/exasol/cloud-storage-extension/pull/38) ## v0.4.2 > 2019 MAY 28 * Adds batch size parameter for export that helps exporting large tables. - [#28](https://github.com/exasol/cloud-storage-etl-udfs/issues/28) - [#32](https://github.com/exasol/cloud-storage-etl-udfs/pull/32) + [#28](https://github.com/exasol/cloud-storage-extension/issues/28) + [#32](https://github.com/exasol/cloud-storage-extension/pull/32) * Applied some refactoring. - [#29](https://github.com/exasol/cloud-storage-etl-udfs/pull/29) + [#29](https://github.com/exasol/cloud-storage-extension/pull/29) ## v0.4.1 > 2019 APR 15 * Adds support for Azure Data Lake (Gen1) Storage. - [#22](https://github.com/exasol/cloud-storage-etl-udfs/issues/22) - [#25](https://github.com/exasol/cloud-storage-etl-udfs/pull/25) + [#22](https://github.com/exasol/cloud-storage-extension/issues/22) + [#25](https://github.com/exasol/cloud-storage-extension/pull/25) * Support ORC formatted data import. - [#23](https://github.com/exasol/cloud-storage-etl-udfs/issues/23) - [#26](https://github.com/exasol/cloud-storage-etl-udfs/pull/26) + [#23](https://github.com/exasol/cloud-storage-extension/issues/23) + [#26](https://github.com/exasol/cloud-storage-extension/pull/26) ## v0.4.0 > 2019 MAR 21 * Add Avro format import support. - [#18](https://github.com/exasol/cloud-storage-etl-udfs/issues/18) - [#21](https://github.com/exasol/cloud-storage-etl-udfs/pull/21) + [#18](https://github.com/exasol/cloud-storage-extension/issues/18) + [#21](https://github.com/exasol/cloud-storage-extension/pull/21) ## v0.3.1 > 2019 MAR 08 * Adds Google Cloud Storage and Azure Blob Storage export as Parquet format. - [#17](https://github.com/exasol/cloud-storage-etl-udfs/issues/17) - [#20](https://github.com/exasol/cloud-storage-etl-udfs/pull/20) + [#17](https://github.com/exasol/cloud-storage-extension/issues/17) + [#20](https://github.com/exasol/cloud-storage-extension/pull/20) ## v0.3.0 > 2019 FEB 12 * Adds feature to export Exasol tables into AWS S3 as Parquet format. - [#14](https://github.com/exasol/cloud-storage-etl-udfs/issues/14) - [#16](https://github.com/exasol/cloud-storage-etl-udfs/pull/16) + [#14](https://github.com/exasol/cloud-storage-extension/issues/14) + [#16](https://github.com/exasol/cloud-storage-extension/pull/16) * Imports date and timestamp values correctly into Exasol. - [#14](https://github.com/exasol/cloud-storage-etl-udfs/issues/14) - [#16](https://github.com/exasol/cloud-storage-etl-udfs/pull/16) + [#14](https://github.com/exasol/cloud-storage-extension/issues/14) + [#16](https://github.com/exasol/cloud-storage-extension/pull/16) ## v0.2.2 > 2018 DEC 13 * Update Hadoop, Exasol Jdbc and Scala versions. - [#13](https://github.com/exasol/cloud-storage-etl-udfs/pull/13) + [#13](https://github.com/exasol/cloud-storage-extension/pull/13) * Fixes issue. - [#12](https://github.com/exasol/cloud-storage-etl-udfs/issues/12) + [#12](https://github.com/exasol/cloud-storage-extension/issues/12) ## v0.2.1 > 2018 DEC 06 * Add initial Azure Blob Store import support. - [#10](https://github.com/exasol/cloud-storage-etl-udfs/pull/10) + [#10](https://github.com/exasol/cloud-storage-extension/pull/10) ## v0.2.0 > 2018 DEC 05 * Add initial Google Compute Storage (GCS) import functionality. - [#9](https://github.com/exasol/cloud-storage-etl-udfs/pull/9) + [#9](https://github.com/exasol/cloud-storage-extension/pull/9) ## v0.1.1 > 2018 NOV 28 * Added AWS S3 endpoint as a parameter. - [#8](https://github.com/exasol/cloud-storage-etl-udfs/pull/8) + [#8](https://github.com/exasol/cloud-storage-extension/pull/8) ## v0.1.0 > 2018 NOV 27 * Add Travis based automated build. - [#3](https://github.com/exasol/cloud-storage-etl-udfs/pull/3) + [#3](https://github.com/exasol/cloud-storage-extension/pull/3) * Renamed packages and external files to more generic cloudetl from s3etl. - [#4](https://github.com/exasol/cloud-storage-etl-udfs/pull/4) + [#4](https://github.com/exasol/cloud-storage-extension/pull/4) * Added automated Github release when a tag is pushed. - [#5](https://github.com/exasol/cloud-storage-etl-udfs/pull/5) + [#5](https://github.com/exasol/cloud-storage-extension/pull/5) ## v0.0.1 diff --git a/doc/changes/changes_0.8.0.md b/doc/changes/changes_0.8.0.md index fe699f87..c0ec4d12 100644 --- a/doc/changes/changes_0.8.0.md +++ b/doc/changes/changes_0.8.0.md @@ -18,10 +18,10 @@ connector, added support for connection object in Kafka connector. ## Features -* [#84](https://github.com/exasol/cloud-storage-etl-udfs/issues/84): Changed to multi module setup repository (PR [#85](https://github.com/exasol/cloud-storage-etl-udfs/pull/85)). -* [#87](https://github.com/exasol/cloud-storage-etl-udfs/issues/87): Added nested data support for Kinesis connector (PR [#88](https://github.com/exasol/cloud-storage-etl-udfs/pull/88)). -* Added support for connection object in Kafka connector (PR [#90](https://github.com/exasol/cloud-storage-etl-udfs/pull/90)). -* Added checks for keystore and truststore files in Kafka connector (PR [#92](https://github.com/exasol/cloud-storage-etl-udfs/pull/92)). +* [#84](https://github.com/exasol/cloud-storage-extension/issues/84): Changed to multi module setup repository (PR [#85](https://github.com/exasol/cloud-storage-extension/pull/85)). +* [#87](https://github.com/exasol/cloud-storage-extension/issues/87): Added nested data support for Kinesis connector (PR [#88](https://github.com/exasol/cloud-storage-extension/pull/88)). +* Added support for connection object in Kafka connector (PR [#90](https://github.com/exasol/cloud-storage-extension/pull/90)). +* Added checks for keystore and truststore files in Kafka connector (PR [#92](https://github.com/exasol/cloud-storage-extension/pull/92)). ## Dependency Updates diff --git a/doc/changes/changes_0.9.0.md b/doc/changes/changes_0.9.0.md index eb7fc58f..109ae385 100644 --- a/doc/changes/changes_0.9.0.md +++ b/doc/changes/changes_0.9.0.md @@ -4,11 +4,12 @@ ## Features -* [#98](https://github.com/exasol/cloud-storage-etl-udfs/issues/98): Removed Kafka and Kinesis modules (PR [#99](https://github.com/exasol/cloud-storage-etl-udfs/pull/99)). +* [#98](https://github.com/exasol/cloud-storage-extension/issues/98): Removed Kafka and Kinesis modules (PR [#99](https://github.com/exasol/cloud-storage-extension/pull/99)). ## Documentation -* [#97](https://github.com/exasol/cloud-storage-etl-udfs/issues/97): Updated Documentation (PR [#101](https://github.com/exasol/cloud-storage-etl-udfs/pull/101)). +* [#97](https://github.com/exasol/cloud-storage-extension/issues/97): Updated Documentation (PR [#101](https://github.com/exasol/cloud-storage-extension/pull/101)). +* [#100](https://github.com/exasol/cloud-storage-extension/issues/100): Updated Documentation (PR [#102](https://github.com/exasol/cloud-storage-extension/pull/102)). ## Dependency Updates