Add support for writing to Exasol using S3 as intermediate #160
Assignees
Labels
feature
Product feature
Comments
morazow
added a commit
that referenced
this issue
May 23, 2023
morazow
added a commit
that referenced
this issue
May 24, 2023
morazow
added a commit
that referenced
this issue
May 24, 2023
morazow
added a commit
that referenced
this issue
May 25, 2023
morazow
added a commit
that referenced
this issue
May 25, 2023
morazow
added a commit
that referenced
this issue
Jul 14, 2023
* #150: Added S3 intermediate storage layer (#152) Co-authored-by: Christoph Pirkl <christoph.pirkl@exasol.com> * #149: Added s3 import query generator and runner (#156) Fixes #149 Co-authored-by: Christoph Kuhnke <github@kuhnke.net> Co-authored-by: KK <christoph.kuhnke@exasol.com> * #160: Add support for writing to Exasol database using S3 as intermediate storage (#161) Fixes #160 * Address review suggestion from @tkilias * #159: Added cleanup process to remove intermediate data after job finish (#165) Fixes #159 --------- Co-authored-by: Christoph Kuhnke <github@kuhnke.net> Co-authored-by: KK <christoph.kuhnke@exasol.com> * #158: Refactored options class (#167) Fixes #158 --------- Co-authored-by: Torsten Kilias <tkilias@users.noreply.github.com> * #168: Refactored to add module setup (#170) Fixes #168 * #171: Refactored artifact packaging and releasing process for module setup (#173) --------- Co-authored-by: Sebastian Bär <sebastian.baer@exasol.com> * #174: Refactored GitHub workflow actions (#175) Fixes #175 * #176: Fixed sha256sum files upload bug (#179) * #155: Refactored to unify user parameters (#178) Fixes #155 --------- Co-authored-by: Christoph Pirkl <christoph.pirkl@exasol.com> * #164: Added validation check before writing to intermediate location (#180) Fixes #164 --------- Co-authored-by: Christoph Pirkl <christoph.pirkl@exasol.com> * #162: Updated developer guide with staged commit behaviour (#182) Fixes #162 --------- Co-authored-by: Christoph Pirkl <christoph.pirkl@exasol.com> * #183: Updated user guide to include latest changes (#184) Fixes #183 --------- Co-authored-by: Christoph Pirkl <christoph.pirkl@exasol.com> * Updated version to `2.0.0` (#185) * Changed version * Improved default options * Updated changes and user guide docs --------- Co-authored-by: Christoph Pirkl <christoph.pirkl@exasol.com> Co-authored-by: Christoph Kuhnke <github@kuhnke.net> Co-authored-by: KK <christoph.kuhnke@exasol.com> Co-authored-by: Torsten Kilias <tkilias@users.noreply.github.com> Co-authored-by: Sebastian Bär <sebastian.baer@exasol.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Situation
We should be able to write from Spark into Exasol table using intermediate storage layer.
Acceptance Criteria
The text was updated successfully, but these errors were encountered: