Skip to content

Commit

Permalink
馃悶 Destination databricks: fix destination config (#12299)
Browse files Browse the repository at this point in the history
* Fix databricks dest config

* Add private constructor for constant class
  • Loading branch information
tuliren authored and suhomud committed May 23, 2022
1 parent 9c00492 commit 0e6561d
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,7 @@ public class DatabricksConstants {
"delta.autoOptimize.optimizeWrite = true",
"delta.autoOptimize.autoCompact = true");

private DatabricksConstants() {
}

}
Original file line number Diff line number Diff line change
Expand Up @@ -63,6 +63,9 @@ public static S3DestinationConfig getDataSource(final JsonNode dataSource) {
dataSource.get("s3_bucket_name").asText(),
dataSource.get("s3_bucket_path").asText(),
dataSource.get("s3_bucket_region").asText())
.withAccessKeyCredential(
dataSource.get("s3_access_key_id").asText(),
dataSource.get("s3_secret_access_key").asText())
.withFormatConfig(new S3ParquetFormatConfig(new ObjectMapper().createObjectNode()))
.get();
}
Expand Down

0 comments on commit 0e6561d

Please sign in to comment.