Skip to content

SAMZA-2166: [Scala cleanup] Convert StorageConfig.scala to Java #996

Merged
cameronlee314 merged 8 commits into
apache:masterfrom
cameronlee314:storage_config_scala
May 8, 2019
Merged

SAMZA-2166: [Scala cleanup] Convert StorageConfig.scala to Java #996
cameronlee314 merged 8 commits into
apache:masterfrom
cameronlee314:storage_config_scala

Conversation

@cameronlee314
Copy link
Copy Markdown
Contributor

@cameronlee314 cameronlee314 commented Apr 16, 2019

It might be easier to view this PR by looking at individual commits. The commit a34e320 contains the change to just remove StorageConfig.scala and replace with JavaStorageConfig.java. The next commit 501ae36 does a rename from JavaStorageConfig.java to StorageConfig.java, since StorageConfig.scala was removed.

Note: This also seems to fix a bug in BaseKeyValueStorageEngineFactory which involved reading the access log sample ratio config. Previously, the config being passed in to BaseKeyValueStorageEngineFactory was stripped of the stores.<store name>. prefix, but it was implicitly converted into a StorageConfig, so when getAccessLogSamplingRatio was called, it seems like it would never actually find the full stores.<store name>.accesslog.sampling.ratio. This meant it always fell back to the default value.

Comment thread samza-kv/src/main/scala/org/apache/samza/storage/kv/AccessLoggedStore.scala Outdated
Comment thread samza-core/src/main/java/org/apache/samza/config/StorageConfig.java Outdated
Comment thread samza-core/src/main/java/org/apache/samza/config/StorageConfig.java Outdated
Comment thread samza-core/src/main/java/org/apache/samza/config/StorageConfig.java
Comment thread samza-core/src/main/java/org/apache/samza/config/StorageConfig.java Outdated
Comment thread samza-core/src/main/java/org/apache/samza/config/StorageConfig.java Outdated
Comment thread samza-core/src/main/java/org/apache/samza/config/StorageConfig.java
Comment thread samza-core/src/main/scala/org/apache/samza/container/SamzaContainer.scala Outdated
Comment thread samza-core/src/main/java/org/apache/samza/config/StorageConfig.java
@cameronlee314 cameronlee314 merged commit 22b8b3b into apache:master May 8, 2019
prateekm pushed a commit to prateekm/samza that referenced this pull request May 12, 2019
…che#996)

* SAMZA-2166: [Scala cleanup] Convert StorageConfig.scala to Java

* rename JavaStorageConfig to StorageConfig

* consolidate usage of key and msg serde access in ContainerStorageManager

* improve javadocs for optional instead of null; clean up StorageConfig constants
@cameronlee314 cameronlee314 deleted the storage_config_scala branch October 4, 2019 21:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants