Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

STORM-2416: Release Packaging Improvements #2017

Closed
wants to merge 1,319 commits into from
Closed

Conversation

ptgoetz
Copy link
Member

@ptgoetz ptgoetz commented Mar 17, 2017

This reduces the size of the binary distribution from > 200MB to ~79MB.

Wissman, Matthew and others added 30 commits January 3, 2017 23:14
* Dropping aggregate & join support based on discussion
  * also addresses documentation
* These implementation will be reused when we introduce them again
…s nothing to do with mine so switching it back to 10 minutes which should be sufficient
* use user's maven local repository if possible
* if it's not available, just use 'local-repo' (it will be created if not exists)
* use JSONValue.parse() instead of JSONValue.parseWithException() in TransactionState
  * this just rolls back to previous, doesn't provide better approach
lukess and others added 29 commits March 9, 2017 19:38
…Partitions When Parallelism Hint Not a Multiple Total Topic-Partitions

 - Introduce logic to poll data from the topic partitions assigned to each  task
While using local FS blob store, nimbus goes into a state where it indefinitely waits for max replication (with max replication wait time set to -1). At this time its also observed that the nimbus that received the topology submission is no longer the leader.
While waiting for max replication, nimbus can also do the `isLeader` check and fail the topology submission if its no longer the leader.

Also added some debug logs to better troubleshoot the race conditions when it happens.
   - Created factory to create ModelRunner and ModelOutputs from Blobstore
   - Updated example topology to support loading PMML model from file and from Blobstore
…cubator-storm into STORM-2038

STORM-2038: No symlinks for local cluster
@ptgoetz ptgoetz closed this Mar 17, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.