Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[v0.7.0] Redisgn Data Generator and External Kafka Source Support #131

Merged
merged 7 commits into from
Dec 11, 2019
Merged

[v0.7.0] Redisgn Data Generator and External Kafka Source Support #131

merged 7 commits into from
Dec 11, 2019

Conversation

ale93p
Copy link
Owner

@ale93p ale93p commented Dec 11, 2019

PR Description

This PR adds to the main release the current upgrades:

  • Improved Data Generator Component
  • Support for Kafka as External Data Source for Storm and Flink.

Usage Example

Closing issues

Closes #78

@ale93p
Improved Data Generator (#126)
dbcc4b9 
* Integrated index generation in DataGenerator; fix #119

* [Storm] Implemented new DataGenerator

* [v0.6.1-dev] bump development version

* [Flink] Implemented new data generator

* [Storm] Implemented new data generator

* [Flink] Implemented new data generator

* [All] Fixed conversion from bytes to string

* [All] Cleaned code
@ale93p
Update README.md
c6b97ac
@ale93p
Fixed variable naming issue
282daef
@ale93p
Fixed DataGenerator null pointer exception
371af33
@ale93p
Sobstituded with correct conf file
c22aed5
@ale93p
Merge branch 'master' into development
def8f66
@ale93p
[v0.7.0] External Source Support: Kafka (#130)
0da946e 
* Added external Kafka Source with basic configurations (curr. only workflow schema)

* Fix: added control for shape and external source

* Added external Kafka Source also for Pipeline Schema

* Added debugging output in source

* cleaned code

* [v0.7.0] External Source Support: Kafka
@ale93p ale93p added Type: Enhancement Improvement of existing feature Priority: High The issue must be solved as soon as possible Type: Feature New feature or request Platform: Storm The issue is related to the Storm benchmark application Platform: Flink The issue is related to the Flink benchmark application Platform: All The issue is related to all the applications labels Dec 11, 2019
@ale93p ale93p merged commit b6eebb8 into master Dec 11, 2019
@ale93p ale93p deleted the development branch December 11, 2019 23:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
Platform: All The issue is related to all the applications Platform: Flink The issue is related to the Flink benchmark application Platform: Storm The issue is related to the Storm benchmark application Priority: High The issue must be solved as soon as possible Type: Enhancement Improvement of existing feature Type: Feature New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Feature: Add external data source (Kafka)
1 participant
@ale93p