Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[v0.7.0] External Source Support: Kafka #130

Merged
merged 6 commits into from
Dec 11, 2019
Merged

[v0.7.0] External Source Support: Kafka #130

merged 6 commits into from
Dec 11, 2019

Conversation

ale93p
Copy link
Owner

@ale93p ale93p commented Dec 11, 2019

PR Description

This PR adds the support for an external data source: Kafka.

The support is added for: Storm, Flink.

Usage Example

Closing issues

Closes #78

@ale93p ale93p added Type: Feature New feature or request Priority: Critical The issue is a blocker Platform: Storm The issue is related to the Storm benchmark application Platform: Flink The issue is related to the Flink benchmark application labels Dec 11, 2019
@ale93p ale93p changed the base branch from master to development December 11, 2019 23:17
@ale93p ale93p merged commit 0da946e into development Dec 11, 2019
ale93p added a commit that referenced this pull request Dec 11, 2019
* Improved Data Generator (#126)

* Integrated index generation in DataGenerator; fix #119

* [Storm] Implemented new DataGenerator

* [v0.6.1-dev] bump development version

* [Flink] Implemented new data generator

* [Storm] Implemented new data generator

* [Flink] Implemented new data generator

* [All] Fixed conversion from bytes to string

* [All] Cleaned code

* Update README.md

* Fixed variable naming issue

* Fixed DataGenerator null pointer exception

* Sobstituded with correct conf file

* [v0.7.0] External Source Support: Kafka (#130)

* Added external Kafka Source with basic configurations (curr. only workflow schema)

* Fix: added control for shape and external source

* Added external Kafka Source also for Pipeline Schema

* Added debugging output in source

* cleaned code

* [v0.7.0] External Source Support: Kafka
@ale93p ale93p deleted the kafka-support branch December 11, 2019 23:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Platform: Flink The issue is related to the Flink benchmark application Platform: Storm The issue is related to the Storm benchmark application Priority: Critical The issue is a blocker Type: Feature New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant