Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for writing raw JSONs #26

Closed
alexanderdean opened this issue Jul 3, 2017 · 2 comments
Closed

Add support for writing raw JSONs #26

alexanderdean opened this issue Jul 3, 2017 · 2 comments
Assignees

Comments

@alexanderdean
Copy link
Member

This would enable Snowplow ES Loader to go beyond pure-Snowplow usecases (similar to how Kinesis S3 already does).

This has a few advantages:

  • Increases the utility of the Snowplow Elasticsearch Loader
  • Increases the number of possible contributors to this project
  • Allows us (Snowplow) to use this for getting customers' non-Snowplow JSON data into Elasticsearch, alongside their Snowplow events
@alexanderdean
Copy link
Member Author

Let's get an estimate (in due course) for the scale of this work before deciding when to schedule...

@alexanderdean alexanderdean added this to the Version 0.10.0 milestone Jul 21, 2017
@alexanderdean
Copy link
Member Author

Let's do this in the next release.

@BenFradet can you suggest an extension to the existing configuration format for this ticket? So the options we want to support are:

  1. The source stream is a Snowplow enriched event stream
  2. The source stream is a Snowplow bad rows stream
  3. The source stream is plain JSON

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants