Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OrionSTHSink #19

Closed
fgalan opened this issue Mar 11, 2014 · 5 comments
Closed

OrionSTHSink #19

fgalan opened this issue Mar 11, 2014 · 5 comments
Assignees
Labels
Milestone

Comments

@fgalan
Copy link
Member

fgalan commented Mar 11, 2014

Implement another sink for MongoDB and test it along with the Cosmos sink, e.g. run the program with 2 sinks activated and check that when a notifyContextRequest arrives it is persisted in both places, check if Flume can implement "all or nothing" semantics (i.e. if one of the sinks is offline, for instance the connection to MongoDB is broken, then the notifyContextRequest is not persisted in Cosmos), etc.

@fgalan fgalan self-assigned this Mar 11, 2014
@fgalan fgalan changed the title orion2mongo Flume component orion2mongo sink Jul 30, 2014
@fgalan fgalan added the backlog label Jul 30, 2014
@frbattid
Copy link
Member

An already developed MongoDB sink for Flume: https://github.com/leonlee/flume-ng-mongodb-sink

Referenced from Flume official wiki (https://cwiki.apache.org/confluence/display/FLUME/Flume+NG+Plugins)

@frbattid frbattid added this to the release/0.7.0 milestone Feb 5, 2015
@frbattid
Copy link
Member

frbattid commented Feb 5, 2015

I've changed the name of this issue to "OrionSTHSink" since it is clear that a sink for the Short-Term Historic of Orion CB has to be created; independently of the underlying technology used for that (Mongo, LevelDB, InfluxDB, Open TSDB, flat files... who knows :)).

@frbattid frbattid changed the title orion2mongo sink OrionSTHSink Feb 5, 2015
@fgalan
Copy link
Member Author

fgalan commented Feb 5, 2015

However, if the technology to implement STH is not MongoDB, an issue about "OrionMongoSink" will still making sense (not sure if this one remaned back or a different new one). Have been the STH technology chosen?

@frbattid
Copy link
Member

frbattid commented Feb 5, 2015

It has not been chosen, really. But the idea behind the original "orion2mongo sink" was to suppert the STH,thus I though it was better to rename it... Nevertheless, I agree maybe in the future a OrionMongoSink issue is necessary if we want to mimic the behaviour of OrionHDFSSink in a Mongo-based fashion... well, I do not know what to do now :)

@gtorodelvalle
Copy link
Member

Implemented in #377 ;)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants