New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SPOT-226. [Ingest] StreamSets pipeline configurations for ODM ingest #117

Closed
wants to merge 231 commits into
base: SPOT-181_ODM
from

Conversation

Projects
None yet
@jnatkins

jnatkins commented Sep 21, 2017

This will add StreamSets pipeline configurations for Qualys APIs, Centrify Identity Platform events, and Windows Events.

daortizh and others added some commits Feb 15, 2017

Changed FEEDBACK_PATH to be HPATH/feedbac/ml_feedback.csv. Upated ml_…
…test.sh.

Also, there was a bug in FlowFeedback.scala, while creating a new data frame using ModelSchema as the schema was causing a can't cast String to Int issue due to source port and destination port were strings but shema was expecting int.
query.py now has a new query who resolves details about threats (#1)
* query.py now has a new query who resolves details about threats
@raypanduro

This comment has been minimized.

Show comment
Hide comment
@raypanduro

raypanduro Sep 21, 2017

Contributor

If this PR is related to ODM, please submit this PR to ODM topic branch https://github.com/apache/incubator-spot/tree/SPOT-181_ODM

Contributor

raypanduro commented Sep 21, 2017

If this PR is related to ODM, please submit this PR to ODM topic branch https://github.com/apache/incubator-spot/tree/SPOT-181_ODM

@jnatkins jnatkins changed the base branch from master to SPOT-181_ODM Sep 21, 2017

@jnatkins

This comment has been minimized.

Show comment
Hide comment
@jnatkins

jnatkins Sep 21, 2017

Sorry about that! I've re-targeted this PR against the SPOT-181_ODM branch.

jnatkins commented Sep 21, 2017

Sorry about that! I've re-targeted this PR against the SPOT-181_ODM branch.

@jnatkins

This comment has been minimized.

Show comment
Hide comment
@jnatkins

jnatkins Sep 21, 2017

In an effort to provide some more visibility into the logic here, I'm attaching screenshots of the pipelines as they would be imported into the SDC. They're all parameterized, so that they can be started using filled-in variables relevant to the Spot environment.

screen shot 2017-09-21 at 11 12 17 am

screen shot 2017-09-21 at 11 12 36 am

screen shot 2017-09-21 at 11 12 49 am

screen shot 2017-09-21 at 11 13 05 am

screen shot 2017-09-21 at 11 13 41 am

jnatkins commented Sep 21, 2017

In an effort to provide some more visibility into the logic here, I'm attaching screenshots of the pipelines as they would be imported into the SDC. They're all parameterized, so that they can be started using filled-in variables relevant to the Spot environment.

screen shot 2017-09-21 at 11 12 17 am

screen shot 2017-09-21 at 11 12 36 am

screen shot 2017-09-21 at 11 12 49 am

screen shot 2017-09-21 at 11 13 05 am

screen shot 2017-09-21 at 11 13 41 am

@jnatkins

This comment has been minimized.

Show comment
Hide comment
@jnatkins

jnatkins Sep 21, 2017

Abandoning this PR in favor of a new one that is correctly rebased

jnatkins commented Sep 21, 2017

Abandoning this PR in favor of a new one that is correctly rebased

@jnatkins jnatkins closed this Sep 21, 2017

@sganderson

This comment has been minimized.

Show comment
Hide comment
@sganderson

sganderson Oct 16, 2017

Still not saving for me any hint??

sganderson commented on 1e9833e Oct 16, 2017

Still not saving for me any hint??

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment