Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training Data does not contain attack labeled examples #4

Open
llamandtea opened this issue Jul 19, 2021 · 2 comments
Open

Training Data does not contain attack labeled examples #4

llamandtea opened this issue Jul 19, 2021 · 2 comments

Comments

@llamandtea
Copy link

The three training data files,

  • train1.csv
  • train2.csv
  • train3.csv
    in the latest version of the dataset (I have not controlled the 20.07 verision) only contain examples labeled as normal in the last four rows. Attacks seem to exist in the testing portion of the dataset, but I don't think the current proposed splits are useful for learning tasks targeting attack columns (I have not checked the single timestamps with the attacks present in the documentation- maybe they have not been correctly labeled as such?).
@zaroosin
Copy link
Contributor

zaroosin commented Aug 3, 2021

Our assumption is that "training data can only be collected during normal operation".
Therefore, there is no attack data in the training data in the HAI dataset.
Anomaly detection with HAI datasets can use unsupervised learning
(or semi-supervised learning, assuming that the training data are all normal).

@llamandtea
Copy link
Author

I did not notice the assumption you mentioned, thank you for the explanation. I see how the splits are suited for unsupervised learning tasks. Maybe a split for supervised learning can be proposed in future versions of the dataset, but I don't really have any problems with this issue being closed now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants