Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce the #import_time meta extractor #2019

Merged
merged 4 commits into from Jan 7, 2022

Conversation

dominiklohmann
Copy link
Member

@dominiklohmann dominiklohmann commented Jan 3, 2022

This introduces the #import_time meta extractor to the query language. Use it to query for data based on the timestamp that the data arrived at the VAST server process, e.g., vast export json '#import_time > 1 hour ago' will export all data that was added in the last hour as NDJSON.

The new extractor behaves like a timestamp in the query language and can be used for comparisons with time value literals.

馃摑 Checklist

  • All user-facing changes have changelog entries.
  • The changes are reflected on docs.tenzir.com/vast, if necessary.
  • The PR description contains instructions for the reviewer, if necessary.

馃幆 Review Instructions

Review commit-by-commit. Test extensively locally. Previous PRs added unit test coverage, so this only adds integration test coverage now that it is exposed to the user.

@dominiklohmann dominiklohmann added the feature New functionality label Jan 3, 2022
@dominiklohmann dominiklohmann requested a review from a team January 3, 2022 15:43
Copy link
Contributor

@dispanser dispanser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Verified locally that queries using #import_time work as expected.

@dominiklohmann dominiklohmann merged commit 3f24a3a into master Jan 7, 2022
@dominiklohmann dominiklohmann deleted the story/sc-30038/import-time-meta-extractor branch January 7, 2022 12:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New functionality
Projects
None yet
2 participants