Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Track events that have been pulled #11

Open
bmeyer99 opened this issue Nov 10, 2019 · 0 comments
Open

Track events that have been pulled #11

bmeyer99 opened this issue Nov 10, 2019 · 0 comments

Comments

@bmeyer99
Copy link
Owner

Not only do the events needs to be tracked, thinking sqlite, we need to figure out if an event has been updated with a new item, thinking may need to hash the events when they come in and if we pull again we can check against the hash to see if it changed.

This will be helpful if using the "LastSeen" field to understand if it is later than the previous "LastSeen"

pull events based on last pull
if eventId is already known
if lastSeen is later than previous lastSeen
Pull new events with all data
If RawId matches existing
Move onto next
else save rawId file
replace old events file with new data
else pull as normal

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant