Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upRecords should be returned in upload order #53
Closed
Labels
Comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Currently we upload records with a prefix including the timestamp in seconds.
S3 returns keys by "UTF-8 binary order", so for example if you put record 0 ".../12340000/z/..." then record 1 ".../12340000/a/..." then record 1 would be returned first.
This impacts the initial sync, when order is important.
We could solve this by storing the timestamp at millisecond precision.
Related: #49