New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Missing data in S3 archive? #80
Comments
Yes, it's possible. |
Could we make the archiving happen daily? On 4 June 2012 04:16, fandrei <
David Laing |
Sure, or even more frequently. But the problem is that file won't be sent to S3 until appropriate user session is finished, and some sessions are many days long. It's made this way because it's impossible to "append" data to S3 object, only completely rewrite it. But I can change this behavior. |
I think we should ensure that sessions recycle every few hours, to better On Thursday, June 7, 2012, fandrei wrote:
David Laing |
As "session" here I mean AppMetrics session, not CIAPI |
Getting raw data directly from AppMetrics server: |
I'm trying to plot a latency scatterplot from the raw data collected on May 23rd ( when the new TradingAPI was released, and we see the increase in measured latency )
I'm pulling my data from https://s3.amazonaws.com/cityindex.appmetrics/CiapiLatencyCollector/2012-05/*.zip
However, my plot seems to be missing data for a bunch of dates:
Is it possible that S3 is missing some source data?
The text was updated successfully, but these errors were encountered: