RFD 160 Discussion: CloudWatch-like Metrics for Manta

[joshwilsdon]

No description provided.

[cburroughs]

BucketSizeBytes 	Average 	bytes of data stored in a bucket
NumberOfObjects 	Average 	number of objects in a bucket

Are those really averages? That is if for 30 seconds there are 10 objects in the bucket, and for 30 seconds there are 20 objects, this will return 15?

*When I add a new filter to CloudWatch, when do my metrics show up? Within any bounds? Or eventually?

(Background note, I used to know things about analytics and Big Data. Most of online advertising is just munching on logs.) I've trained my brain to look at everything as a log/stream problem, so that approach sense to me. But I'm not sure that's really an endorsement.

We should be mindful of incidentally turning an internal interface into a customer one. It takes a great deal of internal coordination to change anything about a metric today. If muskie metrics were the source of a customer facing feature, it would become nearly impossible. For logs, I suggest new logs with versioned schemas instead of re-using the existing ones.