Estuary Metrics API

[alvin-reyes]

Feature Request

In order for external consumers that uses estuary to build their own data analysis tools, we need to prove them with a way to access estuary data. The goal is to create an API to extend the public/stats endpoint to introduce the following:

https://www.notion.so/ecosystem-wg/Metrics-Tracking-ea3da497096e4e4580c38a6a057b274f

High-Level Process Diagram (WIP)

Breaking down the tasks here

• quick chore tasks to extend the public/stats to retrieve the total obj_ref and total sum (chore: added extensive lookup function on public/stats - total obj_ref #285)
• estuary metrics api framework design (https://www.notion.so/ecosystem-wg/Metrics-Tracking-ea3da497096e4e4580c38a6a057b274f)
• estuary metrics standalone api
• estuary metrics standalone core library (for estuary to use directly)
• estuary metrics emit
• estuary metrics api documentation for consumers/clients
• hook the API to grafana
• hook the SQL queries on grafana

[alvin-reyes]

https://github.com/application-research/estuary-metrics

[anjor]

@alvin-reyes we can close this out now, yeah?

[alvin-reyes]

Yes. This is feature-complete but we still need to build more API endpoints and improvements to it. I'll list those down on the project's github issue.