Examining Zoltar API traffic by users

[Khoale1096]

A couple of metrics to keep track (more can be added if deem necessary).

Zoltar traffic report brainstorm (google doc)

• Weekly:

  • How many users submitted a query?
  • How many queries total?
  • Median number of queries by each user?
  • How many rows served in total?
  • Median number of rows per query?
  • Breakdown by score vs forecast queries?

• Overall:

  • same as above but across all time

Initial list (old?)

• How many queries per day per user? Potential: Heroku throughput metrics divided by number of zoltar users?
• How many rows downloaded per day?
• What tables are being queried more frequently?

[ayushkhd]

Ran Exploratory Data Analysis on Zoltar Jobs Table to derive valuable metrics & information.

Derived the following metrics -

1. The types of activities running on Zoltar, sorted from most to least common
2. List of activities done by a particular user along with the dates they were done on
3. Most active users
4. The models that are being queried the most, along with the dates they have been queried on
5. Most queried models, from high to low
6. List of all deleted forecasts with dates

[ayushkhd]

Next up - working on developing a dashboard visualization for all the data gathered

[matthewcornell]

That all sounds good. How are you planning on creating the dashboard?

I reviewed lots of Python visualization libraries and then settled on https://vega.github.io/vega-lite/ for the forecast heatmap. I plan on using it for other graphics down the road. If you don't have a strong reason for using a different library, please consider using vega-lite. I'm happy to take you through it.

Also, once you have output that @nickreich and you like, I'll work with you to get it into Zoltar, if that's what we want. Thanks! --m

[ayushkhd]

Generated a report for user activities & shared with Prof Nick

[matthewcornell]

Would you please put a copy here, or point me to its location? Also, I'd like to see any code that you think might be useful for possibly adding to Zoltar. Thank you.

[ayushkhd]

@matthewcornell Sure, I'll send you the report and the code.