Keep track of detailed information about inference, data synthesis, response sizes, latency, quality

[cartazio]

No description provided.

[cartazio]

basically all the statistics/metrics

[TheRealVish]

What is the preferred approach please? SQL lite db or csv file (new daily) or add to std logs?

[cartazio]

I have my own preferences. But any will suite as a starting point and I can code review it into supporting all 3

[TheRealVish]

Thanks, will look in to this and get back

[TheRealVish]

Please could you give me perms to push in to my branch..

[cartazio]

make a fork and do it there

[TheRealVish]

https://localhost:3002/v1/completion - gives handshake error and http://localhost:3002/v1/completion - gives 404 😦
(using SERVER_API md) Is this a known issue .. ?

[TheRealVish]

Tiny note - SERVER_API.md needs update, the route is incorrect. It should be /v1/complete and not /v1/completion.. Solved the above with this. I will add this change to the PR.

[TheRealVish]

Discussion continued on PR

#117

[TheRealVish]

@cartazio @mmirman if this is still open I will be interested to pickup ..