-
Notifications
You must be signed in to change notification settings - Fork 107
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
AI.INFO command #259
AI.INFO command #259
Conversation
@lantiga @K-Jo @gkorland OSS look and feel. I think that @itamarhaber can be of extreme help here
|
Added tests and docs, the PR is ready to land, except for the histograms. |
### AI.INFO Example | ||
|
||
```sql | ||
AI.INFO amodel |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@lantiga can we include the example output here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
This PR adds a new AI.INFO command to RedisAI.
Stats on each model/script key being run are accumulated and reported periodically.
TODO items:
modelkey
as a mandatory argument (details below in the UPDATE)ERRORS
, evaluatingHISTOGRAM
)AI.INFO modelkey RESET
) to clean up all stat keys and start freshUPDATE (credit @K-Jo): avoid getting stats from all models with a single command (response potentially unbounded, it looks like a scan), but have users call
AI.INFO
with amodelkey
as the argument. This way a) the stats will have the same lifetime as the respective models (we can collocate stats directly in the model struct and get rid of the module-level dictUPDATE: we will still keep the stats in the dict to avoid accessing keyspace in the callback); b) responses will be bounded and specific for each model. Users will also be in charge of callingRESETSTAT
on the model stats.