Configures dev_server utility with rule-based scorer model. #107
Conversation
| super().__init__([last_two_in_rev_id], version=version) | ||
|
|
||
| def score(self, feature_values): | ||
| probability = feature_values[0] / 100 |
There was a problem hiding this comment.
one of them should be float otherwise it gives zero ( 1 / 10 = 0 but 1/10.0 = 0.1)
There was a problem hiding this comment.
Only true in crazy python 2 land. Join the python 3 revolution where divisions don't silently do stupid things. :)
Configures dev_server utility with rule-based scorer model.
|
Could you elaborate on how this will be used? |
|
Yes! So, we're working on testing the new ORES extension, but one problem we have is setting up a scoring model that can work against the vagrant wiki or testwiki or whatever! It would be a pain if we set up a machine learning model specifically for test wikis. So instead, we set up a rule-based scorer model that requires no assets to function and returns a deterministic prediction. This will help us test systems that use ORES independent of the models the useful models that ORES hosts. In the short term, we want to get the testwiki ORES server included as a role for MediaWiki vagrant and to get a testwiki model loaded onto ores.wmflabs.org for testing. Both of those will use this scorer model. |
|
Relevant tasks:
|
|
Thanks! |
This will be useful in testing.
RevIdScorer returns the last two digits in a rev_id as a prediction (378428499 = 99% & True).