Add damaging and goodfaith models for huwiki #142
Add damaging and goodfaith models for huwiki #142tgr wants to merge 4 commits intowikimedia:masterfrom
Conversation
Codecov Report
@@ Coverage Diff @@
## master #142 +/- ##
==========================================
- Coverage 20.93% 13.91% -7.03%
==========================================
Files 58 56 -2
Lines 1070 999 -71
==========================================
- Hits 224 139 -85
- Misses 846 860 +14
Continue to review full report at Codecov.
|
| - bureaucrat | ||
| - editor | ||
| - templateeditor | ||
| - interface-editor |
There was a problem hiding this comment.
Adding these now will cause some warnings, but no big issues. Essentially, we'll have labels for some edits where "needs_review" is false with "reason" == "trusted_group"
Makefile
Outdated
| damaging \ | ||
| roc_auc.labels.true \ | ||
| --label-weight "true=$(damaging_weight)" \ | ||
| --pop-rate "true=0.0872" \ |
There was a problem hiding this comment.
1/10th of all edits are damaging? that seems wrong.
b2c538b to
8abf153
Compare
|
@halfak pointed out that I used the percentage of hand-labeled edits where I should have used the percentage of total edits so I redid the commits using the ratio between and I'll update the docs once the PR passes review. |
|
|
|
I'd recommend using the 39678 as the denominator -- but it shouldn't make too much of a difference. I think you're right and 322 are revisions to deleted pages or they have been rev-deleted. |
|
Needs a rebase. The master branch has an updated merge_labels algorithm which simplifies the Makefile logic. |
| min_samples_leaf: 13 | ||
| pop_rate_true: 0.014812583163867339 | ||
| build_number: 1 | ||
| damaging: |
There was a problem hiding this comment.
This patch should drop the huwiki.reverted model too, AIUI.
|
P.S., you should have privileges on this repo, and if the branch were under the org repo I could push my rebase: https://github.com/wiki-ai/editquality/compare/awight-huwiki |
Bug: T185903
Bug: T185903
8abf153 to
5d11a50
Compare
|
Closing in favor of #152 which uses a local branch (it did not seem possible to change the source for this one). |
Also update the list of trusted groups.
Bug: T185903