Vouch request: AshwinUgale #3927
Closed
AshwinUgale
started this conversation in
Vouch Request
Replies: 2 comments
-
|
/vouch |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
@AshwinUgale has been vouched by @rh-hemartin. You can now submit pull requests to fullsend. Welcome aboard. Please read CONTRIBUTING.md before submitting. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
What do you want to work on?
I wanted to work on the issue I already raised #2460 .
Why this change?
I was working on this side project muteval , you can check it out on my github. Idea was mutation testing for eval suites.
Now the issue is as evals are non deterministic, its hard to say whether the mutant actually degraded the system or its just noise. Thats where the statistical layer comes in so we can determine if a mutant was killed or survived with confidence.
I was following your work and this repo for some time now, I was really fascinated by your work and happen to find that you had raised the same problem and mutation testing as a possible solution in one of your docs here
The issue I raised was supposed to be a first part of just adding the statistical significance layer and I would later like to add the actual mutation harness if this makes sense and you think might add any value.
Checklist
Beta Was this translation helpful? Give feedback.
All reactions