-
Notifications
You must be signed in to change notification settings - Fork 23
Removing problematic finetuning test #85
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Removing problematic finetuning test #85
Conversation
Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com>
| return request.param | ||
|
|
||
|
|
||
| ''' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you mark this test as skipped?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@mikelam-us-aixplain, to remove AWS ASR from the tests, you should erase AWS ASR entry from the finetune_test_run_data.json file. It is the second element: https://github.com/aixplain/aiXplain/blob/M-5283031693-Removing-Problematic-Finetune_Test/tests/functional/finetune/data/finetune_test_run_data.json#L7C22-L8
Please also save a copy of the file with all suppliers as a backup.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@lucas-aixplain why remove when this can be marked as skipped? We can leave a note to why it was marked as skipped.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Here we do not need to skip the test method, we can just remove the problematic test case entry from the input JSON file and let the test run for other suppliers.
Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com>
| return request.param | ||
|
|
||
|
|
||
| ''' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@mikelam-us-aixplain, to remove AWS ASR from the tests, you should erase AWS ASR entry from the finetune_test_run_data.json file. It is the second element: https://github.com/aixplain/aiXplain/blob/M-5283031693-Removing-Problematic-Finetune_Test/tests/functional/finetune/data/finetune_test_run_data.json#L7C22-L8
Please also save a copy of the file with all suppliers as a backup.
Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com>
Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com>
Removing problematic fine-tuning test due to AWS rate-limiting until this problem is fixed.