-
Notifications
You must be signed in to change notification settings - Fork 441
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix Optimize in Anomaly Task #3561
Fix Optimize in Anomaly Task #3561
Conversation
Signed-off-by: Ashwin Vaidya <ashwinnitinvaidya@gmail.com>
@ashwinvaidya17 - Are we using test set for optimization? Did you check optimization works fine with this fix? |
Co-authored-by: Harim Kang <harim.kang@intel.com>
I tried optimization on one category ( |
52d5553
into
openvinotoolkit:releases/2.0.0
* Remove LITMODULE_PER_TASK * Disable Resnext101_ATSS model on XPU (#3514) * diable resnext101_atss on XPU * give detailed xpu device info to perf tag * revert debug code --------- Co-authored-by: kirill prokofiev <kirill.prokofiev@intel.com> * Remove invalid perf benchmark reference history for v2.0.0 (#3517) * Fix a bug that dino_v2 model can't be run w/ HPO (#3518) * add reduce function to dino backbone * add unit test * update integration test * change name * Fix detection export performance degradation (#3520) * Fix to use right index * Align forward by adding missed parts * Revert metrics threshold (#3528) Revert threshold Signed-off-by: Ashwin Vaidya <ashwinnitinvaidya@gmail.com> * Tile with full img optional (#3530) * make tile dataset with full image optional * Add a feature to adapt max value of HPO batch size search space (#3532) * implement adaptive max value of bs search space * implement unit test * Remove duplicates in get_idx_list_per_classes (#3537) * Remove duplicates in get_idx_list_per_classes * Reduce time complex * Revisit Docker image build script (#3536) * Revisit Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com> * Fix test Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com> --------- Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com> * Bump datumaro version to 1.6.1 (#3535) * Add F1 metric computation during detection tasks (#3539) * add f1 metric during training for detection * add f1 metric during training for detection * add a new metric * remove configure_metric in det model * Update doctstring for MeanAveragePrecisionFMeasure Co-authored-by: Vinnam Kim <vinnam.kim@gmail.com> * Trigger Build * resolve precommit error --------- Co-authored-by: Vinnam Kim <vinnam.kim@gmail.com> * Fix yolox export perf degradation (#3534) * Add `Focus` export pipeline * Update `update_ov_subset_pipeline` to update `image_color_channel` * Fix MaskRCNN IR Accuracy Drop (#3540) fix ir maskrcnn accuracy drop * Hotfix/geti integration (#3543) * Fix Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com> * Fix Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com> --------- Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com> * Fix Anomaly OV export flag (#3558) swap_rgb to False Signed-off-by: Ashwin Vaidya <ashwinnitinvaidya@gmail.com> * Fix accuracy drop in MaskRCNN (#3562) * fix maskrcnn accuracy drop * pad to square * remove unnecessary changes * remove unnecessary changes * Update codeql workflow to generate a report (#3559) * Fix & Refine HPO (#3565) * refine engine/hpo * implement draft test code * change replace to shutil.copy * use same initial weight during HPO * implement unit test * search_space support Path * move Path out of TYPE_CHECKING * Fix Optimize in Anomaly Task (#3561) * use val_dataloader Signed-off-by: Ashwin Vaidya <ashwinnitinvaidya@gmail.com> * Apply suggestions from code review Co-authored-by: Harim Kang <harim.kang@intel.com> --------- Signed-off-by: Ashwin Vaidya <ashwinnitinvaidya@gmail.com> Co-authored-by: Harim Kang <harim.kang@intel.com> * Update dependencies (#3570) * Bump anomalib from 1.0.1 to 1.1.0 (#3572) Bump anomalib version to 1.1.0 * Fix F1 instance seg accuracy drop (#3578) * add MaskRLEMeanAPFMeasureCallable * update recipes * format * Update for using locally stored pretrained weights in the CI for torch hub models (#3541) * apply changed arg of OTXModel.export() to YOLOX model * update dinov2 pretrained weights loading * skip yolox-tiny-tile xai test * make semi-sl dino support pickle --------- Signed-off-by: Ashwin Vaidya <ashwinnitinvaidya@gmail.com> Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com> Co-authored-by: Kang, Harim <harim.kang@intel.com> Co-authored-by: Eunwoo Shin <eunwoo.shin@intel.com> Co-authored-by: kirill prokofiev <kirill.prokofiev@intel.com> Co-authored-by: Kim, Sungchul <sungchul.kim@intel.com> Co-authored-by: Ashwin Vaidya <ashwin.vaidya@intel.com> Co-authored-by: Eugene Liu <eugene.liu@intel.com> Co-authored-by: Vinnam Kim <vinnam.kim@intel.com> Co-authored-by: Wonju Lee <wonju.lee@intel.com> Co-authored-by: Vinnam Kim <vinnam.kim@gmail.com>
Summary
val_dataloader
for NNCF optimizationHow to test
Checklist
License
Feel free to contact the maintainers if that's a concern.