[MLU] add mlu device for infer #10249
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Thanks for your contribution! |
onecatcn
reviewed
Jul 10, 2023
There was a problem hiding this comment.
There is some discrepency between the codes for npu and mlu, please justify the difference.
PeiyuLau
force-pushed
the
add_ocr_infer_mlu_device
branch
2 times, most recently
from
e3efae0
to
cedcddb
Compare
shiyutang
requested changes
Jul 14, 2023
tools/infer/utility.py
Outdated
Comment on lines
252
to
257
| elif args.use_custom_device: | ||
| dev_type = paddle.device.get_all_custom_device_type()[0] | ||
| config.enable_custom_device(dev_type) |
There was a problem hiding this comment.
The custom device should not be able to replace npu.
It seems you should add mlu device on top of the original code with another elif clause.
There was a problem hiding this comment.
config.enable_custom_device("mlu")
PeiyuLau
force-pushed
the
add_ocr_infer_mlu_device
branch
from
cedcddb
to
b614907
Compare
shiyutang
requested changes
Jul 18, 2023
tools/infer/utility.py
Outdated
| @@ -37,6 +37,11 @@ def init_args(): | |||
| parser.add_argument("--use_gpu", type=str2bool, default=True) | |||
| parser.add_argument("--use_xpu", type=str2bool, default=False) | |||
| parser.add_argument("--use_npu", type=str2bool, default=False) | |||
| parser.add_argument( | |||
| "--use_custom_device", | |||
There was a problem hiding this comment.
If you want to add mlu, I suppose it is better if this should is use_mlu.
tools/infer/utility.py
Outdated
Comment on lines
252
to
257
| elif args.use_custom_device: | ||
| dev_type = paddle.device.get_all_custom_device_type()[0] | ||
| config.enable_custom_device(dev_type) |
There was a problem hiding this comment.
config.enable_custom_device("mlu")
PeiyuLau
force-pushed
the
add_ocr_infer_mlu_device
branch
from
b614907
to
105958a
Compare
PeiyuLau
force-pushed
the
add_ocr_infer_mlu_device
branch
from
105958a
to
7102843
Compare
shiyutang
pushed a commit
that referenced
this pull request
Oct 16, 2023
shiyutang
added a commit
that referenced
this pull request
Oct 18, 2023
* Update recognition_en.md (#10059) ic15_dict.txt only have 36 digits * Update ocr_rec.h (#9469) It is enough to include preprocess_op.h, we do not need to include ocr_cls.h. * 补充num_classes注释说明 (#10073) ser_vi_layoutxlm_xfund_zh.yml中的Architecture.Backbone.num_classes所赋值会设置给Loss.num_classes， 由于采用BIO标注，假设字典中包含n个字段（包含other）时，则类别数为2n-1;假设字典中包含n个字段（不含other）时，则类别数为2n+1。 * Update algorithm_overview_en.md (#9747) Fix links to super-resolution algorithm docs * 改进文档`deploy/hubserving/readme.md`和`doc/doc_ch/models_list.md` (#9110) * Update readme.md * Update readme.md * Update readme.md * Update models_list.md * trim trailling spaces @ `deploy/hubserving/readme_en.md` * `s/shell/bash/` @ `deploy/hubserving/readme_en.md` * Update `deploy/hubserving/readme_en.md` to sync with `deploy/hubserving/readme.md` * Update deploy/hubserving/readme_en.md to sync with `deploy/hubserving/readme.md` * Update deploy/hubserving/readme_en.md to sync with `deploy/hubserving/readme.md` * Update `doc/doc_en/models_list_en.md` to sync with `doc/doc_ch/models_list_en.md` * using Grammarly to weak `deploy/hubserving/readme_en.md` * using Grammarly to tweak `doc/doc_en/models_list_en.md` * `ocr_system` module will return with values of field `confidence` * Update README_CN.md * 修复测试服务中图片转Base64的引用地址错误。 (#8334) * Update application.md * [Doc] Fix 404 link. (#10318) * Update PP-OCRv3_det_train.md * Update knowledge_distillation.md * Update config.md * Fix fitz camelCase deprecation and .PDF not being recognized as pdf file (#10181) * Fix fitz camelCase deprecation and .PDF not being recognized as pdf file * refactor get_image_file_list function * Update customize.md (#10325) * Update FAQ.md (#10345) * Update FAQ.md (#10349) * Don't break overall processing on a bad image (#10216) * Add preprocessing common to OCR tasks (#10217) Add preprocessing to options * [MLU] add mlu device for infer (#10249) * Create newfeature.md * Update newfeature.md * remove unused imported module, so can avoid PyInstaller packaged binary's start-time not found module error. (#10502) * CV套件建设专项活动 - 文字识别返回单字识别坐标 (#10515) * modification of return word box * update_implements * Update rec_postprocess.py * Update utility.py * Update README_ch.md * revert README_ch.md update * Fixed Layout recovery README file (#10493) Co-authored-by: Shubham Chambhare <shubhamchambhare@zoop.one> * update_doc * bugfix --------- Co-authored-by: ChuongLoc <89434232+ChuongLoc@users.noreply.github.com> Co-authored-by: Wang Xin <xinwang614@gmail.com> Co-authored-by: tanjh <dtdhinjapan@gmail.com> Co-authored-by: Louis Maddox <lmmx@users.noreply.github.com> Co-authored-by: n0099 <n@n0099.net> Co-authored-by: zhenliang li <37922155+shouyong@users.noreply.github.com> Co-authored-by: itasli <ilyas.tasli@outlook.fr> Co-authored-by: UserUnknownFactor <63057995+UserUnknownFactor@users.noreply.github.com> Co-authored-by: PeiyuLau <135964669+PeiyuLau@users.noreply.github.com> Co-authored-by: kerneltravel <kjpioo2006@gmail.com> Co-authored-by: ToddBear <43341135+ToddBear@users.noreply.github.com> Co-authored-by: Ligoml <39876205+Ligoml@users.noreply.github.com> Co-authored-by: Shubham Chambhare <59397280+Shubham654@users.noreply.github.com> Co-authored-by: Shubham Chambhare <shubhamchambhare@zoop.one> Co-authored-by: andyj <87074272+andyjpaddle@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
add mlu device for infer