PPLCNetNew找不到對應模型 #10685

cjwang0318 · 2023-08-21T04:58:41Z

系统环境/System Environment：Ubuntu
版本号/Version：Paddle v2.5： PaddleOCR：问题相关组件/Related components： ppocr/modeling/necks/db_fpn.py
运行指令/Command Code：python tools/train.py -c ./ch_PP-OCRv4_det_cml.yml

使用ch_PP-OCRv4_det訓連模型進行fintune時，將 ch_PP-OCRv4_det_cml.yml 中的 Backbone name: PPLCNetNew 找不到對應模型，如果改成PPLCNetNewV3則會報錯 for i in range(len(in_channels)):TypeError: object of type 'int' has no len()
可以麻煩請教一下原因嗎？謝謝。

完整报错/Complete Error Message：
Traceback (most recent call last):
File "/home/cjwang/cjwang/PaddleOCR-release-2.7/tools/train.py", line 227, in
main(config, device, logger, vdl_writer)
File "/home/cjwang/cjwang/PaddleOCR-release-2.7/tools/train.py", line 135, in main
model = build_model(config['Architecture'])
File "/home/cjwang/cjwang/PaddleOCR-release-2.7/ppocr/modeling/architectures/init.py", line 34, in build_model
arch = getattr(mod, name)(config)
File "/home/cjwang/cjwang/PaddleOCR-release-2.7/ppocr/modeling/architectures/distillation_model.py", line 47, in init
model = BaseModel(model_config)
File "/home/cjwang/cjwang/PaddleOCR-release-2.7/ppocr/modeling/architectures/base_model.py", line 67, in init
self.neck = build_neck(config['Neck'])
File "/home/cjwang/cjwang/PaddleOCR-release-2.7/ppocr/modeling/necks/init.py", line 42, in build_neck
module_class = eval(module_name)(**config)
File "/home/cjwang/cjwang/PaddleOCR-release-2.7/ppocr/modeling/necks/db_fpn.py", line 240, in init
for i in range(len(in_channels)):
TypeError: object of type 'int' has no len()

SWHL · 2023-08-26T01:37:50Z

I meet the same problem.

gl94 · 2023-09-04T05:51:50Z

不是“PPLCNetNewV3”而是“PPLCNetV3”

Taichipeace · 2023-10-09T08:09:33Z

不是“PPLCNetNewV3”而是“PPLCNetV3”

PPLCNetV3 我改成了这个，但是也是一样的报错。

kadimakipp · 2023-10-13T03:43:57Z

把PPLCNetNew改成PPLCNetV3，在添加一行det: true

enemy1205 · 2023-10-13T11:10:44Z

添加det: true后，
训练会遇到另外报错

Traceback (most recent call last):
  File "/mnt/home/sp/projects/PaddleOCR/tools/train.py", line 228, in <module>
    main(config, device, logger, vdl_writer)
  File "/mnt/home/sp/projects/PaddleOCR/tools/train.py", line 199, in main
    program.train(config, train_dataloader, valid_dataloader, device, model,
  File "/mnt/home/sp/projects/PaddleOCR/tools/program.py", line 334, in train
    post_result = post_process_class(preds, batch[1])
  File "/mnt/home/sp/projects/PaddleOCR/ppocr/postprocess/db_postprocess.py", line 275, in __call__
    results[k] = self.post_process(predicts[k], shape_list=shape_list)
  File "/mnt/home/sp/projects/PaddleOCR/ppocr/postprocess/db_postprocess.py", line 229, in __call__
    src_h, src_w, ratio_h, ratio_w = shape_list[batch_index]
ValueError: too many values to unpack (expected 4)
I1013 19:03:27.982057 679392 tcp_store.cc:273] receive shutdown event and so quit from MasterDaemon run loop

调试进入
ppocr/postprocess/db_postprocess.py文件中229lines

        for batch_index in range(pred.shape[0]):
            src_h, src_w, ratio_h, ratio_w = shape_list[batch_index]
            if self.dilation_kernel is not None:
                mask = cv2.dilate(
                    np.array(segmentation[batch_index]).astype(np.uint8),
                    self.dilation_kernel)

发现shappe_list是一个 batch_size * 640(height) *640(width) 的数组，
显然下标访问后取值无法返回src_h, src_w, ratio_h, ratio_w

kadimakipp · 2023-10-16T05:52:19Z

#5710

ITccyhub · 2023-11-07T03:25:21Z

Traceback (most recent call last):
File "tools/train.py", line 227, in
main(config, device, logger, vdl_writer)
File "tools/train.py", line 135, in main
model = build_model(config['Architecture'])
File "D:\PaddleOCR\PaddleOCR-release-2.7\ppocr\modeling\architectures_init_.py", line 34, in build_model
arch = getattr(mod, name)(config)
File "D:\PaddleOCR\PaddleOCR-release-2.7\ppocr\modeling\architectures\distillation_model.py", line 47, in init
model = BaseModel(model_config)
File "D:\PaddleOCR\PaddleOCR-release-2.7\ppocr\modeling\architectures\base_model.py", line 67, in init
self.neck = build_neck(config['Neck'])
File "D:\PaddleOCR\PaddleOCR-release-2.7\ppocr\modeling\necks_init_.py", line 42, in build_neck
module_class = eval(module_name)(**config)
File "D:\PaddleOCR\PaddleOCR-release-2.7\ppocr\modeling\necks\db_fpn.py", line 240, in init
for i in range(len(in_channels)):
TypeError: object of type 'int' has no len()

ITccyhub · 2023-11-07T03:25:50Z

an'zh按照这个改了还是报错

ITccyhub · 2023-11-07T03:26:31Z

加上 det: true 直接

sylarwcy · 2023-11-15T01:35:59Z

把PPLCNetNew改成PPLCNetV3，在添加一行det: true

这个是正解

sylarwcy · 2023-11-15T01:39:56Z

只有设定了det: true，才能走输出序列这个条件分支。后面RSEFPN解析in_channels时，按序列来解，才不会报错。

KongXCai · 2023-12-11T02:05:39Z

添加det: true后，训练会遇到另外报错

Traceback (most recent call last):
  File "/mnt/home/sp/projects/PaddleOCR/tools/train.py", line 228, in <module>
    main(config, device, logger, vdl_writer)
  File "/mnt/home/sp/projects/PaddleOCR/tools/train.py", line 199, in main
    program.train(config, train_dataloader, valid_dataloader, device, model,
  File "/mnt/home/sp/projects/PaddleOCR/tools/program.py", line 334, in train
    post_result = post_process_class(preds, batch[1])
  File "/mnt/home/sp/projects/PaddleOCR/ppocr/postprocess/db_postprocess.py", line 275, in __call__
    results[k] = self.post_process(predicts[k], shape_list=shape_list)
  File "/mnt/home/sp/projects/PaddleOCR/ppocr/postprocess/db_postprocess.py", line 229, in __call__
    src_h, src_w, ratio_h, ratio_w = shape_list[batch_index]
ValueError: too many values to unpack (expected 4)
I1013 19:03:27.982057 679392 tcp_store.cc:273] receive shutdown event and so quit from MasterDaemon run loop

调试进入 ppocr/postprocess/db_postprocess.py文件中229lines

        for batch_index in range(pred.shape[0]):
            src_h, src_w, ratio_h, ratio_w = shape_list[batch_index]
            if self.dilation_kernel is not None:
                mask = cv2.dilate(
                    np.array(segmentation[batch_index]).astype(np.uint8),
                    self.dilation_kernel)

发现shappe_list是一个 batch_size * 640(height) *640(width) 的数组，显然下标访问后取值无法返回src_h, src_w, ratio_h, ratio_w

我也遇到了跟你一样的问题，请问你解决了吗？

Sundragon1993 · 2024-01-05T08:31:03Z

@KongXCai just set: cal_metric_during_train: false

Double97828 · 2024-02-29T09:08:08Z

把PPLCNetNew改成PPLCNetV3，在添加一行det: true

这个student1和student2都要做修改么，我两个都修改了以后，有非常多层的参数无法加载不到模型中

koala-cat · 2024-04-10T03:03:30Z

把PPLCNetNew改成PPLCNetV3，在添加一行det: true

这个student1和student2都要做修改么，我两个都修改了以后，有非常多层的参数无法加载不到模型中

解决了么？我也是PPLCNetNew改成PPLCNetV3之后，student1和student2都加了 det: true，也试过单独加 student1，结果还是报错

nikooooooooooooooooooo · 2024-05-10T06:30:22Z

配置加上还是报错，大佬解决了吗？
预训练模型：ch_PP-OCRv4_det_train

mattheliu · 2024-05-10T08:54:51Z

@564142183 你可以试一下 set: cal_metric_during_train: false

nikooooooooooooooooooo · 2024-05-11T09:15:08Z

@mattheliu 感谢大佬回复，把cal_metric_during_train改成false后训练还是报错

[2024-05-11 09:12:21,664] [ WARNING] dataloader_iter.py:707 - DataLoader 1 workers exit unexpectedly, pids: 5673
Traceback (most recent call last):
  File "/PaddleOCR/tools/train.py", line 255, in <module>
    main(config, device, logger, vdl_writer, seed)
  File "/PaddleOCR/tools/train.py", line 208, in main
    program.train(
  File "/PaddleOCR/tools/program.py", line 304, in train
    for idx, batch in enumerate(train_dataloader):
  File "/usr/local/lib/python3.10/dist-packages/paddle/io/dataloader/dataloader_iter.py", line 826, in __next__
    self._reader.read_next_list()[0]
SystemError: (Fatal) Blocking queue is killed because the data reader raises an exception.
  [Hint: Expected killed_ != true, but received killed_:1 == true:1.] (at ../paddle/fluid/operators/reader/blocking_queue.h:171)

nikooooooooooooooooooo · 2024-05-18T08:07:03Z

问题已解决，就是训练完的效果不太理想，附项目地址：https://aistudio.baidu.com/projectdetail/7900653?sUid=3018256&shared=1&ts=1716019542135

paddle-bot bot assigned andyjiang1116 Aug 21, 2023

paddle-bot bot assigned tink2123 Mar 8, 2024

Liyulingyue mentioned this issue Apr 9, 2024

【疑难解决】解决PaddleOCR历史存在的疑难Issue #11906

Closed

jzhang533 unassigned tink2123 and andyjiang1116 Apr 10, 2024

jzhang533 added triaged this issue has been looked, and triaged. training this is a training related issue PR is welcome labels Apr 10, 2024

mattheliu mentioned this issue May 18, 2024

【OCR Issue No.2】修复训练过程中找不到對應模型和训练时计算精度报错 #12140

Merged

UserWangZz closed this as completed May 30, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

PPLCNetNew找不到對應模型 #10685

PPLCNetNew找不到對應模型 #10685

cjwang0318 commented Aug 21, 2023

SWHL commented Aug 26, 2023

gl94 commented Sep 4, 2023

Taichipeace commented Oct 9, 2023

kadimakipp commented Oct 13, 2023 •

edited

Loading

enemy1205 commented Oct 13, 2023

kadimakipp commented Oct 16, 2023

ITccyhub commented Nov 7, 2023

ITccyhub commented Nov 7, 2023

ITccyhub commented Nov 7, 2023

sylarwcy commented Nov 15, 2023

sylarwcy commented Nov 15, 2023

KongXCai commented Dec 11, 2023

Sundragon1993 commented Jan 5, 2024

Double97828 commented Feb 29, 2024

koala-cat commented Apr 10, 2024

nikooooooooooooooooooo commented May 10, 2024 •

edited

Loading

mattheliu commented May 10, 2024

nikooooooooooooooooooo commented May 11, 2024

nikooooooooooooooooooo commented May 18, 2024 •

edited

Loading

PPLCNetNew找不到對應模型 #10685

PPLCNetNew找不到對應模型 #10685

Comments

cjwang0318 commented Aug 21, 2023

SWHL commented Aug 26, 2023

gl94 commented Sep 4, 2023

Taichipeace commented Oct 9, 2023

kadimakipp commented Oct 13, 2023 • edited Loading

enemy1205 commented Oct 13, 2023

kadimakipp commented Oct 16, 2023

ITccyhub commented Nov 7, 2023

ITccyhub commented Nov 7, 2023

ITccyhub commented Nov 7, 2023

sylarwcy commented Nov 15, 2023

sylarwcy commented Nov 15, 2023

KongXCai commented Dec 11, 2023

Sundragon1993 commented Jan 5, 2024

Double97828 commented Feb 29, 2024

koala-cat commented Apr 10, 2024

nikooooooooooooooooooo commented May 10, 2024 • edited Loading

mattheliu commented May 10, 2024

nikooooooooooooooooooo commented May 11, 2024

nikooooooooooooooooooo commented May 18, 2024 • edited Loading

kadimakipp commented Oct 13, 2023 •

edited

Loading

nikooooooooooooooooooo commented May 10, 2024 •

edited

Loading

nikooooooooooooooooooo commented May 18, 2024 •

edited

Loading