dota数据处理报错munmap_chunk(): invalid pointer

[HeuristicLU]

您好，我遇到些问题，想请教下
我的配置文件type='DOTA1_5'
source_dataset_path='/media/asus/299D817A2D97AD94/ok_PROJs/JDet/datasets/DOTA1_5/'
target_dataset_path='/media/asus/299D817A2D97AD94/ok_PROJs/JDet/datasets/processed_DOTA1_5/'
路径没有错误，DOTA1_5下面是挑选出来的部分数据，我在其他程序上测过，没有问题。

运行数据处理，报错：
(sky) asus@asus-System-Product-Name:/media/asus/299D817A2D97AD94/ok_PROJs/JDet$ python tools/preprocess.py --config-file configs/preprocess/dota1_5_preprocess_config.py
[i 1118 17:31:28.681917 08 compiler.py:944] Jittor(1.3.1.18) src: /home/asus/anaconda3/envs/sky/lib/python3.7/site-packages/jittor
[i 1118 17:31:28.689649 08 compiler.py:945] g++ at /usr/bin/g++(7.5.0)
[i 1118 17:31:28.689716 08 compiler.py:946] cache_path: /home/asus/.cache/jittor/jt1.3.1/g++7.5.0/py3.7.9/Linux-5.4.0-89xd6/AMDRyzen93950Xxea/default
[i 1118 17:31:28.697931 08 init.py:372] Found nvcc(10.1.105) at /usr/local/cuda-10.1/bin/nvcc.
[i 1118 17:31:28.754584 08 init.py:372] Found gdb(8.1.0) at /usr/bin/gdb.
[i 1118 17:31:28.763441 08 init.py:372] Found addr2line(2.30) at /usr/bin/addr2line.
[i 1118 17:31:28.866922 08 compiler.py:997] cuda key:cu10.1.105_sm_75
[i 1118 17:31:29.054781 08 init.py:187] Total mem: 62.79GB, using 16 procs for compiling.
[i 1118 17:31:29.114659 08 jit_compiler.cc:27] Load cc_path: /usr/bin/g++
[i 1118 17:31:29.215793 08 init.cc:61] Found cuda archs: [75,]
[i 1118 17:31:29.230639 08 compile_extern.py:497] mpicc not found, distribution disabled.
[i 1118 17:31:29.271848 08 compile_extern.py:29] found /usr/local/cuda-10.1/include/cublas.h
[i 1118 17:31:29.283580 08 compile_extern.py:29] found /usr/lib/x86_64-linux-gnu/libcublas.so
[i 1118 17:31:29.283738 08 compile_extern.py:29] found /usr/lib/x86_64-linux-gnu/libcublasLt.so.10
[i 1118 17:31:29.420154 08 compile_extern.py:29] found /usr/local/cuda-10.1/include/cudnn.h
[i 1118 17:31:29.437553 08 compile_extern.py:29] found /usr/local/cuda-10.1/lib64/libcudnn.so
[i 1118 17:31:30.539454 08 compile_extern.py:29] found /usr/local/cuda-10.1/include/curand.h
[i 1118 17:31:30.572073 08 compile_extern.py:29] found /usr/local/cuda-10.1/lib64/libcurand.so
munmap_chunk(): invalid pointer
已放弃 (核心已转储)
(sky) asus@asus-System-Product-Name:/media/asus/299D817A2D97AD94/ok_PROJs/JDet$ python -V
Python 3.7.9

[HeuristicLU]

我昨天才配置的环境，各项东西应该都是新版本。cuda版本是10.1，g++是7.5.0，python版本是3.7.9

[li-xl]

看起来像是环境和torch冲突了，在preprocess.py的第一行，加一个import torch试试？ 祝好

…

---原始邮件--- 发件人: ***@***.***> 发送时间: 2021年11月18日(周四) 上午9:39 收件人: ***@***.***>; 抄送: ***@***.***>; 主题: [Jittor/JDet] dota数据处理报错munmap_chunk(): invalid pointer (Issue #35) 您好，我遇到些问题，想请教下 我的配置文件type='DOTA1_5' source_dataset_path='/media/asus/299D817A2D97AD94/ok_PROJs/JDet/datasets/DOTA1_5/' target_dataset_path='/media/asus/299D817A2D97AD94/ok_PROJs/JDet/datasets/processed_DOTA1_5/' 路径没有错误，DOTA1_5下面是挑选出来的部分数据，我在其他程序上测过，没有问题。 运行数据处理，报错： (sky) ***@***.***:/media/asus/299D817A2D97AD94/ok_PROJs/JDet$ python tools/preprocess.py --config-file configs/preprocess/dota1_5_preprocess_config.py [i 1118 17:31:28.681917 08 compiler.py:944] Jittor(1.3.1.18) src: /home/asus/anaconda3/envs/sky/lib/python3.7/site-packages/jittor [i 1118 17:31:28.689649 08 compiler.py:945] g++ at /usr/bin/g++(7.5.0) [i 1118 17:31:28.689716 08 compiler.py:946] cache_path: /home/asus/.cache/jittor/jt1.3.1/g++7.5.0/py3.7.9/Linux-5.4.0-89xd6/AMDRyzen93950Xxea/default [i 1118 17:31:28.697931 08 init.py:372] Found nvcc(10.1.105) at /usr/local/cuda-10.1/bin/nvcc. [i 1118 17:31:28.754584 08 init.py:372] Found gdb(8.1.0) at /usr/bin/gdb. [i 1118 17:31:28.763441 08 init.py:372] Found addr2line(2.30) at /usr/bin/addr2line. [i 1118 17:31:28.866922 08 compiler.py:997] cuda key:cu10.1.105_sm_75 [i 1118 17:31:29.054781 08 init.py:187] Total mem: 62.79GB, using 16 procs for compiling. [i 1118 17:31:29.114659 08 jit_compiler.cc:27] Load cc_path: /usr/bin/g++ [i 1118 17:31:29.215793 08 init.cc:61] Found cuda archs: [75,] [i 1118 17:31:29.230639 08 compile_extern.py:497] mpicc not found, distribution disabled. [i 1118 17:31:29.271848 08 compile_extern.py:29] found /usr/local/cuda-10.1/include/cublas.h [i 1118 17:31:29.283580 08 compile_extern.py:29] found /usr/lib/x86_64-linux-gnu/libcublas.so [i 1118 17:31:29.283738 08 compile_extern.py:29] found /usr/lib/x86_64-linux-gnu/libcublasLt.so.10 [i 1118 17:31:29.420154 08 compile_extern.py:29] found /usr/local/cuda-10.1/include/cudnn.h [i 1118 17:31:29.437553 08 compile_extern.py:29] found /usr/local/cuda-10.1/lib64/libcudnn.so [i 1118 17:31:30.539454 08 compile_extern.py:29] found /usr/local/cuda-10.1/include/curand.h [i 1118 17:31:30.572073 08 compile_extern.py:29] found /usr/local/cuda-10.1/lib64/libcurand.so munmap_chunk(): invalid pointer 已放弃 (核心已转储) (sky) ***@***.***:/media/asus/299D817A2D97AD94/ok_PROJs/JDet$ python -V Python 3.7.9 — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.

[HeuristicLU]

我加了import torch，数据预处理ok了，但是训练的时候依旧报这个错。我现在环境里面是torch1.4，我又尝试了一个torch1.5的环境，还是一样，最后我自己新建了一个conda环境，不安torch，只安jittor，这样没有问题，可以数据预处理也可以进行训练

[HeuristicLU]

您好，我运行可视化有点问题。
指令：(jittor) root@asus-System-Product-Name:/media/asus/299D817A2D97AD94/ok_PROJs/JDet# python tools/run_net.py --config-file=configs/oriented_rcnn_r50_fpn_1x_dota_with_flip.py --task=vis_test --save_dir=./

报错：Loading config from: configs/oriented_rcnn_r50_fpn_1x_dota_with_flip.py
[w 1118 21:52:13.688467 76 init.py:1075] load parameter fc.weight failed ...
[w 1118 21:52:13.688516 76 init.py:1075] load parameter fc.bias failed ...
[w 1118 21:52:13.688541 76 init.py:1093] load total 267 params, 2 failed
Thu Nov 18 21:52:13 2021 Loading model parameters from work_dirs/oriented_rcnn_r50_fpn_1x_dota_with_flip/checkpoints/ckpt_12.pkl
0it [00:00, ?it/s]
0it [00:16, ?it/s]
Traceback (most recent call last):
File "tools/run_net.py", line 56, in
main()
File "tools/run_net.py", line 53, in main
runner.run_on_images(args.save_dir)
File "/home/asus/anaconda3/envs/jittor/lib/python3.7/site-packages/jittor/init.py", line 123, in inner
ret = func(*args, **kw)
File "/home/asus/anaconda3/envs/jittor/lib/python3.7/site-packages/jittor/init.py", line 291, in inner
ret = func(*args, **kw)
File "/media/asus/299D817A2D97AD94/ok_PROJs/JDet/python/jdet/runner/runner.py", line 170, in run_on_images
visualize_results(sync(results),get_classes_by_name(self.test_dataset.dataset_type),[t["img_file"] for t in targets],save_dir)
File "/media/asus/299D817A2D97AD94/ok_PROJs/JDet/python/jdet/utils/visualization.py", line 59, in visualize_results
draw_bboxes(img_file,bboxes,labels=labels,scores=scores,class_names=classnames,out_file=save_file,**kwargs)
File "/media/asus/299D817A2D97AD94/ok_PROJs/JDet/python/jdet/utils/draw.py", line 337, in draw_bboxes
draw_func(ax, bboxes[i:i+1], [text], colors[labels[i]], thickness, font_size)
File "/media/asus/299D817A2D97AD94/ok_PROJs/JDet/python/jdet/utils/draw.py", line 156, in draw_poly
horizontalalignment='left')
File "/home/asus/.local/lib/python3.7/site-packages/matplotlib/axes/_axes.py", line 765, in text
t = mtext.Text(x, y, text=s, **effective_kwargs)
File "/home/asus/.local/lib/python3.7/site-packages/matplotlib/text.py", line 166, in init
self.update(kwargs)
File "/home/asus/.local/lib/python3.7/site-packages/matplotlib/text.py", line 179, in update
super().update(kwargs)
File "/home/asus/.local/lib/python3.7/site-packages/matplotlib/artist.py", line 996, in update
raise AttributeError(f"{type(self).name!r} object "
AttributeError: 'Text' object has no property 'transform_rotates_text'

麻烦再帮忙看下，谢啦。
还要jittor没有评估函数么？？我用了dota_devkit评的，看似好像没有集成这块？

[li-xl]

这是matplotlib的错误，您更新下matplotlib试试。评估函数是指算mAP的吗，可以参考jdet/data/dota.py:evaluate 和 jdet/data/devkits/voc_eval.py

[li-xl]

munmap_chunk(): invalid pointer 这个错误是和pytorch冲突导致的，如果训练出现这个可以在run_net.py 的第一行加上import torch.

[HeuristicLU]

赞！