facing problem in training code

[DeepaliVerma]

❓ Questions and Help

Sir i m facing an issue

1. undefined symbol: _ZN3c105ErrorC1ENS_14SourceLocationERKSs
2. subprocess.CalledProcessError: Command '['/home/cse/anaconda3/envs/scene_graph_benchmark/bin/python', u'-u', 'tools/relation_train_net.py', u'--local_rank=1', '--config-file', 'configs/e2e_relation_X_101_32_8_FPN_1x.yaml', 'MODEL.ROI_RELATION_HEAD.USE_GT_BOX', 'True', 'MODEL.ROI_RELATION_HEAD.USE_GT_OBJECT_LABEL', 'False', 'MODEL.ROI_RELATION_HEAD.PREDICTOR', 'CausalAnalysisPredictor', 'MODEL.ROI_RELATION_HEAD.CAUSAL.EFFECT_TYPE', 'none', 'MODEL.ROI_RELATION_HEAD.CAUSAL.FUSION_TYPE', 'sum', 'MODEL.ROI_RELATION_HEAD.CAUSAL.CONTEXT_LAYER', 'motifs', 'SOLVER.IMS_PER_BATCH', '12', 'TEST.IMS_PER_BATCH', '2', 'DTYPE', 'float16', 'SOLVER.MAX_ITER', '50000', 'SOLVER.VAL_PERIOD', '2000', 'SOLVER.CHECKPOINT_PERIOD', '2000', 'GLOVE_DIR', '/home/cse/neural/Scene-Graph-Benchmark.pytorch/glove', 'MODEL.PRETRAINED_DETECTOR_CKPT', '/home/cse/neural/Scene-Graph-Benchmark.pytorch/checkpoints/pretrained_faster_rcnn/model_final.pth', 'OUTPUT_DIR', '/home/cse/neural/Scene-Graph-Benchmark.pytorch/checkpoints/causal-motifs-sgcls-exmp']' returned non-zero exit status 1

please suggest me any solution for resolving these issues.

[KaihuaTang]

I'm not sure. Try using another --master_port number,
or you didn't install APEX / build the project correctly.
(https://github.com/KaihuaTang/Scene-Graph-Benchmark.pytorch/blob/master/INSTALL.md)

[DeepaliVerma]

sir can you please tell me how i decide which master port i have to give? and I installed and build my APEX/

[KaihuaTang]

sir can you please tell me how i decide which master port i have to give? and I installed and build my APEX/

You can use any master port ID as long as there are no collisions among running programs, e.g., if you started two programs using the same master port ID, there would be an error message.

If you strictly follow the INSTALL.md, your APEX should be ok

[haoopan]

@DeepaliVerma Have you solved this problem? Thx

[shipra25jain]

Hello,
Has anybody fixed this bug?

Thanks

[DeepaliVerma]

No, I am not able to fix that problem.

…

On Mon, Aug 17, 2020 at 9:21 PM Shipra Jain ***@***.***> wrote: Hello, Has anybody fixed this bug? Thanks — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#10 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AIWY7TTKZITWOKCQS3XN2F3SBFGXRANCNFSM4LKXFAWA> .

-- With Regards Deepali Verma

[haoopan]

Hello,
Has anybody fixed this bug?

Thanks

Don't use float16 in 'DTYPE' can solve this problem in my situation.