[LLaMA2-7b] Warning: The shape inference of opmx::ParallelEmbedding type is missing, so it may result in wrong shape inference for the exported graph. Please consider adding it in symbolic function. (function UpdateReliable)

[syheliel]

script:

popd ./model_zoo/llama/facebook/
export MP=1
OMP_NUM_THREADS=${MP} torchrun --nproc_per_node ${MP} \
Export.py --ckpt_dir /data/model_weight/llama/llama-2-7b/ \
--tokenizer_path /data/model_weight/llama/tokenizer.model \
--export_path ./out \
--fused_qkv 1 --fused_kvcache 1 --auto_causal 1 \
--quantized_cache 1 --dynamic_batching 1 

warning:

Loaded: layers.27.attention.wv.weight -> layers.27.attention.wqkv.weight[torch.Size([4096, 4096])]
Loaded: layers.27.attention.wo.weight -> layers.27.attention.wo.weight[torch.Size([4096, 4096])]
Loaded: layers.27.feed_forward.w1.weight -> layers.27.feed_forward.wu.weight[torch.Size([11008, 4096])]
Loaded: layers.27.feed_forward.w2.weight -> layers.27.feed_forward.w2.weight[torch.Size([4096, 11008])]
[ignore]
Loaded: layers.31.ffn_norm.weight -> layers.31.ffn_norm.weight[torch.Size([4096])]
rope.freqs is not loaded.
Loaded in 9.71 seconds
[rank0]:[W shape_type_inference.cpp:1973] Warning: The shape inference of opmx::ParallelEmbedding type is missing, so it may result in wrong shape inference for the exported graph. Please consider adding it in symbolic function. (function UpdateReliable)
[rank0]:[W shape_type_inference.cpp:1973] Warning: The shape inference of opmx::ColumnParallelLinear type is missing, so it may result in wrong shape inference for the exported graph. Please consider adding it in symbolic function. (function UpdateReliable)
[rank0]:[W shape_type_inference.cpp:1973] Warning: The shape inference of opmx::Reshape type is missing, so it may result in wrong shape inference for the exported graph. Please consider adding it in symbolic function. (function UpdateReliable)
[ignore]
[rank0]:[W shape_type_inference.cpp:1973] Warning: The shape inference of opmx::ColumnParallelLinear type is missing, so it may result in wrong shape inference for the exported graph. Please consider adding it in symbolic function. (function UpdateReliable)

[Alcanderian]

Just ignore these warning, we do not need the shape inference for the exported graph