[Question]: pp_uie微调之后, 推理的output.json没有输出

[Chinesejunzai]

请提出你的问题

步骤链接: https://github.com/PaddlePaddle/PaddleNLP/tree/develop/llm/application/information_extraction
根据链接训练之后, 使用命令:

python predict/predictor.py \
    --model_name_or_path ./checkpoints/ie_ckpts \
    --dtype float16 \
    --data_file ./application/information_extraction/data/test.json \
    --output_file ./application/information_extraction/data/output.json \
    --src_length  512 \
    --max_length  1024 \
    --batch_size  4   

进行推理, 但是在对应的文件夹下找不到推理结果, 即output.json文件, 但是在推理过程中报:

/home/algo/miniconda3/envs/paddle_3/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:711: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
  warnings.warn(warning_message)
/home/algo/miniconda3/envs/paddle_3/lib/python3.10/site-packages/_distutils_hack/__init__.py:30: UserWarning: Setuptools is replacing distutils. Support for replacing an already imported distutils is deprecated. In the future, this condition will fail. Register concerns at https://github.com/pypa/setuptools/issues/new?template=distutils-deprecation.yml
  warnings.warn(
[2025-04-14 11:26:03,553] [ WARNING] - The paddlenlp_ops package is not installed. you can read the docs and install it by hand, you can refer to: https://github.com/PaddlePaddle/PaddleNLP/blob/develop/csrc/README.md
[2025-04-14 11:26:03,558] [ WARNING] - paddlenlp_ops does not exist, please install paddlenlp_ops.

查看这个是因为没有安装推理加速, 但是按照文档说明, 不安装只要不设置的对应参数即可, 推理还是可以继续完成的, 正常是应该有output.json文件的, 但是现在找不到是什么原因

[Chinesejunzai]

对应的环境为:
○ python 3.10.16
○ paddlenlp=3.0.0b4.post20250405
○ paddlepaddle-gpu==3.0.0.dev20250406

[ZHUI]

你好，GPU有在运行吗？

[Chinesejunzai]

嗯嗯, 不使用GPU, 需要手动设置 --inference_model False --quant_type None 才能运行, 直接删除不写不行, 我看咱们文件中有默认值, 是不起作用么