配置好自定义api后运行python run.py xx_api.py，始终报json错误这是什么原因？

[shensj12]

[2023-11-29 07:34:20,856] [opencompass.openicl.icl_inferencer.icl_gen_inferencer] [INFO] Starting inference process...
0%| | 0/3 [00:09<?, ?it/s]
Traceback (most recent call last):
File "/home/byniu/anaconda3/lib/python3.10/site-packages/requests/models.py", line 971, in json
return complexjson.loads(self.text, **kwargs)
File "/home/byniu/anaconda3/lib/python3.10/json/init.py", line 346, in loads
return _default_decoder.decode(s)
File "/home/byniu/anaconda3/lib/python3.10/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/home/byniu/anaconda3/lib/python3.10/json/decoder.py", line 355, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/data2/SSJ/opencompass/opencompass/run.py", line 342, in
main()
File "/data2/SSJ/opencompass/opencompass/run.py", line 294, in main
runner(tasks)
File "/data2/SSJ/opencompass/opencompass/opencompass/runners/base.py", line 38, in call
status = self.launch(tasks)
File "/data2/SSJ/opencompass/opencompass/opencompass/runners/local_api.py", line 203, in launch
task.run()
File "/data2/SSJ/opencompass/opencompass/opencompass/tasks/openicl_infer.py", line 78, in run
self._inference()
File "/data2/SSJ/opencompass/opencompass/opencompass/tasks/openicl_infer.py", line 126, in _inference
inferencer.inference(retriever,
File "/data2/SSJ/opencompass/opencompass/opencompass/openicl/icl_inferencer/icl_gen_inferencer.py", line 129, in inference
results = self.model.generate_from_template(
File "/data2/SSJ/opencompass/opencompass/opencompass/models/base.py", line 127, in generate_from_template
return self.generate(inputs, max_out_len=max_out_len, **kwargs)
File "/data2/SSJ/opencompass/opencompass/opencompass/models/chatglm_api.py", line 50, in generate
results = list(
File "/home/byniu/anaconda3/lib/python3.10/concurrent/futures/_base.py", line 621, in result_iterator
yield _result_or_cancel(fs.pop())
File "/home/byniu/anaconda3/lib/python3.10/concurrent/futures/_base.py", line 319, in _result_or_cancel
return fut.result(timeout)
File "/home/byniu/anaconda3/lib/python3.10/concurrent/futures/_base.py", line 458, in result
return self.__get_result()
File "/home/byniu/anaconda3/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
raise self._exception
File "/home/byniu/anaconda3/lib/python3.10/concurrent/futures/thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
File "/data2/SSJ/opencompass/opencompass/opencompass/models/chatglm_api.py", line 136, in _generate
response = raw_response.json()
File "/home/byniu/anaconda3/lib/python3.10/site-packages/requests/models.py", line 975, in json
raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

[tonysy]

Please use --debug to check the error

[shensj12]

上面是debug后显示的报错

[yingfhu]

RequestsJSONDecodeError often occurs when the responses is not complete. You can print raw_response.status_code and raw_response.text for more details。
BTW，you might want to use zhipuai_api directly. It should support chatglm models.

[shensj12]

好的，谢谢，我们这里对chatglm进行了微调所以想试一下自己的api