Skip to content
This repository has been archived by the owner on Oct 19, 2023. It is now read-only.

Expecting value: line 4 column 15 (char 79) #42

Closed
thomas-yanxin opened this issue Apr 25, 2023 · 5 comments
Closed

Expecting value: line 4 column 15 (char 79) #42

thomas-yanxin opened this issue Apr 25, 2023 · 5 comments
Assignees

Comments

@thomas-yanxin
Copy link

When I tried to use langchain-serve in this project, I encountered such a problem. Could you please help me look at it?

image

@deepankarm
Copy link
Contributor

Hi @thomas-yanxin, thanks for trying lcserve. Could you please give us the steps to run the lc-serve command ourselves and please copy paste the curl command in a code format.

@deepankarm deepankarm self-assigned this Apr 25, 2023
@thomas-yanxin
Copy link
Author

@deepankarm
Tks!
I wrote the script based on this tutorial. I performed the following steps:

  1. pip install langchain-serve
  2. lc-serve deploy local jina_serving
  3. run the curl command:
    1).
curl -X 'POST' \
  'http://120.237.18.56:8080/reinit_model' \
  -H 'accept: application/json' \
  -H 'Content-Type: application/json' \
  -d '{
  "large_language_model": "ChatGLM-6B-int8",
  "embedding_model": "text2vec-base",
}' 

This command was executed successfully!
2)

curl -X 'POST' \
  'http://localhost:8080/predict' \
  -H 'accept: application/json' \
  -H 'Content-Type: application/json' \
  -d '{
  "input": "ChatGLM-6B的具体局限性?",
  " file_path": "./README.md",
   "use_web": True,
   "top_k": 3,
   "history_len": 1,
   "temperature": 0.01,
   "top_p": 0.1,
   "history": []
}'

but this didn't, and the above error appears.

@deepankarm
Copy link
Contributor

Can you please change True to true and retry?

curl -X 'POST' \
  'http://localhost:8080/predict' \
  -H 'accept: application/json' \
  -H 'Content-Type: application/json' \
  -d '{
  "input": "ChatGLM-6B的具体局限性?",
  " file_path": "./README.md",
   "use_web": true,
   "top_k": 3,
   "history_len": 1,
   "temperature": 0.01,
   "top_p": 0.1,
   "history": []
}'

@thomas-yanxin
Copy link
Author

Ok, I will try it now and have a conclusion to communicate with you here! Thanks!

@thomas-yanxin
Copy link
Author

Success! Thanks!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants