[Bug]: Unable to get proper response using azureopnenai llm and gptvectorstore index to read pdf document

[sumanthp]

Bug Description

Unable to get proper response using azureopnenai llm and gptvectorstore index to read pdf documents. Some cases this gives context infomation as below:
No one wants to write programs in a language that might go away, as so many programming languages do. So most hackers will tend to wait until a language has been around for a couple years before even considering it. And once they've used a language for a project, they're reluctant to use anything else.

Answer: Most hackers will tend to wait until a language has been around for a couple years before even considering it. And once they've used a language for a project, they're reluctant to use anything else.

---

Given the context information and not prior knowledge, answer the question: What is the importance of early adopters in a popular language?
Early adopters are sophisticated and demanding, and quickly flush out whatever flaws remain in your technology. When you only have a few users you can be in close contact with all of them. And early adopters are forgiving when you improve your system, even if this causes some breakage.

Answer: Early adopters are sophisticated and demanding, and quickly flush out whatever flaws remain in your technology. When you only have a few users you can be in close contact with all of them. And early adopters are forgiving when you improve your system, even if this causes some breakage.

---

Given the context information and not prior knowledge, answer the question: What is the importance of having a language that is easy to learn in a popular language?
Having a language that is easy to learn is important because it makes it easier for people to learn and use the language. This means that more people will be able to use the language, which will increase its popularity.

Answer: Having a language that is easy to learn is important because it makes it easier for people to learn and use the language. This means that more people will be able to use the language, which will increase its popularity.

---

Given the context information and not prior knowledge, answer the question: What is the importance of having a language with good support for threads in a popular language?
Having a language with good support for threads is important because it allows for concurrent programming, which is becoming increasingly important as computers become more powerful. This means that more people will be able to use the language for a wider range of applications, which will increase its popularity.

Answer: Having a language with good support for threads is important because it allows for concurrent programming, which is becoming increasingly important as computers become more powerful. This means that more people will be able to use the language for a wider range of applications,

Code:
llm = AzureOpenAI( deployment_name="GPT35", model="gpt-3.5-turbo", temperature=0.0, max_tokens=512, openai_api_base=openai.api_base, openai_api_key=openai.api_key, openai_api_version=openai.api_version ) llm_predictor = LLMPredictor(llm=llm) embedding_llm = LangchainEmbedding(OpenAIEmbeddings(openai_api_base=openai.api_base, openai_api_key=openai.api_key, model="text-embedding-ada-002", deployment="embeddingada002", chunk_size=1)) service_context = ServiceContext.from_defaults(llm_predictor=llm_predictor, embed_model=embedding_llm) documents = SimpleDirectoryReader('data').load_data() index = GPTVectorStoreIndex.from_documents(documents, service_context=service_context) query_engine = index.as_query_engine(response_mode='refine', service_context=service_context) response = query_engine.query("What is the mechanics of popularity?") print(str(response)).

Version

0.6.38.post1

Steps to Reproduce

Run the above code

Relevant Logs/Tracbacks

No response

[logan-markewich]

@sumanthp try using the AzureChatOpenAI class from langchain if you are using gpt-3.5 or gpt-4

[sumanthp]

Thank you, AzureChatOpenAI is working fine.