In code,we installed langchain and openAi library. OpenAi key is stored in some environment variable that can be used. We have a directory loader which is a utility used to read directory that contains files. And unstructured loader is a loader class present in directory loader,which is going to load various types of files such as text and pdf files. After running the data directory,we get the number of documents present in that particular directory. Then we splitted these documents to create chunks by using LangChain. So TextSplitter takes our document and gives us chunks to create the OpenAi Embeddings.
Akanksha11S/Hackathon
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published