Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor services #104

Merged
merged 2 commits into from
Apr 16, 2024
Merged

refactor services #104

merged 2 commits into from
Apr 16, 2024

Conversation

634750802
Copy link
Collaborator

No description provided.

Copy link

vercel bot commented Apr 15, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
rag ✅ Ready (Inspect) Visit Preview 💬 Add feedback Apr 15, 2024 4:18am
rag-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Apr 15, 2024 4:18am
tidb-ai ✅ Ready (Inspect) Visit Preview 💬 Add feedback Apr 15, 2024 4:18am

@634750802 634750802 merged commit 4001b13 into refactor Apr 16, 2024
4 checks passed
634750802 added a commit that referenced this pull request Apr 16, 2024
* use binary as id

* add llamaindex

* add document store

* update

* update

* refine flow

* feat: add tidb vector store

* fix: align table schema to llamaindex node definition

* refactor: align document store to llamaindex dir

* llamdaindex pipeline example

* update

* fix

* add index store

* fix: refine TiDBVectorStore

* fix: should process with uuid_to_bin when insert

* refactor: update schema

* fix sql

* update

* implement importing and indexing tasks logic

* revert storage extension

* update pnpm lock

* fix PdfLoader type

* update

* wrapper API error

* refine document_task schedule API and errors handle

* update

* config: update initial config

* fix: fix get index bug

* update

* update

* update

* update

* fix

* using BLOB_READ_WRITE_TOKEN first if it exists

* fix build ci

* exclude pdfjs canvas dep

* try to fix exceeded the unzipped maximum size of 250 MB

* fix

* fix

* update

* remove splitter abstraction

* remove prompting abstraction

* fix status check

* todo: fix list source API

* fix user not found error message

* refine document import task error handle

* update

* fix ui

* fix ui

* fix

* fix

* fix

* update cronjob

* update cronjob maxDuration

* update speed

* fix

* fix

* update

* update index process duration limit

* fix

* fix

* fix log

* fix sql

* update

* fix retrieve

* update docs

* fix

* fix

* update prompt

* fix context retrieving

* remove log

* speed up!

* fix error messages length

* fill document names

* fix old api

* add url_key to chat

* fix delete chat

* feat: add llm reranker (#96)

* feat: add llm reranker

* support provide query by query string

* fix typo

* feat: support select chat engine

* fix

* reorder fields

* fix source title

* feat: add bitdeer llm (#97)

* feat: add bitdeer llm

* fix: refine error handle

* add index config page

* fix dashboard page

* fix

* fix

* feat: refine ann index preload (#99)

* feat: refine ann index preload

* fix: remove old tables

* remove the old status code

* refactor authentication provider

* migrate settings

* migrate extensions

* add dockerfile

* add source operations

* refactor: refine v1 APIs (#101)

* refactor: refine v1 APIs

* retry required admin

* fix ci

* protect settings API

* feat: impl readonly index config page

* fix: chat session id

* fix: add public dir in dockerfile

* refactor: remove v1 dir in core (#102)

* remove v1 dir

* merge

* chore: move operations to client dir

* chore: remove docs

* chore: remove unused

* feat: add index summary stats

* fix initial table schema (#103)

* fix ci

* fix settings api

* update index editor pages

* fix settings page refresh

* feat: enable llm provider as default reranker

* fix ci

* refactor: use services replacing jobs (#104)

* move import processor to DocumentImportService

* move index processor to DocumentIndexService

* refine chats API

* add github action to build docker image (#106)

* refactor: optimize settings

* fix: flatten empty array settings

* fix: upload image with local fs storage

* try to fix Dockerfile

* try to fix Dockerfile

* prevent re-fetch chats

* ui: update side nav

* ui: support enable index

* fix settings

* update github action

* support update chat engine

* try fix chat stream

* fix: settings schema

* ui: remove hard coded tidb.ai

* ui: support update chat engine's llm and reranker

* feat: support bitdeer embedding and chat api (#107)

* feat: support bitdeer embedding and chat api

* test

* ui: update form default values

---------

Co-authored-by: Jagger <634750802@qq.com>
Co-authored-by: WD <me@wangdi.ink>
@ngaut ngaut deleted the refactor-services branch May 27, 2024 03:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant