add couchbase vectore store support

[prajwal-pai77]

• Add support for Couchbase as a vector store.
• Update Langchain community version to 0.0.43.

[prajwal-pai77]

Hey @HenryHengZJ How can i add couchbase in here: https://github.com/FlowiseAI/FlowiseDocs/tree/main/integrations/langchain/vector-stores
What is the process to contribute there?

[HenryHengZJ]

Hey @HenryHengZJ How can i add couchbase in here: https://github.com/FlowiseAI/FlowiseDocs/tree/main/integrations/langchain/vector-stores What is the process to contribute there?

thanks for updating the docs as well! here's an example PR

[HenryHengZJ]

@prajwal-pai77 sorry minor conflict for the pnpm lock file as I've merged in some changes, if you dont mind updating that

[prajwal-pai77]

Hey @HenryHengZJ I am having trouble rebasing the pnpm-lock file. But i have managed to push it but it says alot of changes in the pnpm-lock file now, can you please check if this right?
Thanks

[HenryHengZJ]

thanks @prajwal-pai77 !

[HenryHengZJ]

Hey @HenryHengZJ I am having trouble rebasing the pnpm-lock file. But i have managed to push it but it says alot of changes in the pnpm-lock file now, can you please check if this right? Thanks

that's fine, its just the formatting of the lock file that makes the diff large enought to be viewed here

[HenryHengZJ]

@prajwal-pai77 there's some problem when trying to create a new docker image for arm64/amd64:

do you have any idea? or had you came across similar issues?

[prajwal-pai77]

@prajwal-pai77 there's some problem when trying to create a new docker image for arm64/amd64:

do you have any idea? or had you came across similar issues?

Hey @HenryHengZJ I see that you have included cmake now in the docker file. Wanted to know if the issue still persists with the docker build. If it does please let me know what the issue.

[HenryHengZJ]

@prajwal-pai77 there's some problem when trying to create a new docker image for arm64/amd64:
do you have any idea? or had you came across similar issues?

Hey @HenryHengZJ I see that you have included cmake now in the docker file. Wanted to know if the issue still persists with the docker build. If it does please let me know what the issue.

@prajwal-pai77 included Cmake still doesnt work, as you can see the docker image build and push failed - https://github.com/FlowiseAI/Flowise/actions/runs/8977688757/job/24656878006. Here's the CI file - https://github.com/FlowiseAI/Flowise/blob/main/.github/workflows/docker-image.yml

We did managed to made it work once using another higher RAM and CPU machine, and it took up to 40gb of RAM, almost an hour to build that. It also increased the total app size by 500mb..

If there isn't any other workaround alternative, we might have to drop the couchbase integration until we figured out a way

[lokesh-couchbase]

Hey @HenryHengZJ , I went through this and found that the culprit is building the package using Alpine. I checked with the team and as of now we do not support Alpine + Arm64 for Couchbase SDK.
One of the ways to solve this is if we can shift to using Ubuntu instead of Alpine for the builds as ubuntu uses glibc instead of musl and is much more widely adopted.
Please let me know if something can be done from your end, and I have expedited the request internally as well for support of musl but it may take some time.

[HenryHengZJ]

Hey @HenryHengZJ , I went through this and found that the culprit is building the package using Alpine. I checked with the team and as of now we do not support Alpine + Arm64 for Couchbase SDK. One of the ways to solve this is if we can shift to using Ubuntu instead of Alpine for the builds as ubuntu uses glibc instead of musl and is much more widely adopted. Please let me know if something can be done from your end, and I have expedited the request internally as well for support of musl but it may take some time.

thanks for figuring out the issue! did some little experiment and using ubuntu as base docker image seems a lil bit too heavy on top of all the dependencies we already have, bringing the total app size from 900mb to around 1.25gb

[lokesh-couchbase]

Thanks for testing using Ubuntu. However there is really nothing much we can do right now. We still do recommend upgrading to glibc based distro as many of other products might have this as requirement. Even CentOS can be considered.

[HenryHengZJ]

Thanks for testing using Ubuntu. However there is really nothing much we can do right now. We still do recommend upgrading to glibc based distro as many of other products might have this as requirement. Even CentOS can be considered.

yeah, we have a backlog item to work on upgrading the docker to debian based node like bullseye or bookworm, both of which are using glibc. But for now we'll have to temporarily remove the couchbase integration in order to push a new version (some urgent bugfix), until we have the new docker image verified working correctly with all the other integration nodes we have on Flowise