HNSWLib not compatible with 0.0.96

[shawnesquivel]

Trying to use HNSWLib-node

Error message:

Please install hnswlib-node as a dependency with e.g., `npm install -S hnswlib-node` 

With LangChain 0.0.96

[shawnesquivel]

This was fixed in the interim by downgrading to version 0.0.75.

Will there be any fix for this?

[gregorym]

Also facing the same error

[shawnesquivel]

@gregorym were you able to fix it or just downgraded for now?

[gregorym]

I havent' tried yet but I also found this #943

[jacoblee93]

Best I can tell the version of HNSWLib used hasn't changed - can you give me a bit more info about your setup?

[matiasmm]

I'm experiencing the same thing, and I've debugged the line where the error is happening.

You can see that is throwing a new Exception and ignoring the orignal one (of the previous line). So the original cause of the issue is hidden.

in MY case (which might not be everybody's case) the actual error that is causing this is:

"You need to run with a version of node that supports ES Modules in the VM API. See https://jestjs.io/docs/ecmascript-modules"

So I would ask console.log the actual err variable in addition to this human readable error that might not be accurate

[jacoblee93]

Agree we should log the error - want to open a PR? Otherwise I can add it when I get a minute.

[dmb0058]

Is there a known combination of langchain and hnswlib that works on lambda?

With hnswlib-node 1.4.2 and langchain downgraded to 0.0.75 I get the "Please install hnswlib-node as a dependency with, e.g. npm install -S hnswlib-node" error.

With hnswlib-node 1.4.2 and langchain 0.0.105 the error is slightly different: "Could not import hnswlib-node. Please install hnswlib-node as a dependency with, e.g. npm install -S hnswlib-node. Error: /opt/nodejs/node_modules/hnswlib-node/build/Release/addon.node: cannot open shared object file: No such file or directory"

[batjko]

I had the same on Node 18 and Langchain 0.0.143.
But then I installed hnswlib-node manually and it started working fine (ran into different issue after that, but it created the vector store with it at least).

[dominicdev]

I had the same on Node 18 and Langchain 0.0.143. But then I installed hnswlib-node manually and it started working fine (ran into different issue after that, but it created the vector store with it at least).

how to you install manually?

[batjko]

how to you install manually?

The usual npm install hnswlib-node, like any other node package.
It may require you to install some native build tools, e.g. on Linux I needed to make sure to have these:

$ sudo apt-get install -y build-essential gcc python3 make

[DutchPrince]

I have the same issue with node versions 18.18.2 - 20.9.0 on MacOS

edit: #943 (comment) this worked for me :)

[dosubot]

Hi, @shawnesquivel,

I'm helping the langchainjs team manage their backlog and am marking this issue as stale. It seems that the issue you raised regarding the compatibility problem with HNSWLib-node library and version 0.0.96 of LangChain has not been resolved yet. Several users, including gregorym, matiasmm, and DutchPrince, reported experiencing the same issue. There were discussions around temporary workarounds such as downgrading LangChain or manually installing hnswlib-node, but no official resolution has been provided.

Could you please confirm if this issue is still relevant to the latest version of the langchainjs repository? If it is, please let the langchainjs team know by commenting on the issue. Otherwise, feel free to close the issue yourself, or it will be automatically closed in 7 days. Thank you for your understanding and contribution to the langchainjs community.