Enable support for Browsers, Cloudflare Workers, Next.js Browser/Serverless/Edge #632

nfcampos · 2023-04-05T15:01:28Z

~~- [ ] Split File loaders from Blob loaders (File loaders remain with the existing name, Blob loaders are new)~~ Will tackle later in #663

Fix Cannot find module '@fortaine/fetch-event-source/parse' from '../langchain/dist/util/axios-fetch-adapter.js' replace with eventsource-parser ?
Add package to test on CF Workers
Add package to test on browser with create-react-app template
Test when peer dependencies are not present (not sure how to do this in CI, but that's secondary)

vercel · 2023-04-05T15:01:32Z

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
langchainjs-docs	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Apr 10, 2023 2:29pm

langchain/src/embeddings/index.ts

dankolesnikov · 2023-04-05T23:57:50Z

this is very exciting

BleedingDev · 2023-04-06T00:21:37Z

I am hyped about this. Still have problems with streaming, this might be huge step forward. :)

rlancemartin · 2023-04-06T23:42:46Z

+1, i will test w/ the lex-gpt app (https://lex-gpt.vercel.app/) as soon as this goes in :)

Sameedahmad · 2023-04-07T10:02:41Z

@PineappleExpress808 Any updates? Is it working and if so let us know of any roadblocks ahead.

rlancemartin · 2023-04-07T16:06:48Z

@PineappleExpress808 Any updates? Is it working and if so let us know of any roadblocks ahead.

i haven't tested. will wait for this PR to go in and a new release is cut.

Vercel mentioned that streaming will work if:
1/ we are able to enable Vercel edge functions w/ Langchain (e.g., fs is not available in Edge runtime)

or

2/ users migrate Vercel apps to use route handlers (https://beta.nextjs.org/docs/routing/route-handlers)

in any case, i'll definitely test w/ this update.

…kers

agola11

From my perspective (mostly looking at import refactoring) looks good! Thanks!

agola11 · 2023-04-10T02:19:53Z

test-exports-vercel/src/pages/api/hello-edge.ts

+  });
+
+  // Run the chain but don't await it
+  chain.run("hello").catch(console.error);


why don't we await here?

Because we need the response to start being sent to the user right away. If we await then we'll only start sending response after the chain run finishes, therefore no streaming

agola11 · 2023-04-10T02:21:53Z

langchain/src/util/event-source-parse.ts

why do we need this?

Because there was some packaging issue with the dependency we were using for this and it was easiest to include a copy here. Same licence as we have

agola11 · 2023-04-10T02:23:56Z

langchain/scripts/create-entrypoints.js

+            entryPoint = {
+              node: entryPoint,
+            };
+          } else if (fs.existsSync(litePath)) {


yeah should probably remove

Add more docs for other envs

vercel bot deployed to Preview – langchainjs-docs April 5, 2023 15:04 View deployment

nfcampos force-pushed the nc/test-exports-cf branch from 6e05014 to 309027b Compare April 5, 2023 15:05

nfcampos commented Apr 5, 2023

View reviewed changes

langchain/src/embeddings/index.ts Outdated Show resolved Hide resolved

vercel bot deployed to Preview – langchainjs-docs April 5, 2023 15:07 View deployment

vercel bot deployed to Preview – langchainjs-docs April 5, 2023 15:09 View deployment

vercel bot deployed to Preview – langchainjs-docs April 5, 2023 15:10 View deployment

nfcampos force-pushed the nc/test-exports-cf branch from 4738998 to 180de53 Compare April 5, 2023 15:51

vercel bot deployed to Preview – langchainjs-docs April 5, 2023 15:52 View deployment

vercel bot had a problem deploying to Preview – langchainjs-docs April 5, 2023 17:36 Failure

vercel bot deployed to Preview – langchainjs-docs April 5, 2023 17:42 View deployment

nfcampos changed the title ~~Add test-exports-cf package to test using LangChain on Cloudflare Workers~~ Enable support for CF Workers without node_compat flag, Add package to test using LangChain on Cloudflare Workers Apr 5, 2023

nfcampos changed the title ~~Enable support for CF Workers without node_compat flag, Add package to test using LangChain on Cloudflare Workers~~ Enable support for CF Workers without node_compat flag, Add package to test usage on Cloudflare Workers Apr 5, 2023

agola11 approved these changes Apr 5, 2023

View reviewed changes

vercel bot deployed to Preview – langchainjs-docs April 5, 2023 20:30 View deployment

nfcampos changed the title ~~Enable support for CF Workers without node_compat flag, Add package to test usage on Cloudflare Workers~~ Enable support for CF Workers without node_compat flag, Add package to test on CF Workers Apr 5, 2023

vercel bot deployed to Preview – langchainjs-docs April 5, 2023 20:50 View deployment

nfcampos force-pushed the nc/test-exports-cf branch 2 times, most recently from 05088f4 to 1464380 Compare April 6, 2023 13:24

nfcampos changed the title ~~Enable support for CF Workers without node_compat flag, Add package to test on CF Workers~~ Enable support for Browsers, and CF Workers without node_compat flag Apr 7, 2023

nfcampos force-pushed the nc/test-exports-cf branch 3 times, most recently from b78d9e4 to 3999b76 Compare April 8, 2023 16:38

nfcampos added 2 commits April 9, 2023 15:41

Add test-exports-cf package to test using LangChain on Cloudflare Wor…

8b2cd13

…kers

Add readme

b899fb3

nfcampos added 2 commits April 9, 2023 22:24

Remove unused dev deps

09bb7ae

Add back zod in examples deps because of eslint

9cb6171

agola11 self-requested a review April 9, 2023 23:30

agola11 approved these changes Apr 10, 2023

View reviewed changes

agola11 and others added 3 commits April 10, 2023 04:42

Merge branch 'main' into nc/test-exports-cf

9fd3a6c

Code review

fc0f5ef

Update upgrade instructions

48a7ef9

vercel bot deployed to Preview April 10, 2023 07:01 View deployment

Update pdf loader docs

dce825d

nfcampos force-pushed the nc/test-exports-cf branch from 789391b to dce825d Compare April 10, 2023 07:16

vercel bot deployed to Preview April 10, 2023 07:21 View deployment

nfcampos added 4 commits April 10, 2023 10:01

Add test-exports-vite, update docusaurus

e728224

Add Deno section

0ae48ef

Merge pull request #705 from hwchase17/nc/env-docs

7deaaed

Add more docs for other envs

Merge branch 'main' into nc/test-exports-cf

16d214a

vercel bot deployed to Preview April 10, 2023 10:04 View deployment

Add node-only labels to docs

299d647

vercel bot deployed to Preview April 10, 2023 10:48 View deployment

Add one more alternative for loading PDFLoader

9245c7b

vercel bot deployed to Preview April 10, 2023 12:24 View deployment

nfcampos linked an issue Apr 10, 2023 that may be closed by this pull request

pdfjs requires canvas which doesn't run on ARM #709

Closed

nfcampos mentioned this pull request Apr 10, 2023

pdfjs requires canvas which doesn't run on ARM #709

Closed

Smaller node label in docs sidebar

3369f7d

vercel bot deployed to Preview April 10, 2023 14:29 View deployment

nfcampos merged commit 2a6d4be into main Apr 10, 2023
11 checks passed

nfcampos deleted the nc/test-exports-cf branch April 10, 2023 18:32

yassinebridi mentioned this pull request Apr 18, 2023

Is there plan for a typescript version? eth-sri/lmql#1

Open

dosubot bot mentioned this pull request Nov 8, 2023

Illegal invocation with langchain/llms/bedrock/web on Cloudflare Worker #3187

Closed

dosubot bot mentioned this pull request Dec 21, 2023

YoutubeLoader.createFromUrl is not a function #3695

Closed

dosubot bot mentioned this pull request Apr 20, 2024

Error : Cannot get final name for export 'getRuntime' of ./node_modules/openai/_shims/auto/runtime-node.mjs #5161

Open

5 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Enable support for Browsers, Cloudflare Workers, Next.js Browser/Serverless/Edge #632

Enable support for Browsers, Cloudflare Workers, Next.js Browser/Serverless/Edge #632

nfcampos commented Apr 5, 2023 •

edited

vercel bot commented Apr 5, 2023 •

edited

dankolesnikov commented Apr 5, 2023

BleedingDev commented Apr 6, 2023

rlancemartin commented Apr 6, 2023

Sameedahmad commented Apr 7, 2023

rlancemartin commented Apr 7, 2023 •

edited

agola11 left a comment

agola11 Apr 10, 2023

nfcampos Apr 10, 2023

agola11 Apr 10, 2023

nfcampos Apr 10, 2023

agola11 Apr 10, 2023

Enable support for Browsers, Cloudflare Workers, Next.js Browser/Serverless/Edge #632

Enable support for Browsers, Cloudflare Workers, Next.js Browser/Serverless/Edge #632

Conversation

nfcampos commented Apr 5, 2023 • edited

vercel bot commented Apr 5, 2023 • edited

dankolesnikov commented Apr 5, 2023

BleedingDev commented Apr 6, 2023

rlancemartin commented Apr 6, 2023

Sameedahmad commented Apr 7, 2023

rlancemartin commented Apr 7, 2023 • edited

agola11 left a comment

Choose a reason for hiding this comment

agola11 Apr 10, 2023

Choose a reason for hiding this comment

nfcampos Apr 10, 2023

Choose a reason for hiding this comment

agola11 Apr 10, 2023

Choose a reason for hiding this comment

nfcampos Apr 10, 2023

Choose a reason for hiding this comment

agola11 Apr 10, 2023

Choose a reason for hiding this comment

nfcampos commented Apr 5, 2023 •

edited

vercel bot commented Apr 5, 2023 •

edited

rlancemartin commented Apr 7, 2023 •

edited