Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

community: Spider integration #20937

Merged
merged 15 commits into from
Apr 27, 2024
Merged

community: Spider integration #20937

merged 15 commits into from
Apr 27, 2024

Conversation

WilliamEspegren
Copy link
Contributor

@WilliamEspegren WilliamEspegren commented Apr 26, 2024 •
edited
Loading

Added the Spider.cloud document loader. Spider is the fastest and cheapest crawler that returns LLM-ready data.

- **Description:** Adds Spider data loader
- **Dependencies:** spider-client
- **Twitter handle:** @WilliamEspegren

@vercel Vercel
Copy link

vercel bot commented Apr 26, 2024 •
edited
Loading

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
langchain ✅ Ready (Inspect) Visit Preview 💬 Add feedback Apr 27, 2024 9:45pm

@WilliamEspegren WilliamEspegren changed the title community: SpiderWebAI.xyz integration community: Spider.cloud integration Apr 26, 2024
@WilliamEspegren WilliamEspegren changed the title community: Spider.cloud integration community: Spider integration Apr 26, 2024
@WilliamEspegren WilliamEspegren marked this pull request as ready for review April 26, 2024 19:22
@dosubot dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. Ɑ: doc loader Related to document loader module (not documentation) 🤖:docs Changes to documentation and examples, like .md, .rst, .ipynb files. Changes to the docs/ folder labels Apr 26, 2024
@dosubot dosubot bot added the lgtm PR looks good. Use to confirm that a PR is ready for merging. label Apr 27, 2024
@baskaryan baskaryan enabled auto-merge (squash) April 27, 2024 00:50
auto-merge was automatically disabled April 27, 2024 15:16

Head branch was pushed to by a user without write access

@WilliamEspegren
Copy link
Contributor Author

@baskaryan any idea why this is failing?

@ccurme
Copy link
Collaborator

ccurme commented Apr 27, 2024

The docs build failed because the API reference link was missing a URL. Our docs will automatically populate API reference links so I just removed the cell.

Screenshot 2024-04-27 at 5 38 12 PM

@ccurme ccurme enabled auto-merge (squash) April 27, 2024 21:41
@ccurme ccurme merged commit 804390b into langchain-ai:master Apr 27, 2024
61 checks passed
@WilliamEspegren WilliamEspegren mentioned this pull request May 16, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@baskaryan baskaryan baskaryan approved these changes

Assignees
No one assigned
Labels
Ɑ: doc loader Related to document loader module (not documentation) 🤖:docs Changes to documentation and examples, like .md, .rst, .ipynb files. Changes to the docs/ folder lgtm PR looks good. Use to confirm that a PR is ready for merging. size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@WilliamEspegren @ccurme @baskaryan