Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use playwright instead of requests for browse #96

Merged

Conversation

ryanmac
Copy link
Contributor

@ryanmac ryanmac commented Apr 3, 2023

Switch out the browse feature with Playwright. Many sites do not work with requests. Playwright imitates the browser better.

This also adds a new requirement for install:

pip install playwright
playwright install

This also includes:

  • Hide auto_gpt_workspace/* in .gitignore
  • Mac Python 3.11 support (removed dirtyjson in favor of json)
  • Updated requirements.txt

Removing unnecessary files
Copy link
Contributor

@nponeccop nponeccop left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Split into atomic PRs.

.gitignore Outdated
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Submit this change as a separate PR. PRs should be atomic, not mixing unrelated changes together.

requirements.txt Outdated
@@ -1,6 +1,6 @@
beautifulsoup4
colorama==0.4.6
dirtyjson==1.0.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why? It is unrelated to the Playwrite replacements. Separate PR. Even if it was related, delete, not comment.

requirements.txt Outdated
@@ -9,5 +9,5 @@ readability-lxml==0.8.1
requests
tiktoken==0.3.3
docker
# googlesearch-python
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pinning down a dependency is unrelated. Put to a separate PR.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Using JSON instead of Dirty JSON should be either in a separate PR or documented in the description of this PR as for why it is important

@nponeccop
Copy link
Contributor

@ryanmac Resolve the conflicts

@BillSchumacher
Copy link
Contributor

Looks good for the most part if you do decide to update this move to commands/ and remove duplicate functions please.

@BillSchumacher BillSchumacher merged commit f785c8c into Significant-Gravitas:master Apr 15, 2023
tgonzales pushed a commit to tgonzales/Auto-GPT that referenced this pull request Apr 19, 2023
…_interfaces_and_types

feat: add interfaces, types and constants file
sindlinger pushed a commit to Orgsindlinger/Auto-GPT-WebUI that referenced this pull request Sep 25, 2024
…owser

Use playwright instead of requests for browse
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants