[Components] webscraping_ai

[pipedream-component-development]

webscraping_ai

URLs

• https://webscraping.ai/docs

Actions

scrape-website-html

Prompt

Start a new scraping job with specified configurations. Users must provide the target URL, optional selectors, and other scraping parameters like rendering mode or headers.

URLs

• https://webscraping.ai/docs#tag/HTML/operation/getHTML

scrape-website-text

Prompt

Returns the visible text content of a webpage specified by the URL. Users must provide the target URL and optional text_format and return_links.

URLs

• https://webscraping.ai/docs#tag/Text/operation/getText

ask-question

Prompt

Get an answer to a question about a given web page. Users must provide the target URL and the question.

URLs

• https://webscraping.ai/docs#tag/AI/operation/getQuestion

[vunguyenhung]

Hello everyone, I have tested this PR and there're some test cases failed or needed improvement.

Please check the test report below for more information
https://vunguyenhung.notion.site/Components-webscraping_ai-196bf548bb5e81aca962ee98102f8322

[vunguyenhung]

Hi everyone, all test cases are passed! Ready for release!

Test report
https://vunguyenhung.notion.site/Components-webscraping_ai-196bf548bb5e81aca962ee98102f8322