You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
def fetch_with_crawl(url):
# Create an instance of WebCrawler
crawler = WebCrawler()
# Warm up the crawler (load necessary models)
crawler.warmup()
# Run the crawler on a URL
result = crawler.run(url=url)
# Print the extracted content
# print(result.markdown)
return result.markdown
Let me know if you'd like me to add anything else to the issue!
The text was updated successfully, but these errors were encountered:
I'm experiencing an issue where I'm unable to scrape a PDF URL using the [library/tool name]. The URL in question is https://www.myelectric.coop/wp-content/uploads/Electric-Vehicle-Charging-Equipment-Rebates.pdf.
Also, is there an example to use crawl4ai with Azure open AI?
Steps to Reproduce:
Attempt to scrape the PDF URL using the crawl4ai
Observe that the scraping process fails or returns an error
Expected Behavior:
The crawl4ai should be able to successfully scrape the PDF URL and return the contents.
Actual Behavior:
The [library/tool name] is unable to scrape the PDF URL and returns an error or fails to complete the scraping process.
Error Message:
""" Failed to crawl https://www.myelectric.coop/wp-content/uploads/Electric-Vehicle-Charging-Equipment-Rebates.pdf, error: can only concatenate str (not "NoneType") to str"""
Reproduction Code:
def fetch_with_crawl(url):
# Create an instance of WebCrawler
crawler = WebCrawler()
Let me know if you'd like me to add anything else to the issue!
The text was updated successfully, but these errors were encountered: