This project provides a powerful web scraping tool that fetches search results and converts them into Markdown format using FastAPI, SearXNG, and Browserless. It includes the capability to use proxies for web scraping and handles HTML content conversion to Markdown efficiently.

Try multiple options like pyppeteer, playwright and browerless.io

A demo LLM application that explores using RAG to describe a product.