[Feature Request]: Firecrawl compatible endpoints

[loorisr]

What needs to be done?

add /v1/scrape, /v1/batch/scrape, /v1/crawl, /v1/search endpoint, compatible (or partially) with Firecrawl API

What problem does this solve?

a lot of AI tools that need to scrape/search on the internet are compatible with Firecrawl but not with Crawl4AI
in my benchmark crawl4ai is faster (with only_text=true)

with a Firecrawl compatibility, Crawl4AI will be used more widely.

Target users/beneficiaries

developers and users of several LLM tools

crawl4ai will be able to be used more widely

Current alternatives/workarounds

I developed https://github.com/loorisr/crawlrouter to use different backend with Firecrawl API

Proposed approach

No response