This example demonstrates how to use Scrapegraph-ai for universal web scraping across multiple data formats.
- Multi-format data extraction (JSON, XML, HTML, CSV)
- Automatic format detection
- Unified data output
- Content transformation
- Install required dependencies
- Copy
.env.example
to.env
- Configure your API keys in the
.env
file
from scrapegraphai.graphs import OmniScraperGraph
graph = OmniScraperGraph()
data = graph.scrape("https://example.com/data")
Required environment variables:
OPENAI_API_KEY
: Your OpenAI API key