Async Web Crawler

A high-performance Python web crawler built with asyncio and aiohttp.

Features

Asynchronous Crawling: Uses a semaphore to manage concurrency.
Recursion Depth: Automatically crawls internal links.
Reporting: Generates both machine-readable JSON and human-readable Markdown audits.

uv run main.py "[https://example.com](https://example.com)" 3 25

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
.gitignore		.gitignore
.python-version		.python-version
Command		Command
README.md		README.md
crawl.py		crawl.py
json_report.py		json_report.py
main.py		main.py
markdown_report.py		markdown_report.py
pyproject.toml		pyproject.toml
test_crawl.py		test_crawl.py
uv.lock		uv.lock