Skip to content

URL Intelligence Agent v1.0.0 — Unified Intelligence Release

Choose a tag to compare

@vpicciuolo vpicciuolo released this 31 Aug 17:40
· 204 commits to main since this release

🧠 URL Intelligence Agent v1.0.0

URL in. Identity, evidence and intelligence out.

This is the first official public release of URL Intelligence Agent — an evidence-first, open-source web intelligence agent built for developers, AI agents, marketplaces, directories, research systems, monitoring and automation.

The technology is already used as part of the wider HORNO ecosystem and is now available publicly for developers to inspect, extend, self-host and integrate.

🔥 What it does

Give the agent a public URL and it can investigate what that URL represents, collect supporting evidence, discover connected public information and return structured intelligence with confidence and provenance.

Core capabilities

  • Deep website crawling and site mapping
  • robots.txt and sitemap discovery
  • URL safety and SSRF-aware fetching
  • Metadata and Open Graph extraction
  • JSON-LD and structured-data analysis
  • Entity resolution
  • Evidence and confidence scoring
  • Social profile discovery
  • Public contact discovery
  • People and team extraction
  • Technology fingerprinting
  • Brand intelligence
  • SEO and discoverability audits
  • Security-header posture analysis
  • Trust and transparency signals
  • DNS, mail and TLS intelligence
  • Entity relationship graphs
  • Competitor and comparison intelligence
  • API / OpenAPI / GraphQL discovery
  • Commerce and pricing intelligence
  • Content freshness analysis
  • Internal and external link intelligence
  • Broken-link checking
  • Marketplace and directory listing generation
  • RAG-ready document export
  • Provenance-aware knowledge export
  • URL comparison
  • Batch processing and workers
  • Monitoring snapshots and diffs
  • Scheduled website monitoring
  • Webhook notifications
  • JavaScript rendering fallback
  • Optional Playwright integration
  • Optional OpenAI-compatible reasoning
  • Plugin and extension SDK
  • HTTP API server
  • Native MCP server
  • Markdown, HTML and JSON reports
  • Docker and Docker Compose deployment
  • Redis / Valkey and PostgreSQL integration options
  • Interactive CLI with 39 operations

🤖 MCP ready

Run URL Intelligence Agent as an MCP server:

url-agent mcp