Skip to content

Headless Engine v1.0.0

Choose a tag to compare

@yutuknown yutuknown released this 18 Aug 17:15
· 18 commits to master since this release

Headless Engine v1.0.0

Production v1.0.0 release of Headless Engine—the ultra-lightweight, detection-free, pure-Rust headless browser engine built for AI agents, web scraping, and MCP servers.

This release finalizes the core architectural model: eliminating monolithic Chromium IPC overhead and bypassing WAF execution traps by utilizing an offline rendering pipeline with pure-Rust network execution.

Key Highlights

  • Ultra-Lightweight Footprint (<20MB RAM): Achieved by bypassing native V8 instantiation and Blink compositor threads. Operations execute via pure Rust (scraper + isolated boa_engine), maintaining minimal memory overhead.
  • Offline Rendering WAF Bypass: Successfully defeats Cloudflare and Datadome bot-detection. The engine fetches raw HTML payloads natively via Rust, injects a <base href> tag, and commands headless Chromium to render via file:///. Because Chromium never negotiates TLS with the target, WAFs cannot detect the browser.
  • Sub-Second Execution: Benchmark execution completes in < 1000ms (from initialization, network fetch, full DOM traversal, structural parsing, to LLM compression) on heavy targets like Wikipedia.
  • Clean Developer UX: Terminal CLI logging features a structured, pure-ASCII aesthetic with ANSI syntax highlighting.
  • LLM-Optimized Markdown Engine: Built-in DOM-to-Markdown converter strips boilerplate tags (<script>, <style>, <nav>, <footer>, ads) to achieve up to ~99% token compression ratios for LLM context windows.
  • Multi-Platform Support: Native standalone binaries for Linux (x86_64 and arm64), macOS (Apple Silicon and Intel), and Windows (x86_64).

Precompiled Standalone Binaries

Compiled standalone binaries and SHA256 checksums are attached below:

  • headless-engine-linux-x86_64.tar.gz (Linux x86_64 / AMD64)
  • headless-engine-linux-arm64.tar.gz (Linux ARM64 / aarch64)
  • headless-engine-macos-arm64.tar.gz (macOS Apple Silicon)
  • headless-engine-macos-x86_64.tar.gz (macOS Intel)
  • headless-engine-windows-x86_64.zip (Windows x86_64)

Installation

Rust:

cargo add headless-engine

1-Line Install (Linux & macOS):

curl -fsSL https://raw.githubusercontent.com/yutuknown/headless-engine/master/install.sh | bash

1-Line Install (Windows PowerShell):

iwr -useb https://raw.githubusercontent.com/yutuknown/headless-engine/master/install.ps1 | iex