Skip to content

Releases

ScrapeLens v0.1.3

Choose a tag to compare

@cesarhmatias cesarhmatias released this 07 Nov 14:40

🔍 ScrapeLens v0.1.3

Security release. Sanitized exports hide far more secrets, the proxy relay accepts only the capture's own browser, and session writes no longer follow swapped folders.

⚠️ Update if you used proxy credentials or sanitized exports

  • Sanitized exports from v0.1.2 and earlier can contain tokens. Values such as access, refresh, JWTs, sk_live_, ghp_, AKIA, __VIEWSTATE and private_key could stay visible. Review or re-export old sanitized sessions before sharing them.
  • Proxy relay in v0.1.2: another local process could use your proxy credentials by reusing a source port. The password itself was not exposed.

💥 Breaking

  • MCP export_session with include_sensitive=true now asks you to confirm the session, destination and contents. If the client cannot ask, it returns an error unless the server runs with --allow-sensitive-export. Declining writes nothing.
  • MCP export destinations must be inside --out-dir. Paths outside it, .., symlinks and git repositories are refused.
  • MCP import_session reads only from --sessions-dir and --extra-sessions-dir. The error says how to allow another folder.
  • Browser choice in the App: accepted browsers are Chrome (with Beta, Dev, Canary and Chrome for Testing), Chromium, Brave, Edge and Arc. Other programs are refused, and nothing is run to identify them. Flatpak and Snap wrappers are not accepted yet. CloakBrowser is no longer listed, because it was never measured.

🔒 Security fixes

  • Sanitizer: detects secrets by value format (JWT, ghp_, sk_live_, xox*-, AKIA, AIza, PEM keys and high-entropy values), including inside other fields. MCP output masking uses the same rules. The entropy threshold was measured on synthetic data only.
  • Proxy relay: admits a connection only when its whole connection tuple belongs to the capture's browser process tree. A local connection flood no longer takes the browser's slots in the measured scenarios. The relay closes as soon as the browser exits.
  • Session writes: folders are created and written through held descriptors, so swapping a folder for a symlink during a write cannot send the session elsewhere. "Keep this run" and text exports use the same protection.
  • Exported Python scripts escape every non-ASCII character, so hidden text direction characters cannot disguise a script.
  • Test-only settings are no longer in release binaries, and test certificates are generated at test time.
  • Open files limit: the App and MCP raise their soft limit at start. At the macOS default of 256, pages through the relay could lose resources.

Known limits

  • A local user with tens of thousands of open sockets can make the relay use a lot of memory on Linux (up to about 14.5 GB measured) and break page loads. This affects availability, not credentials. A fix is planned.
  • A local process of the same user with access to the capture's browser is outside the relay's protection.
  • The relay's flood results depend on the machine: 9 of 10 and 10 of 10 full pages in measured runs on Linux in Docker.
  • Cleanup after a failed export, and copying raw artifacts into a full export, can still be affected by a local process with write access to those folders.

✅ Validation

Validated with local test proxies; not verified against commercial providers.

  • Linux .deb and AppImage, amd64 and arm64: real capture through a test proxy with right and wrong passwords, with no password in any output.
  • Relay under load (arm64 in Docker, 20 repetitions of 3 scenarios): 0 of 60 sessions marked partial, same URLs as without the relay.
  • Cookies (amd64): Chrome and Firefox in .deb and AppImage, and a mixed profile with a locked keyring.
  • MCP: 11 export and import cases.

Not exercised: "Keep this run" and cURL/Python export through the real interface (automated tests only), the macOS bundle opened on screen, bare-metal Linux, and KWallet.


📦 Packages and checksums (SHA-256)

Platform File SHA-256
macOS (Apple Silicon arm64) ScrapeLens-0.1.3-macos-arm64.zip eecee877e5d063325e9f7fc9f5ac88370bb21821de54d0e1c2328a9b257faad9
Linux (amd64 / x86_64), Debian/Ubuntu ScrapeLens_0.1.3_amd64.deb a9d414d9df1b95298e60c476671cf8c93d525ba601ec7ef7b588052c62a0dee9
Linux (amd64 / x86_64), AppImage ScrapeLens_0.1.3_amd64.AppImage 64608903f5e36bb226cf27552c108226690d935093d13167a3b19666e86769be
Linux (arm64 / aarch64), Debian/Ubuntu ScrapeLens_0.1.3_arm64.deb 79738cc8c7cc176959291fce7a72e860d990adb71f199696f8a4e575fc69f534
Linux (arm64 / aarch64), AppImage ScrapeLens_0.1.3_aarch64.AppImage 04ccff1c8c7305beb899b6d97ae857f9ac79994ead1b7c2950c94e0c92d3caf3

macOS note: ScrapeLens.app has a local signature (ScrapeLens Local Signing, executable SHA-256 f32262b78f4c03042ca477d2e63289a4cc8b26034ff8a6c92b6c6871f9172f74) and is not notarized by Apple. After extracting the .zip to /Applications, remove the quarantine attribute:

xattr -dr com.apple.quarantine /Applications/ScrapeLens.app

On the Keychain prompt, click Allow, not Always Allow.

📄 License

Distributed under the MIT License.

ScrapeLens v0.1.2

Choose a tag to compare

@cesarhmatias cesarhmatias released this 06 Nov 12:14

🔍 ScrapeLens v0.1.2

Adds capture through a proxy link, redacts Portuguese sensitive names in sanitized exports, and marks requests that never left the browser.

✨ New

  • Capture through a proxy: paste one link in the Proxy field, or pass proxy to MCP start_capture. Accepted: http://, https://, socks5://, socks5h://, user:pass@host:port and host:port:user:pass. See docs/22-proxy.md.
  • Passwords stay out of files: credentials stay in memory and are not written to sessions, logs, preferences or exports. In MCP, proxy: "env" reads the link from SCRAPELENS_PROXY_URL, so the password does not pass through the model.
  • Clear proxy errors: an unreachable proxy, refused credentials, a refused destination and an invalid link each show what to do. An untrusted HTTPS proxy certificate stops the capture.
  • not sent state: requests cancelled before sending show not sent, with NetLog evidence. The protocol value stays unknown, and it is never inferred.

🐛 Fixes

  • Sanitized exports now redact Portuguese sensitive names, with or without accents: chave_api, segredo, sessão, autorização, credencial, nome, rg, matricula, assinatura and headers such as X-Chave-Api. rg matches only as a whole word.
  • Exported scripts from a proxied session warn that they do not use the capture proxy.

⚠️ Limits

  • A proxied capture does not use HTTP/3. The session says so.
  • Loopback targets skip the proxy.
  • cURL, Python and priming scripts connect directly, so they can leave from a different IP than the capture.
  • The password is not saved: type the link again after reopening the app.
  • The local relay accepts only the process tree of the capture's browser. A process of the same user with access to that browser is outside this protection.

✅ Validation

Validated with local test proxies; not verified against commercial providers.

  • Linux .deb and AppImage, amd64 and arm64: real capture with credentials through an HTTP proxy, with no legitimate connection refused and no password in output files.
  • Egress: in a container that allows only the proxy, an HTTPS proxy with credentials had 0 packets dropped (arm64 .deb). HTTP and SOCKS5 were measured earlier with the same observer. macOS has indirect evidence only: no connections outside loopback in sampling.
  • Fidelity: same header order and protocol with and without the relay, on HTTP/1.1 and HTTP/2.

📦 Packages and checksums (SHA-256)

Platform File SHA-256
macOS (Apple Silicon arm64) ScrapeLens-0.1.2-macos-arm64.zip 47414621779553b3b44376b850bc650fd8ef52acc627e1448ff20907ca9ed00f
Linux (amd64 / x86_64), Debian/Ubuntu ScrapeLens_0.1.2_amd64.deb 8a82304b2571f21ee529b2c36b0242956ef3770fbf871202588837baa471658e
Linux (amd64 / x86_64), AppImage ScrapeLens_0.1.2_amd64.AppImage 6fec7215608ae460faa352bed7ebd46c007164afb1c954d4fbdd5756a3789849
Linux (arm64 / aarch64), Debian/Ubuntu ScrapeLens_0.1.2_arm64.deb 338d18aec0b3df8cb210c484574a9553d898e867dcd10f52c64f44b872674f23
Linux (arm64 / aarch64), AppImage ScrapeLens_0.1.2_aarch64.AppImage ab346a7ce592ecd486645a81ed76a3e3148520c299a5f75950c81691c8f157b5

macOS note: ScrapeLens.app has a local signature (ScrapeLens Local Signing, executable SHA-256 f85b082553c95badb390fc6b09ea384874a794300785255e3100e97b2b2c5bfb) and is not notarized by Apple. After extracting the .zip to /Applications, remove the quarantine attribute:

xattr -dr com.apple.quarantine /Applications/ScrapeLens.app

📄 License

Distributed under the MIT License.

ScrapeLens v0.1.1

Choose a tag to compare

@cesarhmatias cesarhmatias released this 06 Nov 01:14

🔍 ScrapeLens v0.1.1

Fixes browser cookie import on Linux and makes capture failures easier to understand.

🐛 Fixes

  • Cookie import on Linux now works in .deb and AppImage builds. The app reads the cookie database and the keyring through the system libraries (libsqlite3, libsecret), so it no longer needs the sqlite3 or secret-tool commands. Before this, AppImage builds failed because of the bundled library path, and missing helpers failed without a clear message.
  • Edge and other Chromium browsers: the keyring lookup now tries every name a browser may use and validates the key by decrypting.
  • Mixed v10/v11 profiles: the key is chosen per cookie. If the keyring is locked, readable cookies are still imported.
  • Locked keyring: the lookup has a time limit, and a stuck capture start no longer freezes the app.
  • Capture start errors: the real error is shown instead of "not ready within 35 s".
  • Linux wording: messages no longer mention /Applications or .app.

✨ Improvements

  • Cookie import warnings: a persistent notice shows how many cookies could not be decrypted, why, and what to do. A separate notice says when a browser simply has no cookies for that domain.
  • not sent state: requests cancelled before any bytes left the browser now show not sent instead of unknown, with the NetLog evidence. The protocol value stays unknown in the session JSON, and it is never inferred.
  • Flatpak and Snap browser profiles are now discovered.
  • Stale temporary cookie copies are removed at the next import.

✅ Tested on Linux

Real browser, test profile, loopback server, with the Cookie header checked on the first navigation:

Browser amd64 arm64
Google Chrome .deb, AppImage .deb, AppImage
Firefox .deb, AppImage .deb, AppImage
Microsoft Edge .deb, AppImage not tested
Brave .deb, AppImage not tested
Chromium AppImage not tested

Not tested end to end: KWallet (KDE) and real Flatpak or Snap installs (unit tests only). The keyring must be unlocked for v11 cookies.


📦 Packages and checksums (SHA-256)

Platform File SHA-256
macOS (Apple Silicon arm64) ScrapeLens-0.1.1-macos-arm64.zip 9d73c2747cc8d96b81fa44ecbf18191610cc750d728a15fd26234d2df73ef6b7
Linux (amd64 / x86_64), Debian/Ubuntu ScrapeLens_0.1.1_amd64.deb ffcb239e4bed5039a5a560d2dff247de745d381b8ed1b5820b49ac0e6cf5717a
Linux (amd64 / x86_64), AppImage ScrapeLens_0.1.1_amd64.AppImage 287b7893e7d4ec54044add658c9416c1a4363f184aa38737206c398748f1539c
Linux (arm64 / aarch64), Debian/Ubuntu ScrapeLens_0.1.1_arm64.deb eeac21ab78f56bf5b33d853a1c4d6367cc2c09b823bb4fcf3b12ec1ded406e70
Linux (arm64 / aarch64), AppImage ScrapeLens_0.1.1_aarch64.AppImage f9d06036667b82924b37b5d515fa9aca9614467af823fd75f8c1c2e69d5cf0a2

macOS note: ScrapeLens.app has a local signature (ScrapeLens Local Signing, executable SHA-256 014c8eae8af3b9a1dbdf5c42e8b0bc16c03cb20daf06955e19d18e2043e9e54c) and is not notarized by Apple. After extracting the .zip to /Applications, remove the quarantine attribute:

xattr -dr com.apple.quarantine /Applications/ScrapeLens.app

📄 License

Distributed under the MIT License.

ScrapeLens v0.1.0

Choose a tag to compare

@cesarhmatias cesarhmatias released this 04 Nov 22:56

🔍 ScrapeLens v0.1.0

First public release of ScrapeLens: a local, high-fidelity HTTP session inspector (Tauri 2 + React/TypeScript + Rust) with a native MCP server. The source code, documentation, interface and commit history are in English.

✨ Highlights

  • High-fidelity capture (CDP + NetLog)
    • Preserves the exact header order reported by the source, duplicate headers, original casing, HTTP/2 and HTTP/3 pseudo-headers (:method, :path, :authority, :scheme), redirect chains and network attempts, with explicit per-field provenance.
    • Multi-target capture over a pipe (fd 3/fd 4), attaching automatically to pages, popups, cross-origin iframes (OOPIF), Service Workers and Shared Workers.
  • Browser cookie import
    • A Cookies selector next to the start URL (and the cookie_source MCP parameter) imports and decrypts in memory cookies from Chrome, Brave, Arc, Edge, Chromium, Firefox or Safari before the first navigation, so the session starts signed in.
  • Inspection, body search, diff and priming
    • Structural and text search across captured URLs, headers, cookies and payloads.
    • Side-by-side comparison between requests in one session or across sessions.
    • Origin tracing (trace_value) and generation of multi-step Python (requests.Session) priming scripts.
  • Sanitized or full export (with sensitive data)
    • Single-request export to cURL and Python (requests).
    • Whole-session export to disk (0700/0600): sanitized by default (<session>-sanitized) or a full capture with sensitive data when you opt in.
  • Native MCP server (scrapelens-mcp)
    • 15 MCP tools over stdio. See the README.

📦 Packages and checksums (SHA-256)

Platform File SHA-256 Interface language
macOS (Apple Silicon arm64) ScrapeLens-0.1.0-macos-arm64.zip e687241b86e231a78c37c86d2ac3a54e08463243ace0bedc72213b2e9ff712a0 English
Linux (amd64 / x86_64), Debian/Ubuntu ScrapeLens_0.1.0_amd64.deb 38e3d0db8664fcaa875724170188b5a6f6dc7cbd99934c9534bd27f4610c50c0 English
Linux (amd64 / x86_64), AppImage ScrapeLens_0.1.0_amd64.AppImage 931b658987aff893b0b94d44102602e812cf6f15010e116313b21e9f81a398e8 English
Linux (arm64 / aarch64), Debian/Ubuntu ScrapeLens_0.1.0_arm64.deb 9ff9b1bcc00944eeef93ee46db26cbec7eb4d352299aa03e6041261b4ed653e0 English
Linux (arm64 / aarch64), AppImage ScrapeLens_0.1.0_aarch64.AppImage 5a8d0f62bd7162181926dafd8296b4e4bc79522dc18db3565f0a8b0dd0e23de2 English

macOS note: ScrapeLens.app has a local signature (ScrapeLens Local Signing, executable SHA-256 aca3840f4620f4cddca7821a2a2c55e6082a5ab0e62c014975ecc0b8a6709883) and is not notarized by Apple. After extracting the .zip to /Applications, remove the quarantine attribute:

xattr -dr com.apple.quarantine /Applications/ScrapeLens.app

📄 License

Distributed under the MIT License.