Repository navigation
Releases
ScrapeLens v0.1.3
🔍 ScrapeLens v0.1.3
Security release. Sanitized exports hide far more secrets, the proxy relay accepts only the capture's own browser, and session writes no longer follow swapped folders.
⚠️ Update if you used proxy credentials or sanitized exports
- Sanitized exports from v0.1.2 and earlier can contain tokens. Values such as
access,refresh, JWTs,sk_live_,ghp_,AKIA,__VIEWSTATEandprivate_keycould stay visible. Review or re-export old sanitized sessions before sharing them. - Proxy relay in v0.1.2: another local process could use your proxy credentials by reusing a source port. The password itself was not exposed.
💥 Breaking
- MCP
export_sessionwithinclude_sensitive=truenow asks you to confirm the session, destination and contents. If the client cannot ask, it returns an error unless the server runs with--allow-sensitive-export. Declining writes nothing. - MCP export destinations must be inside
--out-dir. Paths outside it,.., symlinks and git repositories are refused. - MCP
import_sessionreads only from--sessions-dirand--extra-sessions-dir. The error says how to allow another folder. - Browser choice in the App: accepted browsers are Chrome (with Beta, Dev, Canary and Chrome for Testing), Chromium, Brave, Edge and Arc. Other programs are refused, and nothing is run to identify them. Flatpak and Snap wrappers are not accepted yet. CloakBrowser is no longer listed, because it was never measured.
🔒 Security fixes
- Sanitizer: detects secrets by value format (JWT,
ghp_,sk_live_,xox*-,AKIA,AIza, PEM keys and high-entropy values), including inside other fields. MCP output masking uses the same rules. The entropy threshold was measured on synthetic data only. - Proxy relay: admits a connection only when its whole connection tuple belongs to the capture's browser process tree. A local connection flood no longer takes the browser's slots in the measured scenarios. The relay closes as soon as the browser exits.
- Session writes: folders are created and written through held descriptors, so swapping a folder for a symlink during a write cannot send the session elsewhere. "Keep this run" and text exports use the same protection.
- Exported Python scripts escape every non-ASCII character, so hidden text direction characters cannot disguise a script.
- Test-only settings are no longer in release binaries, and test certificates are generated at test time.
- Open files limit: the App and MCP raise their soft limit at start. At the macOS default of 256, pages through the relay could lose resources.
Known limits
- A local user with tens of thousands of open sockets can make the relay use a lot of memory on Linux (up to about 14.5 GB measured) and break page loads. This affects availability, not credentials. A fix is planned.
- A local process of the same user with access to the capture's browser is outside the relay's protection.
- The relay's flood results depend on the machine: 9 of 10 and 10 of 10 full pages in measured runs on Linux in Docker.
- Cleanup after a failed export, and copying raw artifacts into a full export, can still be affected by a local process with write access to those folders.
✅ Validation
Validated with local test proxies; not verified against commercial providers.
- Linux
.deband AppImage,amd64andarm64: real capture through a test proxy with right and wrong passwords, with no password in any output. - Relay under load (
arm64in Docker, 20 repetitions of 3 scenarios): 0 of 60 sessions marked partial, same URLs as without the relay. - Cookies (
amd64): Chrome and Firefox in.deband AppImage, and a mixed profile with a locked keyring. - MCP: 11 export and import cases.
Not exercised: "Keep this run" and cURL/Python export through the real interface (automated tests only), the macOS bundle opened on screen, bare-metal Linux, and KWallet.
📦 Packages and checksums (SHA-256)
| Platform | File | SHA-256 |
|---|---|---|
macOS (Apple Silicon arm64) |
ScrapeLens-0.1.3-macos-arm64.zip |
eecee877e5d063325e9f7fc9f5ac88370bb21821de54d0e1c2328a9b257faad9 |
Linux (amd64 / x86_64), Debian/Ubuntu |
ScrapeLens_0.1.3_amd64.deb |
a9d414d9df1b95298e60c476671cf8c93d525ba601ec7ef7b588052c62a0dee9 |
Linux (amd64 / x86_64), AppImage |
ScrapeLens_0.1.3_amd64.AppImage |
64608903f5e36bb226cf27552c108226690d935093d13167a3b19666e86769be |
Linux (arm64 / aarch64), Debian/Ubuntu |
ScrapeLens_0.1.3_arm64.deb |
79738cc8c7cc176959291fce7a72e860d990adb71f199696f8a4e575fc69f534 |
Linux (arm64 / aarch64), AppImage |
ScrapeLens_0.1.3_aarch64.AppImage |
04ccff1c8c7305beb899b6d97ae857f9ac79994ead1b7c2950c94e0c92d3caf3 |
macOS note:
ScrapeLens.apphas a local signature (ScrapeLens Local Signing, executable SHA-256f32262b78f4c03042ca477d2e63289a4cc8b26034ff8a6c92b6c6871f9172f74) and is not notarized by Apple. After extracting the.zipto/Applications, remove the quarantine attribute:xattr -dr com.apple.quarantine /Applications/ScrapeLens.appOn the Keychain prompt, click Allow, not Always Allow.
📄 License
Distributed under the MIT License.
ScrapeLens v0.1.2
🔍 ScrapeLens v0.1.2
Adds capture through a proxy link, redacts Portuguese sensitive names in sanitized exports, and marks requests that never left the browser.
✨ New
- Capture through a proxy: paste one link in the Proxy field, or pass
proxyto MCPstart_capture. Accepted:http://,https://,socks5://,socks5h://,user:pass@host:portandhost:port:user:pass. See docs/22-proxy.md. - Passwords stay out of files: credentials stay in memory and are not written to sessions, logs, preferences or exports. In MCP,
proxy: "env"reads the link fromSCRAPELENS_PROXY_URL, so the password does not pass through the model. - Clear proxy errors: an unreachable proxy, refused credentials, a refused destination and an invalid link each show what to do. An untrusted HTTPS proxy certificate stops the capture.
not sentstate: requests cancelled before sending shownot sent, with NetLog evidence. Theprotocolvalue staysunknown, and it is never inferred.
🐛 Fixes
- Sanitized exports now redact Portuguese sensitive names, with or without accents:
chave_api,segredo,sessão,autorização,credencial,nome,rg,matricula,assinaturaand headers such asX-Chave-Api.rgmatches only as a whole word. - Exported scripts from a proxied session warn that they do not use the capture proxy.
⚠️ Limits
- A proxied capture does not use HTTP/3. The session says so.
- Loopback targets skip the proxy.
- cURL, Python and priming scripts connect directly, so they can leave from a different IP than the capture.
- The password is not saved: type the link again after reopening the app.
- The local relay accepts only the process tree of the capture's browser. A process of the same user with access to that browser is outside this protection.
✅ Validation
Validated with local test proxies; not verified against commercial providers.
- Linux
.deband AppImage,amd64andarm64: real capture with credentials through an HTTP proxy, with no legitimate connection refused and no password in output files. - Egress: in a container that allows only the proxy, an HTTPS proxy with credentials had 0 packets dropped (
arm64.deb). HTTP and SOCKS5 were measured earlier with the same observer. macOS has indirect evidence only: no connections outside loopback in sampling. - Fidelity: same header order and protocol with and without the relay, on HTTP/1.1 and HTTP/2.
📦 Packages and checksums (SHA-256)
| Platform | File | SHA-256 |
|---|---|---|
macOS (Apple Silicon arm64) |
ScrapeLens-0.1.2-macos-arm64.zip |
47414621779553b3b44376b850bc650fd8ef52acc627e1448ff20907ca9ed00f |
Linux (amd64 / x86_64), Debian/Ubuntu |
ScrapeLens_0.1.2_amd64.deb |
8a82304b2571f21ee529b2c36b0242956ef3770fbf871202588837baa471658e |
Linux (amd64 / x86_64), AppImage |
ScrapeLens_0.1.2_amd64.AppImage |
6fec7215608ae460faa352bed7ebd46c007164afb1c954d4fbdd5756a3789849 |
Linux (arm64 / aarch64), Debian/Ubuntu |
ScrapeLens_0.1.2_arm64.deb |
338d18aec0b3df8cb210c484574a9553d898e867dcd10f52c64f44b872674f23 |
Linux (arm64 / aarch64), AppImage |
ScrapeLens_0.1.2_aarch64.AppImage |
ab346a7ce592ecd486645a81ed76a3e3148520c299a5f75950c81691c8f157b5 |
macOS note:
ScrapeLens.apphas a local signature (ScrapeLens Local Signing, executable SHA-256f85b082553c95badb390fc6b09ea384874a794300785255e3100e97b2b2c5bfb) and is not notarized by Apple. After extracting the.zipto/Applications, remove the quarantine attribute:xattr -dr com.apple.quarantine /Applications/ScrapeLens.app
📄 License
Distributed under the MIT License.
ScrapeLens v0.1.1
🔍 ScrapeLens v0.1.1
Fixes browser cookie import on Linux and makes capture failures easier to understand.
🐛 Fixes
- Cookie import on Linux now works in
.deband AppImage builds. The app reads the cookie database and the keyring through the system libraries (libsqlite3,libsecret), so it no longer needs thesqlite3orsecret-toolcommands. Before this, AppImage builds failed because of the bundled library path, and missing helpers failed without a clear message. - Edge and other Chromium browsers: the keyring lookup now tries every name a browser may use and validates the key by decrypting.
- Mixed
v10/v11profiles: the key is chosen per cookie. If the keyring is locked, readable cookies are still imported. - Locked keyring: the lookup has a time limit, and a stuck capture start no longer freezes the app.
- Capture start errors: the real error is shown instead of "not ready within 35 s".
- Linux wording: messages no longer mention
/Applicationsor.app.
✨ Improvements
- Cookie import warnings: a persistent notice shows how many cookies could not be decrypted, why, and what to do. A separate notice says when a browser simply has no cookies for that domain.
not sentstate: requests cancelled before any bytes left the browser now shownot sentinstead ofunknown, with the NetLog evidence. Theprotocolvalue staysunknownin the session JSON, and it is never inferred.- Flatpak and Snap browser profiles are now discovered.
- Stale temporary cookie copies are removed at the next import.
✅ Tested on Linux
Real browser, test profile, loopback server, with the Cookie header checked on the first navigation:
| Browser | amd64 |
arm64 |
|---|---|---|
| Google Chrome | .deb, AppImage |
.deb, AppImage |
| Firefox | .deb, AppImage |
.deb, AppImage |
| Microsoft Edge | .deb, AppImage |
not tested |
| Brave | .deb, AppImage |
not tested |
| Chromium | AppImage | not tested |
Not tested end to end: KWallet (KDE) and real Flatpak or Snap installs (unit tests only). The keyring must be unlocked for v11 cookies.
📦 Packages and checksums (SHA-256)
| Platform | File | SHA-256 |
|---|---|---|
macOS (Apple Silicon arm64) |
ScrapeLens-0.1.1-macos-arm64.zip |
9d73c2747cc8d96b81fa44ecbf18191610cc750d728a15fd26234d2df73ef6b7 |
Linux (amd64 / x86_64), Debian/Ubuntu |
ScrapeLens_0.1.1_amd64.deb |
ffcb239e4bed5039a5a560d2dff247de745d381b8ed1b5820b49ac0e6cf5717a |
Linux (amd64 / x86_64), AppImage |
ScrapeLens_0.1.1_amd64.AppImage |
287b7893e7d4ec54044add658c9416c1a4363f184aa38737206c398748f1539c |
Linux (arm64 / aarch64), Debian/Ubuntu |
ScrapeLens_0.1.1_arm64.deb |
eeac21ab78f56bf5b33d853a1c4d6367cc2c09b823bb4fcf3b12ec1ded406e70 |
Linux (arm64 / aarch64), AppImage |
ScrapeLens_0.1.1_aarch64.AppImage |
f9d06036667b82924b37b5d515fa9aca9614467af823fd75f8c1c2e69d5cf0a2 |
macOS note:
ScrapeLens.apphas a local signature (ScrapeLens Local Signing, executable SHA-256014c8eae8af3b9a1dbdf5c42e8b0bc16c03cb20daf06955e19d18e2043e9e54c) and is not notarized by Apple. After extracting the.zipto/Applications, remove the quarantine attribute:xattr -dr com.apple.quarantine /Applications/ScrapeLens.app
📄 License
Distributed under the MIT License.
ScrapeLens v0.1.0
🔍 ScrapeLens v0.1.0
First public release of ScrapeLens: a local, high-fidelity HTTP session inspector (Tauri 2 + React/TypeScript + Rust) with a native MCP server. The source code, documentation, interface and commit history are in English.
✨ Highlights
- High-fidelity capture (
CDP + NetLog)- Preserves the exact header order reported by the source, duplicate headers, original casing, HTTP/2 and HTTP/3 pseudo-headers (
:method,:path,:authority,:scheme), redirect chains and network attempts, with explicit per-field provenance. - Multi-target capture over a pipe (
fd 3/fd 4), attaching automatically to pages, popups, cross-originiframes(OOPIF), Service Workers and Shared Workers.
- Preserves the exact header order reported by the source, duplicate headers, original casing, HTTP/2 and HTTP/3 pseudo-headers (
- Browser cookie import
- A Cookies selector next to the start URL (and the
cookie_sourceMCP parameter) imports and decrypts in memory cookies from Chrome, Brave, Arc, Edge, Chromium, Firefox or Safari before the first navigation, so the session starts signed in.
- A Cookies selector next to the start URL (and the
- Inspection, body search, diff and priming
- Structural and text search across captured URLs, headers, cookies and payloads.
- Side-by-side comparison between requests in one session or across sessions.
- Origin tracing (
trace_value) and generation of multi-step Python (requests.Session) priming scripts.
- Sanitized or full export (with sensitive data)
- Single-request export to
cURLandPython (requests). - Whole-session export to disk (
0700/0600): sanitized by default (<session>-sanitized) or a full capture with sensitive data when you opt in.
- Single-request export to
- Native MCP server (
scrapelens-mcp)- 15 MCP tools over
stdio. See the README.
- 15 MCP tools over
📦 Packages and checksums (SHA-256)
| Platform | File | SHA-256 | Interface language |
|---|---|---|---|
macOS (Apple Silicon arm64) |
ScrapeLens-0.1.0-macos-arm64.zip |
e687241b86e231a78c37c86d2ac3a54e08463243ace0bedc72213b2e9ff712a0 |
English |
Linux (amd64 / x86_64), Debian/Ubuntu |
ScrapeLens_0.1.0_amd64.deb |
38e3d0db8664fcaa875724170188b5a6f6dc7cbd99934c9534bd27f4610c50c0 |
English |
Linux (amd64 / x86_64), AppImage |
ScrapeLens_0.1.0_amd64.AppImage |
931b658987aff893b0b94d44102602e812cf6f15010e116313b21e9f81a398e8 |
English |
Linux (arm64 / aarch64), Debian/Ubuntu |
ScrapeLens_0.1.0_arm64.deb |
9ff9b1bcc00944eeef93ee46db26cbec7eb4d352299aa03e6041261b4ed653e0 |
English |
Linux (arm64 / aarch64), AppImage |
ScrapeLens_0.1.0_aarch64.AppImage |
5a8d0f62bd7162181926dafd8296b4e4bc79522dc18db3565f0a8b0dd0e23de2 |
English |
macOS note:
ScrapeLens.apphas a local signature (ScrapeLens Local Signing, executable SHA-256aca3840f4620f4cddca7821a2a2c55e6082a5ab0e62c014975ecc0b8a6709883) and is not notarized by Apple. After extracting the.zipto/Applications, remove the quarantine attribute:xattr -dr com.apple.quarantine /Applications/ScrapeLens.app
📄 License
Distributed under the MIT License.