Five-layer mix, English detector UI, and fuckmark web - #109
Conversation
Protect multiline Markdown, HTML, indented code, and remaining path/URI forms; report transformation outcomes and distinct exit statuses; align installers and docs with carrier insertion; and record live-versus-frozen mix hashes plus Chromium payload render evidence without rewriting frozen confirmation files. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
|
Important
This repository does not receive automatic reviews because it has fewer than 10 stars. ⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Plus Run ID: Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Co-authored-by: Byte271 <byte271@users.noreply.github.com>
![chatgpt-codex-connector[bot]](https://avatars.githubusercontent.com/in/1144995?s=60&v=4){kind=small}
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 75796b7993
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
| $Utf16 = New-Object System.Text.UnicodeEncoding $false, $true | ||
| [IO.File]::WriteAllText($Launcher, $LauncherBody, $Utf16) |
There was a problem hiding this comment.
On Windows installs, this writes fuckmark.cmd as UTF-16LE with a BOM. cmd.exe does not execute UTF-16 batch files correctly because it reads the embedded NULs as command terminators/end-of-file (see Microsoft’s note: https://devblogs.microsoft.com/oldnewthing/20210726-00/?p=105483), so the PATH launcher produced by the installer can fail before invoking Python. Emit the .cmd as a cmd-compatible byte encoding such as ASCII/OEM or UTF-8 without BOM, and keep Unicode handling in the PowerShell script rather than the batch file.
Useful? React with 👍 / 👎.
| if result.reason == REASON_TOO_LARGE: | ||
| return _error(errors, _human_reason(result)) | ||
| if result.reason == REASON_INTERNAL_ERROR: | ||
| _error(errors, _human_reason(result)) | ||
| return EXIT_INTERNAL |
There was a problem hiding this comment.
When --status is requested for inputs over PRODUCT_MAX_INPUT_CHARS (and for an internal transform failure), these early returns happen before _emit_outcome, so stderr contains only the human error and no fuckmark-status result=too-large / internal-error line. The new CLI contract says --status always reports the reason, so automation cannot distinguish these documented outcomes without parsing prose.
Useful? React with 👍 / 👎.
| _WINDOWS_SPACED_FILE_RE = re.compile( | ||
| rf"(?i)(?<![A-Z0-9_])(?:[A-Z]:[/\\]|\\\\[A-Z0-9._$-]+\\)(?:{_FILENAME_TOKEN}[/\\])+{_SPACED_BASENAME}" | ||
| ) | ||
| _POSIX_SPACED_FILE_RE = re.compile( | ||
| rf"(?<![\w:])(?:~?/|\./|\.\./)(?:{_FILENAME_TOKEN}/)+{_SPACED_BASENAME}" |
There was a problem hiding this comment.
For a spaced filename directly under a path prefix, such as C:/My final notes.txt, /My final notes.txt, or ~/My final notes.txt, these new regexes require an extra intermediate component before _SPACED_BASENAME. The full path is therefore not protected; the fallback path regex only covers fragments like C:/My and notes.txt, leaving letters in final eligible for hidden insertions and corrupting the raw path. Allow zero intermediate components after the drive/root prefix.
Useful? React with 👍 / 👎.
Add a no-install demo with baked CLI samples, louder unsupported-domain and coverage reporting, --inspect maps, --status on hard failures, ASCII Windows cmd launchers, and root-level spaced path protection. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
Show "U+2019 at index 5" in the no-install demo so live paste checks and fixed samples cannot be misread as a mashed code point token. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
Stream success no longer looks silent: unless -q, every outcome prints processed/reason/insertions/coverage, and successful transforms note that Mn or default-ignorable stripping restores the source. Docs also state frozen GPT-2 scores do not answer platform usefulness. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
Each eligible ASCII letter now receives a mark plus a C0/C1 control so Mn-strip and default-ignorable strip leave residuals and keep GPT-2 detection at 0/64 on the exploratory Gate v2 rescore. Mixed Unicode with ASCII letters is processed, the site cap is 4096, and frozen confirmation artifacts stay historical mark-only. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
cursor
Bot
changed the title
Live mix is now mark plus Cc plus enclosing Me (U+20DD). Exploratory GPT-2 rescore of frozen Gate v2 seed 1200000 stays 0/64 under Mn/DI strip, UnicodeSanitizer orderings, and required-bundle combinations, while historical dual-layer returns to 61/64 after Mn then US. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
cursor
Bot
changed the title
|
Follow-up push Measured on frozen Gate v2 seed 1200000 watermarked sources (n=64, exploratory, confirmation not rewritten):
Evidence: Tradeoff: Me may decorate glyphs in some renderers; visible projection still strips approved carriers. Full pytest green. |
Rescore frozen Gate v2 watermarked sources on seeds 1210000 and 1220000 and roll them up with 1200000. Live triple-layer stays 0/192 under Mn then UnicodeSanitizer and required-bundle then UnicodeSanitizer. DistilGPT2 frozen n=16 watermarked sources stay 0/16 on the same live arms. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
|
Live triple-layer mix now has confirmation-scale exploratory combo-stress numbers without rewriting Gate v2 artifacts. GPT-2 / Hugging Face SynthID Weighted Mean rescore of frozen Gate v2 watermarked sources (seeds 1200000, 1210000, 1220000):
Evidence: DistilGPT2 frozen n=16 watermarked sources (
Evidence: |
cursor
Bot
changed the title
Repository hygiene forbids comment tokens in Python files, including shebang lines. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
|
Local |
Live triple-layer mix includes U+20DD, so pre-pixel probes differ from the source. Keep historical mark-only VERIFIED where Chromium can run, and isolate headless Chrome profiles with a temp user-data-dir. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
|
CI fix ( Root cause: live triple-layer mix inserts enclosing Me ( Fix:
Locally verified: live |
Live mix is now mark plus Cc plus Me plus cycling U+13430-U+1343F (release-cli-v8). Historical triple-layer is frozen for replay. A restore census on frozen Gate v2 watermarked sources stays 0/192 under Mn+Me+US. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
cursor
Bot
changed the title
Process Latin, Greek, Cyrillic, Han, Kana, Hangul syllables, and emoji grapheme clusters instead of ASCII letters only. Insert after combining sequences so NFD Latin is not split. Historical mixes stay ASCII-only. CLI identity is release-cli-v9. Assigned width-0 carriers are unchanged; Me-strip plus UnicodeSanitizer plus frozen cf_strip still restores. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
cursor
Bot
changed the title
U+13439-U+1343F are unassigned on Python 3.11, so frozen cf_strip left them in the Mn+Me+UnicodeSanitizer remainder. Cycle U+13430-U+13438 instead so mix output and Cf-strip restore stay identical across 3.11+. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
Each eligible site now also receives U+FFF9-U+FFFB. UnicodeSanitizer turns those controls into spaces, so Mn then Me then UnicodeSanitizer then frozen cf_strip cannot rebuild the source. CLI identity is release-cli-v10. Historical four-layer mix stays replayable. Closed-set remainder is still Cf-strip before UnicodeSanitizer. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
--detect and the no-install demo scan approved insertion characters. A miss says no watermark was found and points to Fhelp@q1z.org. first_unsupported now skips mixed Latin, Han, and emoji clusters. CLI identity is release-cli-v11. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
cursor
Bot
changed the title
Bring the live paste UI into the repo. Scan and strip approved FuckMark insertions only; on a miss show the Chinese no-watermark card and mailto Fhelp@q1z.org. Stop stripping emoji VS/ZWJ ranges. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
cursor
Bot
changed the title
Serve the packaged mark.html browser tool with `fuckmark web` for beginners who prefer a page over the CLI. Miss/contact copy is English only. CLI identity is release-cli-v12. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
cursor
Bot
changed the title
The paste UI calls GET /api/health and POST /api/remove-marks so local fuckmark web uses detect_fuckmark_insertions and project_visible_v1. file:// and static mark.q1z.org keep the in-browser fallback. CLI identity stays release-cli-v12. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
Serve Cache-Control: no-store on the local paste page so a prior static copy cannot hide the Python API UI. Co-authored-by: Byte271 <byte271@users.noreply.github.com>
2 participants
Summary
Stop documenting the Mn/DI reversal failure and fix it.
Live letter-mix is now dual-layer (
u034f-ufe00-cc-letter-alt-v1, CLIrelease-cli-v6):VISIBLE(original) == VISIBLE(transformed))first_unsupported)Historical mark-only mix is preserved for frozen evidence replay. Gate v2 confirmation artifacts and hashes are not rewritten.
Measured detector improvement
Exploratory GPT-2 / HuggingFace SynthID rescore of frozen Gate v2 seed 1200000 watermarked sources (
n=64). Confirmation corpora were not regenerated.Evidence:
evidence/cycle8-dual-layer-stress-exploratory-2026-08-28/(scorecard hashaa56fd036cfa733538fd62e213849f1974dafccb13b14c223e61c42d7de0bfea).Product / docs
product_publishable: truewhile remainingproduct_authorized: falseas a historical CLI snapshotmix_sanitizer_gate_v1: FAILand does not weakenrequired_sanitizers_keeppytestgreenDemo
Open
docs/demo.html?v=dual2(cache-bust if a browser cached the old mark-only page).