Skip to content

June 2026 release notes with screenshots#274

Merged
chris-absmartly merged 6 commits into
masterfrom
26/06
Jul 7, 2026
Merged

June 2026 release notes with screenshots#274
chris-absmartly merged 6 commits into
masterfrom
26/06

Conversation

@chris-absmartly

@chris-absmartly chris-absmartly commented Jul 7, 2026

Copy link
Copy Markdown
Collaborator

Summary by CodeRabbit

  • New Features

    • Added release notes covering a beta for the new experiment creation form.
    • Introduced changelog support for experiments and feature flags.
    • Added customisable stopped reasons for accounts.
    • Introduced a new Metric Usage Report with multiple coordinated views.
    • Added export lifecycle webhooks, including notifications when downloads are ready.
  • Bug Fixes

    • Improved export file cleanup reliability.
    • Strengthened metric filter validation and error handling for regex inputs.

@coderabbitai

coderabbitai Bot commented Jul 7, 2026

Copy link
Copy Markdown

Review Change Stack

Warning

Review limit reached

@chris-absmartly, you've reached your PR review limit, so we couldn't start this review.

Next review available in: 8 minutes

Enable usage-based reviews in Billing to review now. Otherwise, wait until the next included review is available.
You're only billed for reviews past your plan's rate limits ($0.25/file).

How can I continue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews.

How do review limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 8fdee016-28e7-4519-9ed2-72f343191acd

📥 Commits

Reviewing files that changed from the base of the PR and between 64ad0cf and 5313294.

📒 Files selected for processing (1)
  • docs/platform-release-notes/2026/06.mdx

Walkthrough

This pull request adds a new MDX documentation file for June 2026 platform release notes. It covers a beta experiment creation form, changelog support for experiments and feature flags, customisable stopped reasons, a Metric Usage Report, export lifecycle webhooks with a fix for an export file cleanup race condition, RE2-compatible regex validation in metric filters, and placeholder sections for bug fixes and feedback.

Estimated code review effort: 1 (Trivial) | ~3 minutes

Suggested reviewers: bmsilva, mario-silva, calthejuggler, marcio-absmartly

Poem

A rabbit hops through docs anew,
June's notes now shine in tidy view,
Regex tamed, webhooks in line,
Stopped reasons custom, metrics fine,
🥕 Hop hop — release notes, right on time!

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title accurately describes the June 2026 release notes update and mentions screenshots, which matches the added document.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch 26/06

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@docs/platform-release-notes/2026/06.mdx`:
- Around line 19-20: The release notes still contain TODO image placeholders
instead of the promised screenshots, so update the markdown to include the
missing visuals before merging. Replace the placeholder in the relevant
changelog section with the correct screenshot reference, and make sure any other
matching TODO on this page is also resolved so both sections render the intended
image content.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 63899943-86da-4650-a3dc-7508a987524c

📥 Commits

Reviewing files that changed from the base of the PR and between 4cbb87a and 64ad0cf.

⛔ Files ignored due to path filters (2)
  • static/img/release-notes/metric-usage-report.png is excluded by !**/*.png
  • static/img/release-notes/new-experiment-form.png is excluded by !**/*.png
📒 Files selected for processing (1)
  • docs/platform-release-notes/2026/06.mdx

Comment thread docs/platform-release-notes/2026/06.mdx Outdated
Comment on lines +19 to +20
<!-- TODO: add image release-notes/experiment-changelog.png -->

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

📐 Maintainability & Code Quality | 🟡 Minor | ⚡ Quick win

Add the missing screenshots before merging.

Both changelog sections still use TODO placeholders instead of the screenshots this page promises, so the release notes ship without the visual context readers expect.

Also applies to: 55-55

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@docs/platform-release-notes/2026/06.mdx` around lines 19 - 20, The release
notes still contain TODO image placeholders instead of the promised screenshots,
so update the markdown to include the missing visuals before merging. Replace
the placeholder in the relevant changelog section with the correct screenshot
reference, and make sure any other matching TODO on this page is also resolved
so both sections render the intended image content.

@netlify

netlify Bot commented Jul 7, 2026

Copy link
Copy Markdown

Deploy Preview for absmartly-docs ready!

Name Link
🔨 Latest commit 5313294
🔍 Latest deploy log https://app.netlify.com/projects/absmartly-docs/deploys/6a4d0c94d161c50008e44b66
😎 Deploy Preview https://deploy-preview-274--absmartly-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

Comment thread docs/platform-release-notes/2026/06.mdx Outdated

## Overview

This release is headlined by the **beta of the new experiment creation form** and the new **Metric Usage Report** — a dedicated workspace for understanding where every metric is used, by whom, and how its adoption is trending. We're also extending the changelog introduced in May to **experiments and feature flags**, and adding end-to-end **webhook coverage for the export lifecycle** so customers can fully automate getting experiment data into their warehouse. On top of that, **stopped reasons are now customisable** per account, and we've hardened **regex validation** in metric filters to keep a single bad pattern from breaking an entire experiment.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
This release is headlined by the **beta of the new experiment creation form** and the new **Metric Usage Report** a dedicated workspace for understanding where every metric is used, by whom, and how its adoption is trending. We're also extending the changelog introduced in May to **experiments and feature flags**, and adding end-to-end **webhook coverage for the export lifecycle** so customers can fully automate getting experiment data into their warehouse. On top of that, **stopped reasons are now customisable** per account, and we've hardened **regex validation** in metric filters to keep a single bad pattern from breaking an entire experiment.
This release is headlined by the **beta of the new experiment creation form** and the new **Metric Usage Report** - a dedicated workspace for understanding where every metric is used, by whom, and how its adoption is trending. We're also extending the changelog introduced in May to **experiments and feature flags**, and adding end-to-end **webhook coverage for the export lifecycle** so customers can fully automate getting experiment data into their warehouse. On top of that, **stopped reasons are now customisable** per account, and we've hardened **regex validation** in metric filters to keep a single bad pattern from breaking an entire experiment.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also, the regex validation isn't in this release - it'll be in the next one 🙏

Comment thread docs/platform-release-notes/2026/06.mdx Outdated

Each entry shows who made the change, when it happened, a short summary, and **field-level before/after diffs** grouped into clear sections. This is especially valuable when reviewing why an experiment behaved differently after a mid-flight edit, or auditing how a test evolved from setup to stop.

<!-- TODO: add image release-notes/experiment-changelog.png -->

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TODO here 😅

Comment thread docs/platform-release-notes/2026/06.mdx Outdated

Similar to Experiments, change logs are now also available for **feature flags** — every modification is captured over the flag's lifetime, so you can always see **what changed, who changed it, and when**, including changes to rollout configuration, targeting, and variants.

<!-- TODO: add image release-notes/feature-flag-changelog.png -->

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TODO

Comment thread docs/platform-release-notes/2026/06.mdx Outdated
Comment on lines +92 to +103
### RE2-Compatible Regex Validation in Metric Filters

User-supplied regular expressions in metric filters are now validated on **both the frontend and the backend** using **RE2-compatible** semantics — the same engine ClickHouse uses to evaluate them.

In practice this means:

- Invalid patterns are caught **inline at edit/save time** with a clear error, and can no longer be saved through the API.
- An invalid regex sneaking through (e.g. a legacy saved value) **no longer breaks the entire experiment's metrics query** with a 500 — the engine path degrades gracefully and flags the offending metric instead.

This was triggered by a real incident where a single bad pattern took down the metrics query for an entire experiment. Tightening validation at every layer makes that class of failure go away for good.

---

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
### RE2-Compatible Regex Validation in Metric Filters
User-supplied regular expressions in metric filters are now validated on **both the frontend and the backend** using **RE2-compatible** semantics — the same engine ClickHouse uses to evaluate them.
In practice this means:
- Invalid patterns are caught **inline at edit/save time** with a clear error, and can no longer be saved through the API.
- An invalid regex sneaking through (e.g. a legacy saved value) **no longer breaks the entire experiment's metrics query** with a 500 — the engine path degrades gracefully and flags the offending metric instead.
This was triggered by a real incident where a single bad pattern took down the metrics query for an entire experiment. Tightening validation at every layer makes that class of failure go away for good.
---

@chris-absmartly chris-absmartly merged commit 2f15601 into master Jul 7, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants