Skip to content

Conversation

@howardchen11
Copy link
Contributor

@howardchen11 howardchen11 commented Sep 27, 2025

This PR updates the JSON pipelines documentation to reflect that the sync toggle has been removed from the UI and sync is now enabled by default for all new JSON pipelines.

  • Removed blockquote about sync being disabled by default and toggle in Advanced settings
  • Updated description to explain sync is enabled by default for data consistency
  • Added 2025-09-27 changelog entry documenting the sync toggle removal
  • Improved formatting and removed redundant explanations

Also twist the previous change logs

@howardchen11 howardchen11 requested a review from a team as a code owner September 27, 2025 07:07
@howardchen11 howardchen11 requested review from kathmath and removed request for a team September 27, 2025 07:07
@vercel
Copy link

vercel bot commented Sep 27, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Comments Updated (UTC)
docs Ready Ready Preview Comment Sep 30, 2025 7:22pm

Mixpanel is able to detect any changes in your data with the granularity of a day and replaces the old data with the latest version both in object storage and data warehouse, if applicable. Data sync helps keep the data fresh and minimizes missing data points.

Do Note: Data sync does not fully guarantee syncing GDPR Data Deletions and will only sync data for days up to 10 days in the past. It is recommended to implement a strategy to remove all records of GDPR Deleted Users in your data warehouse. Additionally, we start checking for late arriving data 24 hours after the data for a day is exported. It may take more than 2 days for the data in the destination to be in sync with the data in Mixpanel.
**Important limitations**: Data sync does not fully guarantee syncing GDPR Data Deletions and will only sync data for days up to 10 days in the past. It is recommended to implement a strategy to remove all records of GDPR Deleted Users in your data warehouse. Additionally, we start checking for late arriving data 24 hours after the data for a day is exported. It may take more than 2 days for the data in the destination to be in sync with the data in Mixpanel.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

doesnt the part around up to 10 days in the past and 2 days for the data to be in sync no longer apply with incremental pipelines? My understanding is its all now exported on the next run basically right? and its across any data in the projects history?

@howardchen11 howardchen11 merged commit d8abdb9 into main Sep 30, 2025
9 checks passed
@howardchen11 howardchen11 deleted the howardchen-docs-remove-sync branch September 30, 2025 19:24
efahk pushed a commit that referenced this pull request Nov 12, 2025
* [DINO-53] Remove sync toggle from JSON pipeline creation UI

* update previous change logs

* update change log date

* udpate notes

* fix out of order

* move change log to the botton
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants