feat: support v2 sync protocol

[doc-han]

Description

This PR makes sync v2 protocol an option for syncing projects with Github. By default sync will use the old config.json style but users can switch to the new openfn.yaml style if they prefer.

Currently defaults to v1 (legacy) but can be switched to v2 (new) style

Github Sync Setup Screen
Legacy	New

Closes #4523

Validation steps

1. Try to sync a project with github. connect and select the repo you want to sync with
2. Click on Advanced: Use new openfn.yaml format
3. After connecting. sync the project.
4. Check whether your openfn.yaml is in github with nicely generated content like the example below

Example openfn.yaml content

project:
  uuid: 43c34b65-50cf-4ec3-b480-32b3b17ac9c0
  endpoint: <your-instance-url>
  alias: 
  inserted_at: 2026-04-13T01:00:00Z
  updated_at: 2026-04-13T04:37:54Z
  id: sync
  name: sync
workspace:
  credentials: credentials.yaml
  dirs:
    projects: .projects
    workflows: workflows
  formats:
    openfn: yaml
    project: yaml
    workflow: yaml

AI Usage

Please disclose whether you've used AI anywhere in this PR (it's cool, we just
want to know!):

• I have used Claude Code
• I have used another model
• I have not used AI

You can read more details in our
Responsible AI Policy

Pre-submission checklist

• I have performed an AI review of my code (we recommend using /review
  with Claude Code)
• I have implemented and tested all related authorization policies.
  (e.g., :owner, :admin, :editor, :viewer)
• I have updated the changelog.
• I have ticked a box in "AI usage" in this PR

[doc-han]

Problems

1. Why don't we allow users to generate a new github project from our platform when doing sync? (because if I need it on a new repo, I'll have to manually create that on github)
2. When a repo has no content yet. We're unable to find the branches on it. i.e we can't find main on the repo

[doc-han]

@josephjclark suggests we keep v1 as default and then allow users to switch to v2 style

[josephjclark]

Sample v2 filesystem after sync has been established: https://github.com/doc-han/openfn-new

[codecov]

Codecov Report

❌ Patch coverage is 95.23810% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 89.67%. Comparing base (a665cfc) to head (8442117).
⚠️ Report is 2 commits behind head on main.

Files with missing lines	Patch %	Lines
...ing_web/live/project_live/github_sync_component.ex	88.88%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #4634      +/-   ##
==========================================
+ Coverage   89.62%   89.67%   +0.05%     
==========================================
  Files         444      444              
  Lines       21609    21627      +18     
==========================================
+ Hits        19366    19395      +29     
+ Misses       2243     2232      -11     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[midigofrank]

Nicely done @doc-han , left a few change requests. Also, is there a link we can add that describes what this new yaml format is all about? Maybe community post or just the docs

[github-actions]

Security Review

⚠️ The review completed but no findings comment was posted.

See the workflow run for the raw Claude output.

[josephjclark]

Great @doc-han, I'm happy with this

I think we should run careful testing against staging. I've not done any kind of QA beyond watching you screen. It's not actually that complicated though so we should be alright

[josephjclark]

QA notes:

• Setting up a GH sync works exactly the same as it is in production, with (almost no) change in the UI
• After sync is set up, the settings will tell you you're using sync v1
• And the sync works for push and pull
• Now you can set up a GH sync but tick the box to use V2
• In v2 sync, your github should contain:
  • an openfn.yaml file
  • a workflows folder with all job code beautifully expanded into files
  • a .projects folder with a yam file called something like main@openfn.org.yaml
  • No config.json, state.json or project.yaml file from v1
• After sync is established, the sync should tell you it's using v2 style
• Sync should work for push and pull

[midigofrank]

Nicely done