Skip to content

Reschedule Daily Documentation Updater to ~2am PST and disable CI Cleaner schedule#26058

Merged
pelikhan merged 4 commits intomainfrom
copilot/fix-daily-documentation-updater
Apr 13, 2026
Merged

Reschedule Daily Documentation Updater to ~2am PST and disable CI Cleaner schedule#26058
pelikhan merged 4 commits intomainfrom
copilot/fix-daily-documentation-updater

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Apr 13, 2026

The Daily Documentation Updater had a high failure rate due to API rate limit contention, and the CI Cleaner has been failing consistently due to agent timeouts.

Root causes:

  • Daily Doc Updater: Agent succeeds but safe_outputs step hits API rate limits — 6+ daily workflows all fire during the 20:xx UTC hour, exhausting the installation token quota
  • CI Cleaner: Claude agent times out at ~47min (45min limit), related to known sandbox tool access issues

Changes:

  • Moved daily-doc-updater.md schedule from cron: daily (scattered to 14 20 * * *) to cron: daily around 10:00 (scattered to 33 10 * * * / ~2am PST) to avoid the 20:xx UTC rate limit contention window
  • Removed schedule trigger from hourly-ci-cleaner.md (was cron: '15 6,18 * * *')
  • Updated CI Cleaner description to reference this change
  • Recompiled both .lock.yml files

The Daily Documentation Updater continues to run daily at ~2am PST. The CI Cleaner remains available via workflow_dispatch for manual runs until the agent timeout issues are addressed upstream.

Copilot AI and others added 2 commits April 13, 2026 16:01
…ner workflows

Both workflows have been failing consistently due to:
- Daily Doc Updater: API rate limit exceeded during safe_outputs PR creation
  (too many workflows competing for installation token at 20:xx UTC)
- CI Cleaner: Agent timing out (~47 min, near 45-min limit)

Removing schedule triggers stops the wasted spend (~$25/month for doc updater
alone). Both workflows remain available via workflow_dispatch for manual runs.

Fixes #26015

Agent-Logs-Url: https://github.com/github/gh-aw/sessions/95204221-c84a-44c6-94a2-1ec14d998215

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] Investigate and fix Daily Documentation Updater failure rate Disable schedule triggers for Daily Documentation Updater and CI Cleaner workflows Apr 13, 2026
Copilot AI requested a review from pelikhan April 13, 2026 16:07
on:
schedule:
# Every day at 6am UTC
- cron: daily
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@copilot keep it daily around 2am PST

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Restored the daily schedule moved to ~2am PST using cron: daily around 10:00 — compiles to 33 10 * * * (10:33 UTC). This avoids the 20:xx UTC rate limit contention window that was causing failures. See commit e4560f4.

…0:00 UTC)

Per reviewer feedback, keep the doc updater on a daily schedule but move
it to around 2am PST (10:00 UTC) to avoid the 20:xx UTC rate limit
contention window.

Agent-Logs-Url: https://github.com/github/gh-aw/sessions/08202d6b-4391-4c70-9ed8-f4f900981c85

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title Disable schedule triggers for Daily Documentation Updater and CI Cleaner workflows Reschedule Daily Documentation Updater to ~2am PST and disable CI Cleaner schedule Apr 13, 2026
Copilot AI requested a review from pelikhan April 13, 2026 16:26
@pelikhan pelikhan marked this pull request as ready for review April 13, 2026 16:36
Copilot AI review requested due to automatic review settings April 13, 2026 16:36
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adjusts GitHub Actions schedules to reduce API rate-limit contention and disables an unreliable scheduled workflow while keeping manual triggering available.

Changes:

  • Rescheduled Daily Documentation Updater to run “daily around 10:00 UTC” (~2am Pacific, depending on DST).
  • Disabled the CI Cleaner scheduled trigger, leaving workflow_dispatch for manual runs.
  • Recompiled the corresponding *.lock.yml workflow lockfiles.
Show a summary per file
File Description
.github/workflows/hourly-ci-cleaner.md Removes scheduled trigger and updates workflow description to indicate schedule is disabled.
.github/workflows/hourly-ci-cleaner.lock.yml Regenerated compiled workflow reflecting schedule removal and description update.
.github/workflows/daily-doc-updater.md Moves the friendly schedule to “daily around 10:00”.
.github/workflows/daily-doc-updater.lock.yml Regenerated compiled workflow with the new scattered cron time (~10:33 UTC).

Copilot's findings

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

  • Files reviewed: 4/4 changed files
  • Comments generated: 2

schedule:
# Every day at 6am UTC
- cron: daily
# Every day around 2am PST (10:00 UTC)
Copy link

Copilot AI Apr 13, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This comment hard-codes 2am PST, but 10:00 UTC is only 2am during standard time (it’s 3am during daylight saving time). Consider rewording to 2am PT or just 10:00 UTC to avoid a seasonally incorrect note.

Suggested change
# Every day around 2am PST (10:00 UTC)
# Every day around 10:00 UTC

Copilot uses AI. Check for mistakes.
@@ -1,8 +1,6 @@
---
description: CI cleaner that fixes format, lint, and test issues when CI fails on main branch. Runs twice daily (6am, 6pm UTC) to optimize token spend. Includes early exit when CI is passing to prevent unnecessary token consumption.
description: CI cleaner that fixes format, lint, and test issues when CI fails on main branch. Schedule disabled (issue #26015); use workflow_dispatch to trigger manually.
Copy link

Copilot AI Apr 13, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The description: value contains #26015, but YAML treats # as the start of a comment when the scalar is unquoted. This causes the compiled .lock.yml to truncate the description at (... issue (see hourly-ci-cleaner.lock.yml). Quote the entire description string (or remove/escape the #) and re-run gh aw compile so the lock file is regenerated with the full description.

Suggested change
description: CI cleaner that fixes format, lint, and test issues when CI fails on main branch. Schedule disabled (issue #26015); use workflow_dispatch to trigger manually.
description: "CI cleaner that fixes format, lint, and test issues when CI fails on main branch. Schedule disabled (issue #26015); use workflow_dispatch to trigger manually."

Copilot uses AI. Check for mistakes.
@github-actions github-actions bot mentioned this pull request Apr 13, 2026
@pelikhan pelikhan merged commit dcae8cc into main Apr 13, 2026
76 of 78 checks passed
@pelikhan pelikhan deleted the copilot/fix-daily-documentation-updater branch April 13, 2026 16:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[deep-report] Investigate and fix Daily Documentation Updater — 100% failure rate for 13+ days

3 participants