Skip to content

ci: refactor file diff update#22229

Merged
ti-chi-bot[bot] merged 9 commits into
pingcap:masterfrom
shhdgit:refactor-diff-update
Dec 25, 2025
Merged

ci: refactor file diff update#22229
ti-chi-bot[bot] merged 9 commits into
pingcap:masterfrom
shhdgit:refactor-diff-update

Conversation

@shhdgit

@shhdgit shhdgit commented Dec 24, 2025

Copy link
Copy Markdown
Member

First-time contributors' checklist

What is changed, added or deleted? (Required)

Which TiDB version(s) do your changes apply to? (Required)

Tips for choosing the affected version(s):

By default, CHOOSE MASTER ONLY so your changes will be applied to the next TiDB major or minor releases. If your PR involves a product feature behavior change or a compatibility change, CHOOSE THE AFFECTED RELEASE BRANCH(ES) AND MASTER.

For details, see tips for choosing the affected versions.

  • master (the latest development version)
  • v9.0 (TiDB 9.0 versions)
  • v8.5 (TiDB 8.5 versions)
  • v8.1 (TiDB 8.1 versions)
  • v7.5 (TiDB 7.5 versions)
  • v7.1 (TiDB 7.1 versions)
  • v6.5 (TiDB 6.5 versions)
  • v6.1 (TiDB 6.1 versions)
  • v5.4 (TiDB 5.4 versions)

What is the related PR or file link(s)?

  • This PR is translated from:
  • Other reference link(s):

Do your changes match any of the following descriptions?

  • Delete files
  • Change aliases
  • Need modification after applied to another branch
  • Might cause conflicts after applied to another branch

@gemini-code-assist

Copy link
Copy Markdown
Contributor

Summary of Changes

Hello @shhdgit, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request refactors the continuous integration (CI) scripts responsible for updating and managing documentation files. It streamlines the process by removing two older, specialized scripts and centralizing robust file and Table of Contents (TOC) parsing logic within a shared utility file. This change aims to improve the maintainability and reliability of the documentation update workflow, particularly for cloud-specific content.

Highlights

  • CI Script Refactoring: Two existing CI scripts, scripts/fetchFiles.js and scripts/filterUpdateFiles.js, have been removed, indicating a significant consolidation and refactoring of the file update and diff handling logic within the CI pipeline.
  • Robust TOC File Handling: The scripts/utils.js file has been enhanced to include checks for the existence of Table of Contents (TOC) files and error handling during file reading, making the process of extracting Markdown file lists more resilient.
  • New Cloud-Specific TOC Logic: New utility constants and functions (CLOUD_TOC_LIST, getAllCloudMdList) have been introduced in scripts/utils.js to centralize and deduplicate the retrieval of Markdown file paths from multiple cloud-related TOC files, streamlining cloud documentation updates.

🧠 New Feature in Public Preview: You can now enable Memory to help Gemini Code Assist learn from your team's feedback. This makes future code reviews more consistent and personalized to your project's style. Click here to enable Memory in your admin console.

Ignored Files
  • Ignored by pattern: .github/workflows/** (2)
    • .github/workflows/translation-cron.yml
    • .github/workflows/translation-zh.yaml
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

@ti-chi-bot ti-chi-bot Bot added missing-translation-status This PR does not have translation status info. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. labels Dec 24, 2025

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request refactors the CI process for handling file diff updates. It achieves this by removing the scripts/fetchFiles.js and scripts/filterUpdateFiles.js scripts and enhancing scripts/utils.js with more robust TOC file processing and new helper functions. The changes improve error handling when reading TOC files and centralize logic for handling lists of TOCs. I have one suggestion to simplify the new getAllCloudMdList function for better code clarity and to avoid redundant operations. Overall, this is a positive refactoring that improves the structure and reliability of the scripts.

Comment thread scripts/utils.js Outdated
Comment on lines +91 to +95
// Get all MD files from multiple TOCs and deduplicate
const allFilteredLinkLists = tocFiles.map((tocFile) => getAllMdList(tocFile));
const flattenedList = allFilteredLinkLists.flat();
const allFilePaths = [...new Set(flattenedList)]; // Deduplicate
return allFilePaths;

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

This function's implementation can be significantly simplified. The getAllMdList function already accepts an array of TOC files, processes them, and returns a deduplicated list of markdown file paths. You can delegate the call directly to it. This makes the code more concise and avoids redundant logic.

Suggested change
// Get all MD files from multiple TOCs and deduplicate
const allFilteredLinkLists = tocFiles.map((tocFile) => getAllMdList(tocFile));
const flattenedList = allFilteredLinkLists.flat();
const allFilePaths = [...new Set(flattenedList)]; // Deduplicate
return allFilePaths;
return getAllMdList(tocFiles);

@Oreoxmt Oreoxmt self-assigned this Dec 24, 2025
@Oreoxmt Oreoxmt self-requested a review December 24, 2025 08:30
@Oreoxmt Oreoxmt added the translation/no-need No need to translate this PR. label Dec 24, 2025
@ti-chi-bot ti-chi-bot Bot removed the missing-translation-status This PR does not have translation status info. label Dec 24, 2025
@ti-chi-bot ti-chi-bot Bot added the needs-1-more-lgtm Indicates a PR needs 1 more LGTM. label Dec 25, 2025
@ti-chi-bot

ti-chi-bot Bot commented Dec 25, 2025

Copy link
Copy Markdown

[LGTM Timeline notifier]

Timeline:

  • 2025-12-25 02:37:53.944081994 +0000 UTC m=+2304618.757859565: ☑️ agreed by Oreoxmt.

@Oreoxmt

Oreoxmt commented Dec 25, 2025

Copy link
Copy Markdown
Contributor

/approve

@ti-chi-bot

ti-chi-bot Bot commented Dec 25, 2025

Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: Oreoxmt

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@ti-chi-bot ti-chi-bot Bot added the approved label Dec 25, 2025
@Oreoxmt Oreoxmt added the lgtm label Dec 25, 2025
@ti-chi-bot ti-chi-bot Bot merged commit 2af577d into pingcap:master Dec 25, 2025
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved lgtm needs-1-more-lgtm Indicates a PR needs 1 more LGTM. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. translation/no-need No need to translate this PR.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants