Skip to content

[SPARK-58015][INFRA][FOLLOWUP] Make dependency group names compliant with the PyPA specification - #57729

Closed
ueshin wants to merge 1 commit into
apache:masterfrom
ueshin:dependency_group
Closed

[SPARK-58015][INFRA][FOLLOWUP] Make dependency group names compliant with the PyPA specification#57729
ueshin wants to merge 1 commit into
apache:masterfrom
ueshin:dependency_group

Conversation

@ueshin

@ueshin ueshin commented Aug 3, 2026

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This is a follow-up of #57093.

This PR renames internal dependency groups in pyproject.toml from names beginning with _ to names beginning with internal_. It also updates all corresponding include-group references.

No package requirements or dependency group contents are changed.

Why are the changes needed?

The PyPA Dependency Groups specification requires group names to be valid non-normalized names. Such names must begin and end with an ASCII letter or number, so the existing names beginning with _ are invalid.

[dependency-groups] keys, sometimes also called “group names”, must be valid non-normalized names. Tools which handle Dependency Groups MUST normalize these names before comparisons.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

The existing tests should pass. All dependency group names and include-group references were validated, including checks for missing references and duplicate normalized names.

Also manually:

$ uv pip install --dry-run --group pyproject.toml:dev

Was this patch authored or co-authored using generative AI tooling?

Generated-by: OpenAI Codex (GPT-5)

@ueshin
ueshin requested a review from gaogaotiantian August 3, 2026 22:47
@uros-b

uros-b commented Aug 4, 2026

Copy link
Copy Markdown
Member

LGTM, thank you @ueshin and @HyukjinKwon!

@ueshin

ueshin commented Aug 4, 2026

Copy link
Copy Markdown
Member Author

Thanks! merging to master/4.x/4.3.

@ueshin ueshin closed this in a38b122 Aug 4, 2026
ueshin added a commit that referenced this pull request Aug 4, 2026
…with the PyPA specification

### What changes were proposed in this pull request?

This is a follow-up of #57093.

This PR renames internal dependency groups in `pyproject.toml` from names beginning with `_` to names beginning with `internal_`. It also updates all corresponding `include-group` references.

No package requirements or dependency group contents are changed.

### Why are the changes needed?

The PyPA Dependency Groups specification requires group names to be valid non-normalized names. Such names must begin and end with an ASCII letter or number, so the existing names beginning with `_` are invalid.

- https://packaging.python.org/en/latest/specifications/dependency-groups/#the-dependency-groups-table

> [dependency-groups] keys, sometimes also called “group names”, must be [valid non-normalized names](https://packaging.python.org/en/latest/specifications/name-normalization/#name-format). Tools which handle Dependency Groups MUST [normalize](https://packaging.python.org/en/latest/specifications/name-normalization/#name-normalization) these names before comparisons.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

The existing tests should pass. All dependency group names and `include-group` references were validated, including checks for missing references and duplicate normalized names.

Also manually:

```sh
$ uv pip install --dry-run --group pyproject.toml:dev
```

### Was this patch authored or co-authored using generative AI tooling?

Generated-by: OpenAI Codex (GPT-5)

Closes #57729 from ueshin/dependency_group.

Authored-by: Takuya UESHIN <ueshin@happy-camper.st>
Signed-off-by: Takuya Ueshin <ueshin@happy-camper.st>
(cherry picked from commit a38b122)
Signed-off-by: Takuya Ueshin <ueshin@happy-camper.st>
ueshin added a commit that referenced this pull request Aug 4, 2026
…with the PyPA specification

### What changes were proposed in this pull request?

This is a follow-up of #57093.

This PR renames internal dependency groups in `pyproject.toml` from names beginning with `_` to names beginning with `internal_`. It also updates all corresponding `include-group` references.

No package requirements or dependency group contents are changed.

### Why are the changes needed?

The PyPA Dependency Groups specification requires group names to be valid non-normalized names. Such names must begin and end with an ASCII letter or number, so the existing names beginning with `_` are invalid.

- https://packaging.python.org/en/latest/specifications/dependency-groups/#the-dependency-groups-table

> [dependency-groups] keys, sometimes also called “group names”, must be [valid non-normalized names](https://packaging.python.org/en/latest/specifications/name-normalization/#name-format). Tools which handle Dependency Groups MUST [normalize](https://packaging.python.org/en/latest/specifications/name-normalization/#name-normalization) these names before comparisons.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

The existing tests should pass. All dependency group names and `include-group` references were validated, including checks for missing references and duplicate normalized names.

Also manually:

```sh
$ uv pip install --dry-run --group pyproject.toml:dev
```

### Was this patch authored or co-authored using generative AI tooling?

Generated-by: OpenAI Codex (GPT-5)

Closes #57729 from ueshin/dependency_group.

Authored-by: Takuya UESHIN <ueshin@happy-camper.st>
Signed-off-by: Takuya Ueshin <ueshin@happy-camper.st>
(cherry picked from commit a38b122)
Signed-off-by: Takuya Ueshin <ueshin@happy-camper.st>
@ueshin

ueshin commented Aug 4, 2026

Copy link
Copy Markdown
Member Author

Merge Summary:

@ueshin
ueshin deleted the dependency_group branch August 4, 2026 21:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants