Skip to content

Conversation

@yaooqinn
Copy link
Member

What changes were proposed in this pull request?

This PR adds a new avro_funcs group for Avro SQL functions (from_avro, to_avro, schema_of_avro) to follow the pattern used by other data format functions like xml_funcs, json_funcs, and csv_funcs.

Why are the changes needed?

Currently, Avro functions are grouped under misc_funcs, while other data format functions have their own dedicated groups:

  • xml_funcs for XML functions
  • json_funcs for JSON functions
  • csv_funcs for CSV functions

For consistency and better documentation organization, Avro functions should also have their own group.

Does this PR introduce any user-facing change?

No, this is a documentation-only change that affects how functions are grouped in the SQL function reference.

How was this patch tested?

Existing tests pass. The change was validated by building the documentation.

Was this patch authored or co-authored using generative AI tooling?

Yes, GitHub Copilot was used to assist with this change.

@github-actions
Copy link

JIRA Issue Information

=== Improvement SPARK-55127 ===
Summary: [SQL] Add avro_funcs group for Avro SQL functions
Assignee: None
Status: Open
Affected: ["4.0.0"]


This comment was automatically generated by GitHub Actions

@github-actions github-actions bot added the SQL label Jan 22, 2026
@yaooqinn yaooqinn force-pushed the SPARK-55127-avro-funcs-group branch 2 times, most recently from 15e20c5 to bcc6d40 Compare January 22, 2026 03:40
### What changes were proposed in this pull request?

This PR adds a new `avro_funcs` group for Avro SQL functions (from_avro, to_avro, schema_of_avro) to follow the pattern used by other data format functions like xml_funcs, json_funcs, and csv_funcs.

### Why are the changes needed?

Currently, Avro functions are grouped under `misc_funcs`, while other data format functions have their own dedicated groups:
- `xml_funcs` for XML functions
- `json_funcs` for JSON functions
- `csv_funcs` for CSV functions

For consistency and better documentation organization, Avro functions should also have their own group.

### Does this PR introduce _any_ user-facing change?

No, this is a documentation-only change that affects how functions are grouped in the SQL function reference.

### How was this patch tested?

Existing tests pass. The change was validated by building the documentation.

### Was this patch authored or co-authored using generative AI tooling?

Yes, GitHub Copilot was used to assist with this change.
@yaooqinn yaooqinn force-pushed the SPARK-55127-avro-funcs-group branch from bcc6d40 to b073f98 Compare January 22, 2026 17:22
@HyukjinKwon
Copy link
Member

Merged to master.

@yaooqinn yaooqinn deleted the SPARK-55127-avro-funcs-group branch January 23, 2026 02:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants