[WIP][SPARK-46349] Prevent nested SortOrder instances in SortOrder expressions

[hhdri]

Hello everyone,

This is my first contribution to the project. I welcome any feedback and edits to improve this pull request.

Issue Addressed:
Currently, it's possible to create redundant sort expressions in both Scala and Python APIs, leading to potentially incorrect and confusing SQL statements. For example:

Scala:

spark.range(10).orderBy($"id".desc.asc).show()

Python:

spark.range(10).orderBy(f.desc('id'), ascending=False).show()

Such usage generates SQL like order by id DESC NULLS LAST DESC NULLS LAST, causing non-descriptive error messages.

Solution:
This pull request introduces a constraint in the SortOrder class, ensuring that its child cannot be another instance of SortOrder. This change prevents the creation of nested, redundant sort expressions.

Additionally, in PySpark's DataFrame.sort, there's an ascending keyword argument that could conflict with already sorted expressions. I've added an exception handler to generate more descriptive error messages in such cases.

Tests:
A test case has been added to verify that no double ordering occurs after this fix.

I look forward to your feedback and thank you for considering this contribution.

[github-actions]

We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you'd like to revive this PR, please reopen it and ask a committer to remove the Stale tag!