Spark 3.5: Migrate tests to JUnit5 in data directory

[chinmay-bhat]

Since migrating Spark 3.5v to Junit5 is a large task, I'm splitting my work into multiple easy-to-review PR's, split by directory.

This PR contains the Junit5 migration for Spark 3.5v for the spark/data directory, and any files that inherit from this directory.

Issue: #9086

TODO:

• self-review

[chinmay-bhat]

Changes:

1. update assertJ imports
2. remove cast - int, byte[]
3. update tempDir access - solves build errors
4. I had erroneously included a parameterized file in this PR. Reverted the files changes. Will add it in a seperate PR.

[chinmay-bhat]

CI failing.
Error:

> Task :iceberg-spark:iceberg-spark-3.5_2.12:jar
/home/runner/work/iceberg/iceberg/spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/source/TestDataFrameWrites.java:150: error: cannot find symbol
    File tablePropertyDataLocation = temp.newFolder("test-table-property-data-dir");

Fix:
TestDataFrameWrites extends AvroDataTest. Since the temp dir has been updated to JUnit5 In AvroDataTest, TestDataFrameWrites temp is throwing errors.
To fix, I'll update only the temp calls in TestDataFrameWrites to JUnit5.

[chinmay-bhat]

When I run the build check (./gradlew -DallVersions build -x test -x javadoc -x integrationTest) locally, build succeeds.

BUILD SUCCESSFUL in 5m 29s
496 actionable tasks: 373 executed, 123 up-to-date
10:12:39 PM: Execution finished 'build -DallVersions -x test -x javadoc -x integrationTest'.

[chinmay-bhat]

running CI check locally and resolving errors. I'll push once I've cleared the errors / need more help!

[chinmay-bhat]

Initially, I assumed I can seperate out parameterize and non-parameterize files. But the CI errors included parameterized files that inherit from spark/data/AvroDataTest.

So I'm converting these files from JUnit4 to JUnit5

• the files (parameterized and non-parameterized) in spark/data and
• the param files inspark/source that inherit from AvroDataTest.

All CI tests pass locally with this command.
./gradlew -DsparkVersions=3.5 -DscalaVersion=2.13 -DhiveVersions= -DflinkVersions= :iceberg-spark:iceberg-spark-3.5_2.13:check -Pquick=true -x javadoc

[nastra]

LGTM once CI passes