[SPARK-56582][BUILD][TESTS] Upgrade snowflake-jdbc to 4.1.0

[dongjoon-hyun]

What changes were proposed in this pull request?

This PR aims to upgrade snowflake-jdbc test dependency to 4.1.0 for Apache Spark 4.2.0 to use the recommended version.

Why are the changes needed?

To bring the latest bug fixed version for testing:

• https://docs.snowflake.com/en/release-notes/clients-drivers/jdbc-2026 (2026-04-08)
  • New features and updates
    • Added warning when using plain HTTP endpoints for OAuth authentication.
    • Added getRole, getWarehouse, and getDatabase API extension methods.
    • Removed the io.netty.tryReflectionSetAccessible system property setting, as it is no longer needed with modern Arrow/Netty versions.
  • Bug fixes
    • Fixed ObjectMapper initialization when DATE_OUTPUT_FORMAT is specified.
    • Fixed Netty native library conflict in thin JAR packaging.
    • Bumped Netty to 4.1.132.Final to address CVE-2026-33870 and CVE-2026-33871.
    • Fixed driver failure when a security manager prohibits access to system properties, environment variables, or security provider modifications.
    • Fixed crash in getColumns when a table contained an unrecognized column type.
    • Fixed session expiration when multiple sessions have different heartbeat intervals.
    • Fixed query context not being merged from failed query responses.

Does this PR introduce any user-facing change?

No. This is a test-only dependency.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Opus 4.7

[dongjoon-hyun]

K8s IT failure is irrelevant to this PR. Currently, master branch is broken and tracked here.

• [SPARK-56583][K8S] Skip pip upgrade and use --break-system-packages to avoid PEP 668 error in PySpark Dockerfile #55492

[dongjoon-hyun]

Thank you, @HyukjinKwon .

[dongjoon-hyun]

Merged to master for Apache Spark 4.2.0.