feat(core): add spark integration

[Elbehery]

This PR adds a go implementation spark integration.

cc @laskoviymishka @zeroshade

[zeroshade]

What exactly is this PR trying to accomplish? I don't see a purpose for this at all as we already have a separate PR that is working on spark integration testing

[Elbehery]

this PR is adding integration with Apache Spark using Spark-connect-go client

[zeroshade]

Why do we need that? Spark-connect already integrates with Arrow and we return Arrow data. So I don't see any need or benefit to integration there.

[laskoviymishka]

Agree here on @zeroshade , whole purpose of this library is being standalone from spark.

[zeroshade]

ASF guidelines prohibit entirely AI generated PRs. You can use an LLM to assist you, but cannot submit a PR that is entirely AI generated. As such I'm going to close this.