Update to DataFusion 36

[jonmmease]

This ended up being a fairly large PR to update DataFusion to version 36.0.0 and arrow-rs to version 50.0.0. We're updating from version 32.0.0, and a lot has changed!

[jonmmease]

VegaFusion tests are passing now. There are a couple of CI issues:

1. The python duckdb tests are failing due to a failure to load an extension. Duckdb 0.10.0 was released today, so this will likely get ironed out.
2. Building wheel fails on linux aarch64, with a failure to build ring. This ring GitHub issue might be relevant: Cannot cross-compile to x86_64-unknown-linux-gnu from Apple M1  briansmith/ring#1605. There is a suggestion for some compilation flags to use, and a report that it works with version 0.17.5 (currently trying to use v 0.17.3).

Prior to this PR, we were on ring 0.16.20. Oh, this looks directly relevant: briansmith/ring#1728. We may need to bump manylinux past 2014.

[semgrep-app]

Legal Risk
The following dependencies were released under a license that is currently prohibited by your organization. Merging is blocked until this is resolved.
Recommendation:
Reach out to your security team or Semgrep admin to address this issue. In special cases, exceptions may be made for dependencies with violating licenses, however, the general recommendation is to avoid using a dependency under such a license

AGPL-3.0
dssim 3.3.1
dssim-core 3.2.8

[semgrep-app]

Legal Risk
The following dependencies were released under a license that has been flagged by your organization for consideration.
Recommendation:
While merging is not directly blocked, it's best to pause and consider what it means to use this license before continuing. If you are unsure, reach out to your security team or Semgrep admin to address this issue.

MPL-2.0
webpki-roots 0.25.4

[semgrep-app]

Legal Risk
The following dependencies were released under a license that is currently prohibited by your organization. Merging is blocked until this is resolved.
Recommendation:
Reach out to your security team or Semgrep admin to address this issue. In special cases, exceptions may be made for dependencies with violating licenses, however, the general recommendation is to avoid using a dependency under such a license

AGPL-3.0
dssim 3.3.1
dssim-core 3.2.8

[semgrep-app]

Legal Risk
The following dependencies were released under a license that is currently prohibited by your organization. Merging is blocked until this is resolved.
Recommendation:
Reach out to your security team or Semgrep admin to address this issue. In special cases, exceptions may be made for dependencies with violating licenses, however, the general recommendation is to avoid using a dependency under such a license

AGPL-3.0
dssim 3.3.1
dssim-core 3.2.8

[semgrep-app]

Legal Risk
The following dependencies were released under a license that is currently prohibited by your organization. Merging is blocked until this is resolved.
Recommendation:
Reach out to your security team or Semgrep admin to address this issue. In special cases, exceptions may be made for dependencies with violating licenses, however, the general recommendation is to avoid using a dependency under such a license

AGPL-3.0
dssim 3.3.1
dssim-core 3.2.8

[jonmmease]

Legal Risk The following dependencies were released under a license that is currently prohibited by your organization. Merging is blocked until this is resolved. Recommendation: Reach out to your security team or Semgrep admin to address this issue. In special cases, exceptions may be made for dependencies with violating licenses, however, the general recommendation is to avoid using a dependency under such a license

AGPL-3.0 dssim 3.3.1 dssim-core 3.2.8

This was only used in testing (not part of the production build), but to simplify things I switch to the pixelmatch crate (with MIT license) instead of dssim for testing.

[jonmmease]

Removed this UDF in favor of the built-in DataFusion make_list function

[jonmmease]

Removed this UDF in favor of DataFusion's built-in array_length and character_length functions

[jonmmease]

Replaced with DataFusion's built-in isnan function

[jonmmease]

I tried to drop our custom span UDF in favor of DataFusion transforms. I think I got it working, but DataFusion didn't seem to be able to simplify array expressions, which is what we use for scalar evaluation.