[Integration] Reconsider generated_large_batch.json

[asfimport]

The dominant part of the time spent running the integration tests is one test case named "generated_large_batch.json". It is not obvious how useful this test case is. Ideally, integration test cases should be small enough to only take a fraction of a second.

Reporter: Antoine Pitrou / @pitrou
Assignee: David Li / @lidavidm

PRs and other links:

• GitHub Pull Request #7908

_{Note: This issue was originally created as ARROW-9358. Please see the migration documentation for further details.}

[asfimport]

David Li / @lidavidm:
It's used to verify that gRPC is configured to allow large message payloads by default in Flight. I think we could reduce the size though (to a few 10s of MBs instead of the very large size it currently is).

[asfimport]

Antoine Pitrou / @pitrou:
Do we need to use the integration tests for that? It goes through a costly JSON conversion step.

[asfimport]

David Li / @lidavidm:
That's true. They could be made into in-process tests.

[asfimport]

Micah Kornfield / @emkornfield:
Issue resolved by pull request 7908
#7908