[Data] Improve block size selection when reading large jsonl data chunks

[scottjlee]

Description

As a followup to #40533, add logic to gracefully handle cases where the block size configured in Arrow's JSON loader is too small.

Hugging Face has an implementation where they handle this dynamically, we could do something similar by adding an improved default value and fallback logic to increase the block size to a sufficient value: https://github.com/huggingface/datasets/blob/d122b3ddc67705cc2b622bcbd79de9ff943a5742/src/datasets/packaged_modules/json/json.py#L119

Related issues:

• Error when loading a HUGE json file (pyarrow.lib.ArrowInvalid: straddling object straddles two block boundaries) huggingface/datasets#2181
• ArrowInvalid: straddling object straddles two block boundaries (try to increase block size?) apache/arrow#7835
• [Python] Automatically back on larger IO block size when JSON parsing fails apache/arrow#25674 (comment)

Use case

No response