File.ReadAsLinesSync silently does not read the whole of very large file on Linux

[lukechurch]

Generate a large file, piping something like the following into a file:

import 'dart:io';

main() {
	for (int i = 0; i < 1000 * 1000 * 1000; i++) {
	   print ("$i: Long line of text to pad the file");
	}
}

Run this until the file is ~2.5Gb

Then load the file back

main() {
   var lst = new File('BigListOfNumbers.log').readAsLinesSync();

   print (lst.length);
   print (lst.last);
}

On OS X this will fail with an error message

FileSystemException: readSync failed, path = 'BigListOfNumbers.log' (OS Error: Invalid argument, errno = 22)

On Linux this appears to read only part of the file. The number reported is less than number reported by running 'tail' on the same file.

If there is a size limit on the files that can be read, this should reported as an error, rather than silently failing. This has resulted in a bug that proved very difficult to locate.

[lrhn]

The 2.5Gb size suggests a signed 32-bit integer overflow, and Dart doesn't have 32-bit integers, so the problem is likely in the OS glue code or maybe in not using the correct "big file aware" API (if one exists).

[Szaki]

Can confirm this issue on Dart SDK version: 2.10.4 (stable) (Wed Nov 11 13:35:58 2020 +0100) on "macos_x64".