Memory allocation error in CombiTimeTable when given UTF16 LE file

[maltelenz]

If a CombiTimeTable is given a UTF16-LE encoded text file of sufficient length (pretty short) it fails with a Memory allocation error.

I realize the table format requires UTF-8 or ASCII, but a nicer failure mode for such an invalid file would be nice.

To reproduce, create a model with a single CombiTimeTable component pointing to the attached file, and attempt to simulate:

MadeUpTable.txt

The error seems to come from https://github.com/modelica/ModelicaStandardLibrary/blob/master/Modelica/Resources/C-Sources/ModelicaIO.c#L1039 after bugLen overflows to negative numbers.

[beutlich]

@maltelenz Do you think there might be some requirement to support UTF-16 encoded text files?

[maltelenz]

@beutlich I don't see a large need for it. My personal experience is that everyone is using UTF-8, and the description on https://en.wikipedia.org/wiki/UTF-16 seems to agree:

It is rarely used for files on Unix-like systems. As of May 2019, Microsoft seems to have reversed course and now supports and recommends using UTF-8.[2]

UTF-16 never gained popularity on the web, where it is used by under 0.01% (1 hundredth of 1 percent) of web pages,[3] and UTF-8 dominates.