[2023-09-18] Library & Engine Team Update

[GregoryTravis]

• James: Fixes issue writing to a dry run Excel File Fixes issue writing to a dry run Excel File #7763
• James: S3 Read Access, Input Stream based reading S3 Read Access, Input Stream based reading #7776
• Radek: Support for BigInteger values in Table Support for BigInteger values in Table #7715
• Radek: More robust/friendly Date Time formatter More robust Date/Time format patterns parsing #7826
• Greg: New Data.post for sending a payload to a Web API New Data.post for sending a payload to a Web API #7700
• Jaroslav: Support runtime checks of intersection types Support runtime checks of intersection types #7769
• Jaroslav: Avoid StackOverflow when comparing unknown foreign objects Avoid StackOverflow when comparing unknown foreign objects #7780
• Jaroslav: Benchmark shall loop correctly Benchmark shall loop correctly #7781
• Jaroslav: Checking ascribed expression types for existence Checking ascribed expression types for existence #7796
• Jaroslav: Moving numpy check into test/Examples_Tests Moving numpy check into test/Examples_Tests #7808
• Jaroslav: Cleanup code in IdExecutionInstrument Cleanup code in IdExecutionInstrument #7811
• Jaroslav: Throw UnsupportedMessageException when loosing BigInteger precision Throw UnsupportedMessageException when loosing BigInteger precision #7817
• Hubert: Cleanup serialization config Cleanup serialization config #7748
• Hubert: Workaround crashes during regular execution Workaround crashes during regular execution #7778
• Hubert: Improve shutdown logic of language server Improve shutdown logic of language server #7801
• Hubert: Fix log output for suggestions' tests Fix log output for suggestions' tests #7803
• Hubert: Rename Decimal to Float Rename Decimal to Float #7807
• Hubert: Reduce extra output in compilation and tests Reduce extra output in compilation and tests #7809
• Hubert: Always log verbose logs to a log file Always log to console and file #7825
• Pavel: Implement private modules Implement private modules #7304
• Dmitry: expressionUpdates do not contain Method Pointer of operators expressionUpdates do not contain Method Pointer of operators #7659
• Dmitry: Log visualization expressions generated by IDE Log visualization expressions generated by IDE #7756
• Dmitry: Download single edition by name Download single edition by name #7771
• Dmitry: Fix flaky project rename test Fix flaky project rename test #7794
• Dmitry: Send suggestions database on request Send suggestions database on request #7812

[radeusgd]

A few words on new date-time formats:

Rationale: we were having weird bugs (#7461) because in Java format yyyy and YYYY mean different things (first is a year of era, the second is a special ISO week date year, e.g. Sat 1 Jan 1977 is actually 1976-W53-6 in this format). Similarly d and D have slightly different meanings. This has caused great confusion.

We've now developed our own, simplified format for the date-time format patterns. It is mostly case insensitive (YYYY and yyyy always mean the same thing), with the only exception of H/h (24 vs 12 hour clock hours) and M (months) vs m (minutes).

To still allow the ISO week date, we simply use a separate function to enable this format (in it, yyyy always means the week-based year, and regular months are unavailable because their meaning is incompatible with week-based-years):

Our advanced users can still use the Raw Java format if they wish to, using from_java:

---

This is still work in progress. In the next iterations, I plan to add some validation layers to make the user experience even better and error-less. For example, when we encounter a month field between time fields (HH:MM:ss) or minute field between date fields (yyyy-mm-dd), we will accept such cases (there can be weird formats out there), BUT we will attach a warning telling the user that this is likely a mistake. Similarly, a 24h hour with an ampm marker (HH:mm a) which is redundant, will also yield a warning.

[jdunkerley]

S3 Integration: