v0.3.4

[linhr]

Overview

You can find the release summary in the documentation.

The PySail Python package is available on PyPI.

What's Changed

• feat: add try_mod function Spark 4.0.0 by @davidlghellin in feat: add try_mod function Spark 4.0.0 #727
• feat: add make_interval function by @davidlghellin in feat: add make_interval function #682
• fix: adjust default session timeout and update docs by @linhr in fix: adjust default session timeout and update docs #761
• fix: reading and writing compressed files by @shehabgamin in fix: reading and writing compressed files #760
• fix: nth_value failure on ignoreNulls=true by @SparkApplicationMaster in fix: nth_value failure on ignoreNulls=true #767
• fix: withColumnsRenamed result if chained renames in one input by @SparkApplicationMaster in fix: withColumnsRenamed result if chained renames in one input #764
• fix: window functions inconsistent uint64 return type by @SparkApplicationMaster in fix: window functions inconsistent uint64 return type #765
• fix: median return type to double by @SparkApplicationMaster in fix: median return type to double #769
• deps(npm): bump the all group with 5 updates by @dependabot[bot] in deps(npm): bump the all group with 5 updates #771
• deps(cargo): bump the all group with 4 updates by @dependabot[bot] in deps(cargo): bump the all group with 4 updates #770
• refactor: split plan resolver by @linhr in refactor: split plan resolver #772
• feat: map_entries func, map keys deduplication logic by @SparkApplicationMaster in feat: map_entries func, map keys deduplication logic #774
• chore: code coverage by @lonless9 in chore: code coverage #758
• refactor: split expression resolver by @linhr in refactor: split expression resolver #775
• fix: predicate negation for SQL by @linhr in fix: predicate negation for SQL #776
• feat: map_from_entries, unify all ways to create a map in MapFunction by @SparkApplicationMaster in feat: map_from_entries, unify all ways to create a map in MapFunction #777
• chore: add url codecov in README by @davidlghellin in chore: add url codecov in README #778
• feat: split function by @rafafrdz in feat: split function #722
• feat: text file format by @shehabgamin in feat: text file format #737
• feat: map_concat func, args check for map(k, v) func by @SparkApplicationMaster in feat: map_concat func, args check for map(k, v) func #779
• refactor: split data source options resolver by @linhr in refactor: split data source options resolver #781
• chore: codecov config by @lonless9 in chore: codecov config #780
• feat: support DeltaPlan for Delta Lake by @lonless9 in feat: support DeltaPlan for Delta Lake #768
• chore: update data format docs by @shehabgamin in chore: update data format docs #783
• fix: element_at and try_element_at inconsistent error treatment, chore: simplify, unify by @SparkApplicationMaster in fix: element_at and try_element_at inconsistent error treatment, chore: simplify, unify #785
• chore: refactor array and collection modules by @SparkApplicationMaster in chore: refactor array and collection modules #786
• docs: update unsupported SQL features by @linhr in docs: update unsupported SQL features #788
• fix: upload codecov report after tests finished by @lonless9 in fix: upload codecov report after tests finished #782
• feat: str_to_map function by @SparkApplicationMaster in feat: str_to_map function #787
• feat: add width_bucket function by @davidlghellin in feat: add width_bucket function #762
• fix: position and locate funcs with startpos arg by @SparkApplicationMaster in fix: position and locate funcs with startpos arg #789
• fix: projection optimization for extension logical nodes by @linhr in fix: projection optimization for extension logical nodes #790
• deps(npm): bump the all group with 4 updates by @dependabot[bot] in deps(npm): bump the all group with 4 updates #791
• deps(cargo): bump the all group with 7 updates by @dependabot[bot] in deps(cargo): bump the all group with 7 updates #792
• fix: split func type coersion, perf: split, str_to_map with scalar args by @SparkApplicationMaster in fix: split func type coersion, perf: split, str_to_map with scalar args #795
• chore: update cargo deps by @shehabgamin in chore: update cargo deps #796
• feat: regex_instr, fix: string funcs type casting, chore: string funcs refactoring by @SparkApplicationMaster in feat: regex_instr, fix: string funcs type casting, chore: string funcs refactoring #798
• feat: support Spark Connect streaming API by @linhr in feat: support Spark Connect streaming API #751
• feat: json_object_keys, fix: get_json_object with scalar by @SparkApplicationMaster in feat: json_object_keys, fix: get_json_object with scalar #801
• refactor: kernel log replay for Delta Lake by @lonless9 in refactor: kernel log replay for Delta Lake #794
• feat: collect_list(cols) over (window_frame) by @SparkApplicationMaster in feat: collect_list(cols) over (window_frame) #806
• refactor: use topandas in derived tpch example by @shehabgamin in refactor: use topandas in derived tpch example #807
• fix: data sink exec by @shehabgamin in fix: data sink exec #813
• fix: deterministic schema for withColumns by @linhr in fix: deterministic schema for withColumns #814
• fix: handle harmless OSError in socket test by @lonless9 in fix: handle harmless OSError in socket test #815
• deps(npm): bump @ianvs/prettier-plugin-sort-imports from 4.6.2 to 4.7.0 in the all group by @dependabot[bot] in deps(npm): bump @ianvs/prettier-plugin-sort-imports from 4.6.2 to 4.7.0 in the all group #817
• feat: heartbeat for long-running execution by @linhr in feat: heartbeat for long-running execution #818
• chore: prepare v0.3.4 by @linhr in chore: prepare v0.3.4 #819

Full Changelog: v0.3.3...v0.3.4

---

This discussion was created from the release v0.3.4.