Skip to content

Releases: hkpeaks/peaks-consolidation

Peaks230518

19 May 08:56
2e1ad72
Compare
Choose a tag to compare
Peaks230518 Pre-release
Pre-release

Great new after this runtime. Except some functions inside databending.go, other source codes are publised to https://github.com/hkpeaks/peaks-consolidation/tree/main/PeaksFramework as open source.

To use this software for free trial, please read the Readme.pdf file included in the file Peaks230518.zip.

The Readme.pdf, runtime for Windows/Liunx and sample scripts are included in file Peaks230518.zip.

This initial trial version 23.05.18 (YY.MM.DD) of Peaks Consolidation supports the following commands for file format csv only:-

  • BuildKey2Value
  • Distinct
  • GroupBy
  • JoinKey2Balue
  • ReadFile
  • Select
  • SelectUnmatch
  • WriteFile

Other features:-

  • Switch between in-memory and streaming mode automatically
  • Supports Windows 10+ and Linux (x86 CPU)
  • WriteFile Supports file expansion by using parameter “%ExpandBy100Time.csv”, it is case sensitive. Maximum is 100,
  • minimum is 1.
  • Allow to change CurrentSetting{StreamMB(1000)Thread(100)ForceInteger(True)}
  • Include Polars and Peaks benchmark for filtering billion-rows csv file
  • Prebuild ready-to-use scripts
    • DifferentCommands.txt
    • DifferentCommandsStreaming.txt
    • Distinct.txt
    • FilterByDifferentCompareOperators.txt
    • GroupBy.txt
    • GroupByOneColumn.txt
    • JoinTable.txt
    • JoinTableFullStreaming.txt
    • SelectColumn.txt
    • SelectColumnRow.txt
    • SelectRow.txt
    • SelectUnmatch.txt
    • RunAllScripts.bat (For Windows only: to run all of above scripts)
    • RunAllScripts.sh (For Linux only: to run all of above scripts)

The source code folder below includes the author’s old dataframe projects and other related documents of the current project.