Skip to content

Sparksoniq 0.9.6 "Olive Tree"

Pre-release
Pre-release

Choose a tag to compare

@ghislainfourny ghislainfourny released this 23 Apr 13:56
· 8243 commits to master since this release
f93097d

New alpha release for Sparksoniq, a JSONiq engine to query large-scale JSON datasets stored on HDFS. Spark under the hood.

New:

  • New functions text-file#1, text-file#2, tokenize#1, tokenize#2 to open text files as input. Now billions of lines can be manipulated as sequences of strings with FLWORs, in the same way billions of objects could until now.
  • Fixing serialization bugs (escaping)
  • Fixing bug in string literal escaping in the shell
  • Fix bug with local count clause execution
  • Fix bug in the shell leading to a crash when a parallelized FLWOR execution was outputting the empty sequence
  • Fix bug leading to a crash when the where clause expression was not returning a boolean in local execution. Now the effective boolean value is taken.

The jar file with ANTLR 4.7 is to be used with Spark 2.3+. Older versions (2.0+) use ANTLR 4.5.3.

Documentation: http://sparksoniq.readthedocs.io/en/latest/