@spark-connect-js/node@0.5.0
Immutable
release. Only release title and notes can be modified.
Minor Changes
- #98
a6237a1Thanks @prustic!- Type-driven Arrow decode keyed on the column's Arrow type:
DECIMAL(p, s)as a fixed-point string honoring scale,DATE/TIMESTAMPasDate,MAP<K, V>asMap<K, V>with typed keys,LONGalways asbigint(wrap inNumber(...)for values known to fit a JS safe integer), applied recursively through structs and arrays ArrowEncoderbackscreateDataFrame(rows)with type inference overstring,number,boolean,bigint,Date, and nulls; strings encode as materializedUtf8(never dictionary-encoded, which SparkLocalRelationmisreads)GrpcTransportOptions.handshakeTimeoutMs(default10_000,0disables): the channel handshake fails witherrorClass: "CONNECTION_TIMEOUT"instead of hanging on an unreachable or misconfigured endpointRetryPolicy.maxConsecutiveNoProgressReattaches(default 3,0disables): a stream that keeps reattaching without delivering data throwserrorClass: "REATTACH_NO_PROGRESS"instead of retrying foreverGrpcTransportimplements the streaming command RPCs (WriteStreamOperationStart,StreamingQueryCommand,StreamingQueryManagerCommand) and the listener event streamparseConnectionStringrejects non-sc://schemes and userinfo in the host with messages naming the offending segment
- Type-driven Arrow decode keyed on the column's Arrow type: