[Bug] column_separator and line_delimiter not support an invisible character

[liuchunhua]

Search before asking

• I had searched in the issues and found no similar issues.

Version

Doris 1.2.3
doris-spark-connector: master

What's Wrong?

pyspark3.1.3

df.write.format("doris")
        .option("doris.table.identifier", "")
        .option("doris.fenodes", "")
        .option("user", "")
        .option("password", "")
        .option("doris.write.fields", ",".join(df.columns))
        .option("doris.sink.batch.size", "20000")
        .option("doris.sink.max-retries", "3")
        .option("doris.sink.properties.format", "csv")
        .option("sink.properties.column_separator", "\\x01")
        .option("sink.properties.line_delimiter", "\\x07")
        .option("doris.sink.batch.interval.ms", "200")

stream load csv failed with invisible character

What You Expected?

like Doris fe
org.apache.doris.analysis.Separator
convert \x01 and invisible character

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[gnehil]

we are working on this，it will be supported soon

[JNSimba]

It has been resolved and can be upgraded to the latest connector