Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spark Doris Connector Release Note 1.3.2 #203

Open
JNSimba opened this issue May 15, 2024 · 0 comments
Open

Spark Doris Connector Release Note 1.3.2 #203

JNSimba opened this issue May 15, 2024 · 0 comments

Comments

@JNSimba
Copy link
Member

JNSimba commented May 15, 2024

Features & Improvements

  1. Reconstruct Loader writing and Support writing in copy mode [refactor](load) Refactor the loader to expand the way data is written #187 [refactor](load) Support loader with copy into #190
  2. Write to support https [feature] support fe https request #189
  3. Support reading varint ipv4 ipv6 and other types [feature]support read ipv4/ipv6 data type #199 [feature] support variant type #197
  4. Support doris2.1 date/datetime reading format [improvement] Compatible with arrow serialization type modifications for date/datetime #193

Bug

  1. Fix the problem of error reporting when column name is keyword when writing [fix] stream load's colunms can use keyword with sparksql #186
  2. Fix the problem of data duplication caused by repartition [Bug] Fix data duplication caused by repartition #191
  3. Fix the problem of data duplication during retry

Behavior Change

  1. Some default values of Reader have been modified [improvement] change config default value for read optimization #196

Thanks

@gnehil
@JNSimba
@lxwcodemonkey
@smallhibiscus
@vinlee19

@JNSimba JNSimba changed the title 1 Spark Doris Connector Release Note 1.3.2 May 15, 2024
@JNSimba JNSimba pinned this issue May 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant