Skip to content

Releases: apache/seatunnel

2.3.13 Release

14 Mar 02:52
@xiaochen-zhou xiaochen-zhou
2.3.13
8c9d47f

Choose a tag to compare

View all tags
2.3.13 Release Latest
Latest

2.3.13 Release Note

This is a great milestone for Apache SeaTunnel project!
The release of version 2.3.13 with its so many new features and fixes will significantly boost the efficiency of data integration workflows for our users.

We’re really impressed by the dedication and hard work our contributors have put into this update, and we're confident this new version will be widely welcomed by the community.

Feature

  • [Feature][Core][Checkpoint] Add checkpoint api (#10065)
  • [Feature][Zeta] Support the min-pause configuration for checkpoints (#9804)
  • [Feature][Flink] Add Flink version 1.20.1 support (#9576)
  • [Feature][Flink] Support CDC source schema evolution on Flink engine (#9867)
  • [Feature][Connector-V2][HdfsFile] Support true large-file split for parallel read (#10332)
  • [Feature][connector-file-local] Localfile supports splitting and parallel reading of large files of csv, text, and json (#10142)
  • [Feature][connectors-v2/connector-file] Support logical Parquet splits (#10239)
  • [Feature][Connector-V2] Support sink connector for Apache HugeGraph (#10002)
  • [Feature][connector-jdbc] Support source and sink of DuckDB (#10285)
  • [Feature][Connector-V2] Support write data into lance dataset (#9894)
  • [Feature][Connector-V2] Support sink connector for AWS DSQL #9726 (#9739)
  • [Feature][Connector-V2] Support sync_mode=update for FtpFile/SftpFile/LocalFile source (binary) (#10437)
  • [Feature][Connector-V2][Elasticsearch] Add Runtime Fields support (Elasticsearch 7.11+) (#10201)
  • [Feature][Connector-v2]Resolve null first column in CSV Reader (#10383)
  • [Feature][Connector-v2][Kafka] Add support for Schema Registry wire format in Protobuf deserialization (#10183)
  • [Feature] [Connector-V2][HBase] Support time-range scan with min/max timestamp in HBaseSource (#10318)
  • [Feature][Iceberg] Support schema.partition_keys and ${partition_keys} placeholder (#10389)
  • [Feature][Connector-V2] Support hdfs file multi table source read (#9816)
  • [Feature][Transform-V2] Support multimodal embeddings (#9673)
  • [Feature][Transform-V2] Support RegexExtract Transform (#9829)
  • [Feature][Connector-V2] Support `` for the SQL To Paimon converter (#10206)
  • [Feature][Kafka source] Inject Kafka record timestamp as EventTime metadata (#9994)
  • [Feature][Connector-V2] Postgresql support read TIMESTAMP_TZ (#10048)
  • [Feature][Connector-V2] Support HDFS ViewFs Schema (#10117)
  • [Feature][Core] Add REST API for viewing Pending queue details (#10078)
  • [Feature][Connector-V2] Hive sink support SchemaSaveMode and DataSaveMode (#9743)
  • [Feature][Connector-V2] Support the dynamic options of the paimon table read (#9981)
  • [Feature][Connector-V2][Milvus] Sink writer flush by interval (#9961)
  • [Feature][Core] Add PendingJobs info in the response of GetOverviewOperation (#9902)
  • [Feature][Connector-V2] Support row range boundaries for HBaseSource (#9983)
  • [Feature][Hive] Kerberos renew for >24h Hive and HDFS writes (#9989)
  • [Feature][Connector-redis] fix redis cluster bug and add cluster e2e (#9869)
  • [Feature][Format] Improve maxwell_json,canal_json,debezium_json format support merge update_before and update_after (#9805)
  • [Feature][File] Add markdown parser documentation (#9834)
  • [Feature][File] Add markdown parser for RAG support #9714 (#9760)
  • [Feature][Connectors-v2] Clean up temporary files for paimon sink (#9819)
  • [Feature][Connector-V2] Support CDC mode for databend sink connector (#9661)
  • [Feature][Engine]Metalake support for data source information storage and management (#9688)
  • [Feature][Connector-V2] [IoTDB] Added source and sink connectors to support IoTDB 2.X (#9872)
  • [Feature][Connector-File-Hadoop] Support sync_mode=update for HdfsFile source (binary) (#10268)
  • [Feature][Connector-V2][Hive] Support multiple Hive metastore URIs for automatic failover (#10253)
  • [Feature][Core][Metrics] Add sink committed metrics and calculate commit rate in job metrics summary (#10233)
  • [Feature][connector-hive] Support regex and whole-database table_name for source (#10250)
  • [Feature][connector-kudu] Support regex and whole-database table_name for source (#10180)
  • [Feature][Connector-V2] Mongodb Sink Support Multi Table (#9958)
  • [Feature][Connector-V2] MongodbSink Support SaveMode (#9883)
  • [Feature][Core] Support define any nested array and map type in Zeta (#9881)
  • [Improve][Zeta] Improve job metrics handling with partitioning support (#9833)
  • [Improve][Connector-Clickhouse] improve ck batch parallel read by using last batch row sorting value approach, instead of limit offset. (#9801)
  • [Improve][Connectors-v2] Add support for re-signaling NoMoreSplitsEvent after reader re-registration (#10208)
  • [Improve][Core][Metrics] Refactor and enhance job metrics handling for multiple sinks with updated tests (#10273)
  • [Improve][Zeta] engine-server and seantunnel-ui support remote paginated queries (#9951)
  • [Improve][Common] Improve SinkFlowTestUtils Checkpoint Logic (#10071)
  • [Improve][seatunnel-api] Unify non-relational data source multi-table mode schema configuration parameters (#10370)
  • [Improve] cdc related options (#10372)
  • [Improve][E2E] Improve redis e2e for delete (#10018)
  • [Improve][Core][Metrics] Optimize Sink Write Data Statistics (#10100)
  • [Improve][Connector-V2][WeChat] Optimize StringBuffer to StringBuilder for better performance (#10127)
  • [Improve][Fink] NO_CDC source support checkpoint (#10094)
  • [Improve][Connector-v2][MySQL] Optimize shard calculation strategy (#9975)
  • [Improve] Support JSON multi-level nested parsing (#10000)
  • [Improve][e2e] Change Docker images to use seatunnelhub repository (#10072)
  • [Improve][Connector-V2][HBase] Support configurable range scan boundary inclusion policies (#10011)
  • [Improve][E2E] update jdk docker image to seatunnelhub (#10036)
  • [Improve][seatunnel-connectors-v2][connector-mongodb] Improve MongodbWriter close (#10051)
  • [Imporve][Connector-v2][MySQL-CDC]Schema evolution optimization waiting time (#10040)
  • [Improve][E2E] Improve redis test for delete hash (#9946)
  • [Improvement][Connector] Upgrade Kafka client version from 3.2.0 to 3.4.0 (#9941)
  • [Improve][CI] Optimize CI (#9900)
  • [Improve][Core][Starter] Support encryption and decryption for transform config (#9932)
  • [Improve][CI] Increase timeout for kafka-connector-it from 120 to 140 minutes (#9893)
  • [Improve][Connector-V2] MongodbSinkFactory implements TableSinkFactory (#9879)
  • [Improve] Update snapshot version to 2.3.13 (#9858)
  • [Improve][Connector-V2][Hive] Deduplicate Hive option definitions (#10251)
  • [Improve][Connector-V2][Elasticsearch] Enhance Scroll API handling with resource cleanup (#10124)
  • [Improve][Connector-v2][Hive] Add socket and connection timeout options for Hive JDBC connections (#10254)
  • [Improve][Core] Auto-create GC log directory to avoid startup failures (#10255)
  • [Improve][e2e] Increase timeout for DatabendCDCSinkIT to reduce test flakiness (#10269)
  • [Improve][Connector-V2][Jdbc] Increase timeout for schema change IT to fix flaky test (#10258)
  • [Improve][connector-elasticsearch] Optimize Elasticsearch Sink vector parameters and documents (#10260)
  • [Improve][Zeta] Remove unused fields (#10261)
  • [improve] the substring and substr functions support Date,LocalDate,L… (#9969)
  • [Improve][seatunnel-api] Optimize metadata lake related code (#10347)
  • [Improve][Connector-V2][HBase] Support DATE/TIME/TIMESTAMP/DECIMAL in sink and fix DECIMAL deserialization (#10291)
  • [Improve][seatunnel-connectors-v2][connector-jdbc] Remove some obsolete code in JdbcSinkFactory (#10026)
  • [Improve][CI] Increase kudu connector timeout to 60 minutes (#10240)
  • [Improve][Connector] Replace printStackTrace with proper logging (#10176)
  • [Improve][Connecotr-v2][Databend] Optimize CI judgment logic (#10130)
  • [Improve][Zeta] Filter tasks and pipelines by state (#9926)

Docs

  • [Feature][File] Add markdown parser documentation (#9834)
  • [Improve][Docs] Add S3 Compatible Storage IMAP configuration example. Closes #10308 (#10342)
  • [Improve][doc]Optimize the introduction of schema parameters in documents (#10385)
  • [Improve][doc] move duckdb doc (#10382)
  • [Improve][Docs] Supplement Chinese documentation for SeaTunnel connectors (#10109)
  • [Improve][Docs] Add incompatible changes documentation for version upgrades (#10068)
  • [Improve][Docs][seatunnel-engine] Add namespace to plugin-config (#10271)
  • [Improve][Docs][connector-file] Document SaveMode options for HdfsFile/LocalFile (#10283)
  • [Improve][Docs] Add multiple table sync examples for MySQL Sink connector (#10241)
  • [Improve][Doc] Update table_path examples for clarity and consistency (#10202)
  • [Improve][Docs] Fix word spelling errors (#10170)
  • [Doc] SQL UDF docs hardcode 2.3.2 dependencies causing runtime mismatc… (#10445)
  • [Doc] correct some issues for Readme.md (#10424)
  • [Doc] Adjust the file structure under concepts (#10420)
  • [Doc] Update README.md
  • [Doc] Fix the Deepwiki display in READE.md (#10438)
  • [Doc] [MongoDB] Update CDC documentation for role and user creation with clearer examples (#10423)
  • [Doc] align EN architecture docs with Zeta implementation
  • [Doc] correct some issues for Readme.md
  • [Doc] Adjust Seatunnel Doc Structure (#10395)
  • [Doc] Seatunnel Doc Structure Adjustment (#10351)
  • [Doc] Introduce SeaTunnel MCP and x2SeaTunnel documentation on website (#10108)
  • [Doc][transforms-v2] improve meatadata and rowkind doc (#10010)
  • [Doc][Transform-v2][Embedding] Fix transform embedding option name (embedding_model_provider -> model_provider) (#9925)
  • [Doc]fix Elasticsearch source docs (options table, typos) (#10259)
  • [Chore] fix typos coolumn ---> column (#9830)
  • [Doc][Connector-V2][S3File] Fix connector s3file option name (access_secret -> secret_key) (#9892)
  • [Doc] Optimize Seatunnel Document Structure (#10262)
  • [Doc][connector-hbase] Add Kerberos configuration notes/ex...
Read more
Assets 2
Loading

2.3.12 Release

12 Sep 08:43
@Hisoka-X Hisoka-X
2.3.12
1fce0a7

Choose a tag to compare

View all tags
2.3.12 Release

2.3.12 Release Note

Docs

  • [Doc] Added deepwiki to README.md #9354 (#9356)
  • [Doc] Fix link error and DynamoDB parameter error (#9447)
  • [Doc][Improve] update projection supported in Paimon (#9425)
  • [Doc][Zeta] Add zeta tuning guide (#9539)
  • [doc]The link in the document is 404 (#9561)
  • [Docs] update jdbc related document (#9679)
  • [Docs][Connector-Iceberg] Update Iceberg doc with support S3 Tables rest catalogs (#9686)
  • [Fix][Doc] Fix rest api finished-jobs doc miss SAVEPOINT_DONE (#9676)
  • [Fix][Doc] Fix transform-v2 TableFilter title (#9528)
  • [Fix][Doc] Sink's plugin_input is incorrect configurations (#9492)
  • [Fix][Doc] Update StarRocks doc change schema necessity to true (#9656)
  • [Improve][Doc] Add GenericDialect support in jdbc doc (#9763)
  • [Improve][Doc] Add multimodal support description to docs (#9652)
  • [Improve][Doc] Add SeaTunnel tools into Readme (#9707)
  • [Improve][Doc] Fix formatting of parameter types (#9753)
  • [Improve][Doc] Update sql function result type (#9703) (#9711)

Bug Fix

  • [Bug] [Connector-V2] Fix the issue of writing the ORC format Iceberg report "Illegal provider-class name" (#6754) (#9588)
  • [Bug] [Connector-V2] Updates Iceberg version to 1.6.1 (#9387) (#9451)
  • [Bug] [seatunnel-connector-http-base] An NPE (NullPointerException) will occur when the pageField is null (#9498)
  • [Bug][connector-http] Fix paging request running infinitely (#9504)
  • [Bug][Connector-V2] fix NPE when decimal type precision is incompatible for Paimon (#9452)
  • [Bug][Connector-V2] NoSuchMethodError caused by Netty version conflict on Spark 3.3.0 (#9632)
  • [bug][dist]fix the release packaging exception (#9436)
  • [bugfix][Connector-V2] Fixed the load driver inaccurate situation (#9468)
  • [Fix] [connector-jdbc] prevent precision loss in Float to BigDecimal conversion (#9670)
  • [Fix] [Transform-V2] Fix embedding output columns vector dimension (#9646)
  • [Fix][CI] Update iris docker version to fix ci (#9360)
  • [Fix][Connecotr-kafka] Fix kafka IllegalArgumentException when offset is -1 (#9376)
  • [Fix][Connector-clickhouse] Fix SeaTunnelRow tableId set error (#9585)
  • [Fix][Connector-File] Fix parquet support user config schema (#9596)
  • [Fix][Connector-HTTP] Add default content-type when user not set (#9497)
  • [Fix][Connector-Http] fix Invalid mime type (#9363)
  • [Fix][connector-http] fix parsing httpjson, the number of two fields is inconsistent with the import failure (#9103)
  • [Fix][Connector-Iceberg] Fix Time Zone Issue for Iceberg Timestamp Type (#9460)
  • [Fix][Connector-Jdbc] Supports reading and writing Postgres network dress types (#9618)
  • [Fix][Connector-Jdbc]Fixed Vertica data source cannot upsert data. (#9607)
  • [Fix][connector-rabbitmq] Set default value for durable, exclusive and auto-delete (#9631)
  • [Fix][Connector-V2] Add Filter for Partitions to Prevent Blocking in KafkaConsumer StreamMode (#9598)
  • [Fix][Connector-V2] ArrowToSeatunnelRowReader convertSeatunnelRowValue add handle Second TIMESTAMP type (#9393)
  • [Fix][Connector-V2] Correct typo in batch-size-per-scan option key (#9434)
  • [Fix][Connector-V2] Fix misleading parameter name in DorisStreamLoad (#9685)
  • [Fix][Connector-V2] Fix OceanBase Oracle create unsupported data type (#9383)
  • [Fix][Connector-V2] Fix prometheus check time can not parse double value (#9311)
  • [Fix][Connector-V2] Fix starrocks decimal column definition generation(#9470) (#9471)
  • [Fix][Connector-V2] Optimize Paimon DECIMAL type check to prevent precision loss (#9480)
  • [Fix][Connector-V2] Optimize start mode of kafka recovery job (#9736)
  • [Fix][Connector-V2] Oracle cdc not update transaction commit when LOB enabled (#9412)
  • [Fix][Connector-V2] set default tableid in SeaTunnelRow for Debezium JSON deserialization (#9431)
  • [Fix][Connector-V2] Update catalog table schema of debezium json (#9525)
  • [Fix][Connector-V2] Update file filter pattern compilation to remove unnecessary quoting (#9658)
  • [Fix][Connector-V2] Update waitCompaction value for batch mode and writeonly (#9479)
  • [Fix][Connectors-Jdbc] Postgres supports streaming and batch reading and writing of the interval data type (#9590)
  • [Fix][Connectors-v2] fix dynamic bucket for paimon sink (#9595)
  • [fix][connectors-v2] repeated commit cause task exceptions (#9665)
  • [Fix][Core]fix kotlin jar conflict (#9683)
  • [Fix][E2E] Fixed e2e test cases of Kafka did not work as expected (#9359)
  • [Fix][engine-server] Fix the issue of garbled characters in log output (#9594)
  • [Fix][Mongo-CDC] Fix the issue where mongo isExactlyOnce defaults to true, causing room to malfunction (#9454)
  • [Fix][paimon-e2e] e2e test error (#9467)
  • [Fix][paimon-e2e] Optimize Paimon E2E Cases (#9612)
  • [Fix][seatunnel-dist]fix duplicate dependency (#9458)
  • [Fix][Spark] Fix source parallelism not working with Spark engine (#9319)
  • [Fix][Transform-V2] correct handling of 'T' in date format strings (#9406)
  • [Fix][Transform-v2] Fix custom udf throw exception (#9195)
  • [Fix][Transform-V2] Reduce embedding precision from double to float (#9635)
  • [Fix][Transform] Support integer input for from_unixtime function (#9738)
  • [Fix][Zeta] Avoid redundant checkpoint reads when disabled checkpoint (#9552)
  • [Fix][Zeta] change parallelStream to stream in SeaTunnelTask to avoid classloader mismatch (#9426)
  • [Fix][Zeta] Enhance job state display by including pending jobs in status retrieval (#9489)
  • [Fix][Zeta] Fix Imap resource leak (#9696)
  • [Fix][Zeta] Fix local mode can not finish (#9549)
  • [Fix][Zeta] Fix operation thread leak when master switch (#9464)
  • [Fix][Zeta] Use dynamic port allocation for HTTP in RestApiHttpsForTruststoreTest and update Prometheus image (#9792)
  • [Fix][POM] Fix transform udf dependency version (#9803)
  • [Fix][Core] Fix the placeholders cannot pass parameters when using complex config (#9800)
  • [Future][Connector-V2]Support the automatic creation of non-primary key table (#9219)
  • [HotFix][CI] The Some CI subtasks are not executed (#9684)
  • [Hotfix][Connector-Jdbc] Write MySQL to support set collection data type (#9553)
  • [Hotfix][Transform-V2] Fix some model return number of dimensions (#9644)
  • [Hotfix][Zeta] Fix custom https port configuration not working (#9705)

Feature

  • [Chore] fix typos filed -> field (#9757)
  • [Chore][Core] Remove useless parameter in ConfigBuilder (#9494)
  • [Feature] [connector-file] Add configurable sheet_max_rows support for Excel sink connector (#9668)
  • [Feature] Version from 2.3.11 to 2.3.12 (#9366)
  • [Feature][Connector-Clickhouse] Support Clickhouse multi table source read (#9704)
  • [Feature][Connector-File-Hadoop]Support multi table sink feature for HdfsFile (#9651)
  • [Feature][connector-hive] hive sink connector support overwrite mode #7843 (#7891)
  • [Feature][connector-kudu] implement the filter (#9405)
  • [Feature][connector-paimon] Paimon connector supports paimon privilege (#9722)
  • [Feature][connector-tdengine] Support subtable and fieldNames in tdengine source (#9593)
  • [Feature][connector-v2] Add Sensorsdata Connector Support #9323 (#9432)
  • [Feature][Connector-V2] Jdbc mysql support read tinyint(1) to byte(tinyint) (#9373)
  • [Feature][Connector-V2] Support databend source/sink connector (#9331)
  • [Feature][Connector-V2] Support like predicate pushdown in paimon (#9484)
  • [Feature][Connector-v2] Support multi paimon source (#9759)
  • [Feature][Connector-V2][JDBC] Add presto/trino dialect (#9388)
  • [Feature][Connectors-v2] Optimize the size of CDC JAR Files (#9546)
  • [Feature][Connectors-v2] Support auto-increment id for FakeSource (#9505)
  • [feature][connectors-v2] Support in predicate pushdown in paimon (#9379)
  • [Feature][Connectors-v2] Support Mysql8.4+ for mysql-cdc (#9720)
  • [Feature][Connectors-V2][Elasticsearch] Support vector transformation sink (#9330)
  • [Feature][Connectors-v2]Paimon version upgrade to 1.1.1 (#8074)
  • [Feature][Core] Add plugin directory support for each connector (#9650)
  • [Feature][Core] Support show cluster members information in seatunnel-cluster scripts (#9502)
  • [Feature][elasticsearch-connector] Add API key authentication support (#9610)
  • [Feature][Format] Improve maxwell_json,canal_json,debezium_json format add ts_ms and table (#9701)
  • [Feature][Jdbc] Support read multiple tables by regular expressions (#9380)
  • [Feature][MySQL CDC] MySQL cdc support start by time (#9735)
  • [Feature][Redis] Add redis key into the result record (#9574)
  • [Feature][Sink] File support new format: maxwell_json,canal_json,debezium_json (#9278) (#9336)
  • [Feature][SQL function] Enhance SQL Transform COALESCE functions to support type cast (#9299)
  • [Feature][SQL Transform] Check SQL Cast will fail or not during the SQL parsing stage (#9600)
  • [Feature][Transform-V2] Add TRIM_SCALE function for sql transform (#9700)
  • [Feature][transform-v2] Data Validator Transform support (#9445)
  • [Feature][transform-v2] sql transform support multi_if function (#9154)
  • [Feature][Transform-V2] Support jsonpath extracting multiple fields in a configuration block (#9712)
  • [Feature][Transform-V2] Support vector series sql function (#9765)
  • [Feature][Transform] Add Murmur64 function to obtain the lower 64 bit (#9748)
  • [Feature][Transform] Support single/batch mode vectorization using Amazon Titan & cohere embedding model (#9120)
  • [Feature][TransForms-V2] Support scala dynamic compile (#9625)
  • [Feature][Transform V2] Add vector dimension reduction transform (#9783)
  • [Feature][Zeta] Add metrics for task intermediate queue size (#9550)
  • [Feature][Zeta] Add startTime to the job info (#9400)
  • [Feature][Zeta] extended jobStateEvent event listening for zeta (#9689)
  • [Feature][Zeta] Support SQL format in REST API (#9802)
  • [improve] jdbc options (#9541)
  • [Improve] JdbcInputFormat nextRecord Exception throw TableId (#9374)
  • [improve] pulsar options (#9180)
  • [improve] rocketmq options (#9251)
  • [imp...
Read more
Loading

2.3.11 Release

27 May 01:22
@zhangshenghang zhangshenghang
2.3.11
a923c36

Choose a tag to compare

View all tags
2.3.11 Release

2.3.11 Release Note

Docs

  • [Doc][Improve] support chinese [docs/zh/connector-v2/source/MySQL-CDC.md] (#8884)
  • Add MongoDB-CDC connector Chinese documentation (#9337)
  • [Doc][zh-CN] Add HiveJdbc connector Chinese documentation (#8497) (#9329)
  • [Doc][Connector-V2] Update save mode config for OssFileSink (#9303)
  • [Doc][zh-CN] Add Jira connector Chinese documentation (#9236)
  • [Doc][Improve] support chinese [docs/zh/connector-v2/source/Cloudberry.md] (#9211)
  • [Fix][Doc] Delete space before _test and _sink (#9216)
  • [Doc][Improve] support chinese [docs/zh/connector-v2/source/Github.md] (#9210)
  • [Feature][doc] Repair md document format (#9177)
  • [Fix][Doc] Adjust the description of the explode function (#9168)
  • [Improve][Doc] Unify the header format and fix some documents with abnormal formats (#9159)
  • [Improve][Doc] Adjust description of trim series sql function (#9143)
  • [Improve][Doc] Update kerberos part of kafka doc (#9031)
  • [Doc] Update changelog (#9071)
  • [Doc] Fix classloader-cache-mode default value
  • [Doc][Fix] DB2.md fix markdown formatting in Data Type Mapping (#9062)
  • [Doc] fix deadlinks (#9053)
  • [Improve][Doc] Improve changelog generate tool to ignore useless commit (#9035)
  • [Fix][Doc] fix deadlinks (#9016)

Bug Fix

  • [Bug][Zeta] SeaTunnelClient can not exit with error (#9281)
  • [Improve][Oracle-CDC] Fix oracle rename ddl event missing column type (#9314)
  • [Fix][Connector-jdbc] Fix postgresql sink trying to update unique key (#9293) (#9298)
  • [Fix][Zeta] Fix losing checkpoint scheduling in extreme cases (#9246)
  • [Fix][Connector-V2] Fix hive client thread unsafe (#9282)
  • [Fix][Connector-V2] Fix oceanbase mysql jdbc sink create statement error (#9267)
  • [Fix][CI] Fix update build status action error (#9300)
  • [Fix][CI] Disable dead link check (#9296)
  • [Fix][CI] Set continue-on-error to true for dead link job (#9290)
  • [Fix][Connector-V2] Fix the problem that missing options configuration when building ClickHouse Nodes (#9277)
  • [Fix][CI] Remove dead link check from sanity check (#9274)
  • [fix][connector-mango] fix split with avgSize zero error (#9255)
  • [Bugfix][Starrocks] Fix starrocks batch data exceeds the maximum limit (#9256)
  • [Fix][Config] Fix invalid telemetry-log config in seatunnel.yaml (#9230)
  • [Improve][connector-iceberg] fix schema change event (#9217)
  • [Fix][Zeta] Fix premature closure of the checkpoint thread pool causes abnormal task status (#9228)
  • [Bugfix][CI] Fix transform check (#9237)
  • [Bugifx][kafka] Fix kafka enumerator assign split NPE (#9220)
  • [Fix][CI] Release file resources in testcase (#9232)
  • [Fix][Core]Fix config parse with "" error (#9225)
  • [Fix][Connector-V2] Fix kafka database name (#9201)
  • [Fix][Serialize] prevent scientific notation for decimal numbers in JSON output​ (#9186)
  • [Fix][Zeta] Fix double-checked locking without volatile in HdfsStorage (#9200)
  • [Fix][connector-file-base] fix parquet int32 convert error (#9142)
  • [Fix][CI] Upgrade action job runner host version (#9185)
  • [Fix][API] Fixed not invoke the SinkAggregatedCommitter's init method (#9070)
  • [Fix][Connector-V2] Fix NullPointerException when column or tag contains null value in TDengine sink (#9158)
  • [Bugfix][Csv] Fix csv format delimiter (#9066)
  • [Fix][Zeta] Adjust the timing of invoking the enumerator open method (#9092)
  • [Fix][Connector-V2] Fix postgres cdc with debezium_json format can not parse number without scale (#9052)
  • [Fix][Connector-V2] Fix maxcompute write with multi parallelism (#9089)
  • [Fix][MongoDB] The Long type cannot handle string values in scientific notation (#8783)
  • [Bugfix][Elasticsearch] Fix add column event (#9069)
  • [Fix][Connector-V2] Fix SqlServer create table when database with dot (#9007)
  • [Fix] Fix DateUtils can not parse datetime string with local timezone (#9019)
  • [Fix][Connector-V2] Fixed missing timestamp accuracy of starrocks connector (#9096)
  • [Fix][Connector-V2][OceanBase] oceanbase vector support simple vector index (#9072)
  • [Fix][JDBC] fix jdbc default connection parameter invalid (#8185)
  • [Improve][Checkpoint] Use fixed serialVersionUID in sink state class (#9079)
  • [Fix][Connector-V2] assign size for KafkaSource reader cache queue (#9041)
  • [Fix][Connector-Redis] Redis did not write successfully, but the task did not fail (#9055)
  • [Hotfix][Jdbc] Fix mysql tinyint(1) type mapping for TypeMapper (#9012)
  • [Fix][Core] Cancel pending job (#8993)
  • [Fix][Paimon] nullable and comment attribute was lost during automatic table creation (#9020)
  • [Fix][Connector-JDBC] Fix JDBC driver selection for data source connections (#8986)
  • [Fix] Fix dead link (#9023)
  • [Fix][Connector-V2] Fix maxcompute sink write date less than actual date (#8999)

Feature

  • [Feature][http-Sink] Implementing http batch writes (#9292)
  • [Feature][Connectors-V2] Add end_timestamp for timstamp start mode (#9318)
  • [Feature][Connector-doris] Adds case insensitivity feature (#9306)
  • [Feature][Connector-V2] Iceberg add glue catalog support (#9247)
  • [Improve][Connector-V2] Add remote host verification option for FTP data channels (#9324)
  • [improve] EasySearch support schema_save_mode/data_save_mode (#9310)
  • [Feature][Connector-JDBC] Supprot read Oracle BLOB data as string instead of bytes (#9305)
  • [Improve] Optimize variable handling robustness in stop-seatunnel-cluster.sh (#9316)
  • [Improve] Remove useless iceberg sink config iceberg.table.config (#9307)
  • [Feature][Connector-V2] Support multi-table sink feature for ClickHouse (#9301)
  • [Improve] Remove release-note.md in dev branch (#9304)
  • [improve] sentry options (#9261)
  • [improve] sls options (#9260)
  • [Feature][connector-http] Parameters support placeholder replacement (#9184)
  • [Improve][Starrocks] Catch lable already exception (#9222)
  • [improve] neo4j options (#9164)
  • [Improve][Zeta] Add log to print the each task execute location (#9205)
  • [improve] qdrant options (#9235)
  • [Feature][Connector-V2] Make some sink parameters optional for DataHub (#9229)
  • [Feature][Transform] Add table filter transform (#9189)
  • [improve] openmldb options (#9166)
  • [Feature][Connector-V2] Support multi-table sink feature for TDengine (#9215)
  • [Feature][Connector-V2] Datahub support multi-table sink (#9212)
  • [Feature][Transform] Support define sink column type (#9114)
  • [Feature][Transform] support boolean type for sql transform (#9136)
  • [Feat][Connector-v2][Iceberg]support filter conditions in iceberg source (#9095)
  • [Feature][Checkpoint] Add check script for source/sink state class serialVersionUID missing (#9118)
  • [Feature][Zeta] Support basic authentication for web ui (#9171)
  • [Feature][connector-elasticsearch] elasticsearch source support PIT (#9150)
  • [Improve][Connector-V2][Http] Supports Cursor-based Pagination (#9109) (#9138)
  • [Feature][Connector-V2] Support GraphQL Connector (#8557) (#9021)
  • [Improve] maxcompute options (#9163)
  • [Improve] kudu options (#9162)
  • [improve] paimon options (#9167)
  • [improve] milvus options (#9165)
  • [Feature][Zeta] Format exception messages on task running management page (#9147)
  • [Improve][connector-doris] Improved doris source enumerator splits allocation algorithm for subtasks (#9108)
  • [Improve][Zeta] Support restore execute savemode (#9059)
  • [improve] update file connectors config (#9034)
  • [Improve][seatunnel-engine-ui] improve sorting of Running Jobs and Finished Jobs (#9107)
  • [Improve][Connector-V2] Optimize dialect selection in jdbc (#8820)
  • [Improve][Transform-V2] support try_cast expressions (#9029)
  • [Improve][Transform] Update MetadataTransformConfig extends (#9082)
  • [Chore] Upgrade actions/cache@v2 to actions/cache@v4 (#9084)
  • [Improve][Sql] Support boolean fields in case-when condition clauses (#9073)
  • [Feature][File] Support extract CSV files with different columns in different order (#9064)
  • [Feature][Zeta] Support enable https protocol for rest-api v2 (#9010)
  • [Feature] Version from 2.3.10 to 2.3.11 (#9058)
  • [Improve] Refactor file enumerator to prevent duplicate put split (#8989)
  • [Feature][Jdbc] Add String type column split Support by charset-based splitting algorithm (#9002)
  • [Feature][Connector-V2] Add aerospike sink connector (#8821)
  • [Feature][E2E] Add helm test case (#9006)
  • [Feature][Connector] Add Apache Cloudberry Support (#8985)
  • [Improve][File] Add row_delimiter options into text file sink (#9017)
  • [Improve][Zeta] Remove misleading exception log when job be canceled (#8988)
  • [Improve][Jdbc] Upgrade sap-hana driver from 2.14.7 to 2.23.10 (#9013)
Loading

2.3.10 Release

26 Mar 12:42
@zhangshenghang zhangshenghang
2.3.10
5c8a4c0

Choose a tag to compare

View all tags
2.3.10 Release

2.3.10 Release Note

Feature

  • [improve] update localfile connector config (#8765)
  • [Improve][Zeta] Check closing log file handle every 1 minute (#9003)
  • Revert " [improve] update localfile connector config" (#9018)
  • [improve] update Web3j connector config option (#9005)
  • [Improve] influxdb options (#8966)
  • [improve] http connector options (#8969)
  • [improve] iotdb options (#8965)
  • [improve] email connector options (#8983)
  • [Feature][Jdbc] Support sink ddl for sqlserver #8114 (#8936)
  • [Improve] iceberg options (#8967)
  • [Improve] Update label-scope-conf.yml for core label (#8979)
  • [Improve][Core] Support parse quote as key (#8975)
  • [Improve][deploy] helm chart config improve (#8954)
  • [Feature][Connector-V2] Support between predicate pushdown in paimon (#8962)
  • [Improve][Connector-V2] Ensure that the FTP connector behaves reliably during directory operation (#8959)
  • [Improve] easysearch options (#8951)
  • [Feature][elasticsearch-connector] support elasticsearch sql source (#8895)
  • [Improve][Connector-V2] RocketMQ Source add message tag config (#8825)
  • [improve] hudi options (#8952)
  • [Improve][Shade] Unit the module name of Shade. (#8960)
  • [Feature][Connector-V2] Suppor Time type in paimon connector (#8880)
  • [improve] fake source options (#8950)
  • [Improve] hbase options (#8923)
  • [Improve][CDC] Filter ddl for snapshot phase (#8911)
  • [Improve][Oracle-CDC] Support ReadOnlyLogWriterFlushStrategy (#8912)
  • [improve] google sheets options (#8922)
  • [Improve][Connector-V2] Random pick the starrocks fe address which can be connected (#8898)
  • [Improve][E2E][Connector V2][CDC Oracle] OracleContainer support ARM architecture images (#8928)
  • [Improve] filestore options (#8921)
  • [improve] improve TaskLocation/TaskLocationGroup info (#8862)
  • [Improve][CDC] Extract duplicate code (#8906)
  • [Feature][Paimon] Customize the hadoop user (#8888)
  • [Improve][connector-file-base] Improved multiple table file source allocation algorithm for subtasks (#8878)
  • [Improve][connector-hive] Improved hive file allocation algorithm for subtasks (#8876)
  • [Improve] sink mongodb schema is not required (#8887)
  • [Feature][Connector-v2] Support multi starrocks source (#8789)
  • [Feature][Kafka] Support native format read/write kafka record (#8724)
  • [Improve][Redis] Optimized Redis connection params (#8841)
  • [Improve][CDC] Filter heartbeat event (#8569)
  • [Improve][Jdbc] Support upsert for opengauss (#8627)
  • [Improve][Zeta] Split classloader in job master (#8622)
  • [Feature][Connector-V2] Add parameter for read/write file (#8769)
  • [Improve] doris options (#8745)
  • [Feature][Transform-v2] Add support for Zhipu AI in Embedding and LLM module (#8790)
  • [Improve][Jdbc] Remove useless utils. (#8793)
  • [improve] update clickhouse connector config option (#8755)
  • [Feature][Config] Support custom config keys for encrypt/decrypt (#8739)
  • [Improve] rabbit mq options (#8740)
  • [Improve] re-struct Zeta Engine config options (#8741)
  • [Improve][Zeta] Disable restful api v1 by default (#8766)
  • [improve] update kafka source default schema from content<ROW> to content (#8642)
  • [Feature][Transforms-V2] Handling LLM non-standard format responses (#8551)
  • [improve] console sink options (#8743)
  • [Improve][Connector-V2] Improve orc read error message (#8751)
  • [Improve][connector][activemq] Remove duplicate dependencies (#8753)
  • [Improve][Jdbc] Improve catalog connection cache (#8626)
  • [improve] datahub sink options (#8744)
  • [improve] dingtalk sink options (#8742)
  • [improve] Slack connector options (#8738)
  • [Improve][Connector-V2] Add optional flag for rocketmq connector to skip parse errors instead of failing (#8737)
  • [Improve][Connector-v2][Paimon]PaimonCatalog close error message update (#8640)
  • [Feature][Jdbc] Support sink ddl for dameng (#8380)
  • [Improve] restruct connector common options (#8634)
  • [improve] add StarRocks options (#8639)
  • [improve] update Redis connector config option (#8631)
  • [improve] add assert options (#8620)
  • [Improve][e2e] Remove duplicate dependencies (#8628)
  • [improve] update S3File connector config option (#8615)
  • [Feature][Connector-V2] Support maxcompute source with multi-table (#8582)
  • [improve] add Elasticsearch options (#8623)
  • [improve] update amazondynamodb connector (#8601)
  • [improve] amazon sqs connector update (#8602)
  • [improve] update activemq connector config option (#8580)
  • [Feature][transform-v2] jsonpath support map array type (#8577)
  • [improve] cassandra connector options (#8608)
  • [improve] kafka connector options (#8616)
  • [improve] update Druid connector config option (#8594)
  • [Refactor][core] Unify transformFactory creation logic (#8574)
  • [improve] add connector options class exist check (#8600)
  • [Feature][Core] Add slot allocation strategy (#8233)
  • [Improve] Update snapshot version to 2.3.10 (#8578)
  • [Improve][Jdbc] Remove oracle 'v' query (#8571)
  • [feature][core] Unified engine initialization connector logic (#8536)
  • [Feature][Iceberg] Support read multi-table (#8524)
  • [Feature] [Postgre CDC]support array type (#8560)
  • [Feature][Connector-V2] Support create emtpy file when no data (#8543)
  • [config][enhance]support use properties when encrypt/decrypt config (#8527)
  • [Improve][Connector-v2] add starrocks comment test (#8545)
  • [Feature][Transform-V2] llm add deepseek (#8544)
  • [Feature][Connector-V2] Support single file mode in file sink (#8518)
  • [Improve][Connector-V2] MaxComputeSink support create partition in savemode (#8474)

Bug Fix

  • [Fix][Connector-V2] Fix load state check in MilvusSourceReader to consider partition-level status (#8937)
  • [Fix][File]use common-csv to read csv file (#8919)
  • [Fix][CI] Ignore dead link check for change log commit url (#9001)
  • [Fix][Connector-V2] Fix StarRocksCatalogTest#testCatalog() NPE (#8987)
  • [Improve] Update nodejs version to fix ci (#8991)
  • [Fix][Command] Run seatunnel on windows with fileAppender enabled, no log file been created (#8938)
  • [Fix][Connector-V2] Fix maxcompute read with partition spec (#8896)
  • [Fix] [Mongo-cdc] Fallback to timestamp startup mode when resume token has expired (#8754)
  • [Fix][Connector-V2] Fix text file read separator issue (#8970)
  • [hotfix][redis] fix npe cause by null host parameter (#8881)
  • [Fix][CI] Update known-dependencies.txt to fix ci (#8947)
  • [Fix] [Clickhouse] Parallelism makes data duplicate (#8916)
  • [Fix][Connector-V2] Fixed incorrectly setting s3 key in some cases (#8885)
  • [Fix]update reload4j version to 1.7.36 (#8883)
  • [Fix][chore] Fix --role parameter not working in seatunnel-cluster.cmd (#8877)
  • [Fix][Connector-V2] Fix MaxCompute cannot get project and tableName when use schema (#8865)
  • [Fix][Connector-File] Fix conflicting requirement (#8823)
  • [Fix][Connector-V2] Fix parse SqlServer JDBC Url error (#8784)
  • [Fix][Plugin] Optimize the plugin discovery mechanism (#8603)
  • [Fix] Fix error log name for SourceSplitEnumerator implements class (#8817)
  • [Fix][connector-http] fix when post have param (#8434)
  • [Bugfix] Fix ClassCastException of ExceptionUtil (#8776)
  • [Fix][Connector-V2] Fix possible data loss in scenarios of request_tablet_size is less than the number of BUCKETS (#8768)
  • [Fix][Connector-V2]Fix Descriptions for CUSTOM_SQL in Connector (#8778)
  • [Fix][E2e] Optimized pom file name tag (#8770)
  • [Fix][Connector-v2] Add DateMilliConvertor to Convert DateMilliVector into Default Timezone (#8736)
  • [Fix][Transform] Fix FieldMapper transform lost field constraint information (#8697)
  • [Bugfix][Canal] Fix canal serialization to json (#8695)
  • [Fix][Connector-V2] Fix jdbc sink statement buffer wrong time to clear (#8653)
  • [Fix][Connector-V2] Fix file reading cannot read empty strings (#8646)
  • [Fix][Connector-v2][DorisIT]Fix the problem that DorisIT cannot run local (#8630)
  • [Fix][transform-v2]LLM transform provider switch case miss break (#8643)
  • [Fix][transform-v2]SQL transform support max/min function (#8625)
  • [Fix][MySQL-CDC]fix recovery task failure caused by binlog deletion (#8587)
  • [Fix][mysql-cdc] Fix GTIDs on startup to correctly recover from checkpoint (#8528)
  • [Fix][Connector-V2] User selects csv string pattern (#8572)
  • [Fix][doris-e2e] Fix flaky Doris e2e tests (#8596)
  • [Fix][Connector-Mongodb] close MongodbClient when close MongodbReader (#8592)
  • [Bugfix][example] Fixing spark test cases (#8589)
  • [Fix][Connector-V2] fix starRocks automatically creates tables with comment (#8568)
  • [Fix][Connector-V2] Fix CSV String type write type (#8499)
  • [Hotfix][Connector-V2][SFTP] Add quote to sftp file names with wildcard characters (#8501)
  • [Fix][connector-elasticsearch] support elasticsearch nest type && spark with Array (#8492)
  • [Fix] [Connector-V2] Postgres support for multiple primary keys (#8526)
  • [Fix][File] Fix Multi-file with binary format synchronization failed (#8546)
  • [Fix] Update zh table-merge.md (#8535)
  • [Fix] Update table-merge.md (#8532)
  • [Fix][Connector-V2] Fixed adding table comments (#8514)
  • [Fix] [Kafka Source] kafka source use topic as table name instead of fullName (#8401)
  • [Fix][Hive] Writing parquet files supports the optional timestamp int96 (#8509)

Docs

  • [Improve][Doc] Added automatically generate connector commit history documents (#8948)
  • [Fix][Doc] s3 file doc mismatch with code (#8926)
  • [Doc][Improve] translate FtpFile related chinese document (#8944)
  • [Fix][Doc] Fixed the parameter error in the JDBC doc (#8943)
  • [Doc] Fix example error (#8905)
  • [Doc][FTP] Fix the dead link of ftp doc. (#8860)
  • [Doc][Improve] support chinese [docs/zh/connector-v2/source/CosFile.md] (#8826)
  • [Doc][Improve] support chinese [docs/zh/connector-v2/source/Clickhouse.md] (#8824)
  • [Doc][Improve] support chinese [docs/zh/connector-v2/sink/ObsFile.md] (#8827)
  • [Doc][Improve] support chinese [docs/zh/connecto...
Read more
Loading

2.3.9 Release

19 Jan 15:20
@TyrantLucifer TyrantLucifer
2.3.9
074a02e

Choose a tag to compare

View all tags
2.3.9 Release

2.3.9 Release Note

Bug fix

  • [Bug][Avro] Fix avro miss convert short type to int (#8459)
  • [Bug][CI] Fix all-connectors and update-modules run simultaneously (#8343)
  • [Bug] [connector-file] When the data source field is less than the target (Hive) field，it will throw null pointer exception#8150 (#8200)
  • [Bug][connectors-v2] fix mongodb bson convert exception (#8044)
  • [Bug] [connectors-v2] The Hadoop Source/Sink fails with Unable to find valid Kerberos Ticket. (#7809)
  • [Bug][Connector-v2] MongoDB CDC Set SeatunnelRow's tableId (#7935)
  • [Bug][Core] Local mode cancel running JobStatusRunner (#7943)
  • [bugfix][core] Fix the problem of incorrect association between metrics and nodes (#7799)
  • [BUG] Fixed avro format support for storing null (#8424)
  • [BugFix][Excel] Fix read formulas/number cell value of excel (#8316)
  • [Bug][Kafka] kafka reads repeatedly (#8465)
  • [Fix][API] Fix column length can not be long (#8039)
  • [Fix][CI] Fix ci dependency check error (#8262)
  • [Fix][CI] Fix CI error caused by set classloader-cache-mode to true (#7940)
  • [Fix][CI] Fix schedule test be canceled (#8024)
  • [Fix][CI] time-consuming module optimization (#8052)
  • [Fix][Connecotr-V2] Fix clickhouse sink does not support composite primary key (#8021)
  • [Fix][Connector-starrocks] Fix drop column bug for starrocks (#8216)
  • [Fix][Connector][TDEngine] TDEngine support NCHAR type (#8411)
  • [fix][connector-v2][connector-assert] Optimize Assert Sink verification method (#8356)
  • [Fix][Connector-V2][connector-file-base-hadoop] Fixed HdfsFile source load the krb5_path configuration (#7870)
  • [Fix][Connector-V2] Fix AbstractSingleSplitReader lock useless when do checkpoint (#7764)
  • [Fix][Connector-V2] Fix cdc use default value when value is null (#7950)
  • [Fix][Connector-V2] Fixed clickhouse connectors cannot stop under multiple parallelism (#7921)
  • [Fix][Connector-V2] Fix file binary format sync convert directory to file (#7942)
  • [Fix][Connector-V2] Fix hana type loss of precision (#7912)
  • [Fix][Connector-V2] Fix hive krb5 path not work (#8228)
  • [Fix][Connector-V2] Fix kafka format_error_handle_way not work (#7838)
  • [Fix][connector-v2]Fix Paimon table connector Error log information. (#7873)
  • [Fix][Connector-V2] Fix When reading Excel data, string and date type conversion errors (#7796)
  • [Fix][Connector-V2][FTP] Fix FTP connector connection_mode is not effective (#7865)
  • [Fix][Connector-V2]Oceanbase vector database is added as the source server (#7832)
  • [fix][docker] update Dockerfile (#8421)
  • [Fix][Docker] Workflow "push-docker" failed run with error "No space left on device" (#8339)
  • [Fix][Doris] Fix catalog not closed (#8415)
  • [fix] fix get job metrics get NPE (#8093)
  • [Fix][Flink] Fix NPE when get null row from upstream transform (#8469)
  • [Fix] [Flink/Spark] Fix transform stream choose wrong when not configure source_table_name (#7907)
  • [Fix][Kafka] Fix in kafka streaming mode can not read incremental data (#7871)
  • [fix][log]Fix log returns interface issue and adds test code (#8387)
  • [fix] move docker build plugin into dist module (#8338)
  • [Fix] Set all snappy dependency use one version (#8423)
  • fix transforms-v2 nlpmodel typo (#8430)
  • [Fix][Zeta] Fix apply resource again for another pipeline when restore one pipeline (#7965)
  • [Fix][Zeta] Fix job client print error msg even job finished (#7981)
  • [Fix][Zeta] Fix worker node metrics acquisition (#7862)
  • [Fix][Zeta] Introduce SeaTunnel CompletableFuture to prevent ForkJoinPool thread shortage (#8445)
  • [Fix][Zeta] Remove duplicate LIFECYCLE_WRITER_CLOSE events (#7984)
  • [Fix][Zeta] Set AsyncLogger.ThreadNameStrategy=UNCACHED to avoid thread name cache (#8215)
  • [Hotfix][CDC] Fix occasional database connection leak when read snapshot split (#7918)
  • [Hotfix][Config] Fix configuration key sort disorder (#7893)
  • [hotfix] [connector-cdc-oracle ] support read partition table (#8265)
  • [hotfix][connector-elasticsearch-sink] Convert index to lowercase (#8429)
  • [hotfix][connector-v2][hive]Fix hive3 e2e dependencies (#8045)
  • [Hotfix][Connector-V2][kafka] fix kafka sink config exactly-once exception (#7857)
  • [Hotfix][Core][Flink] SeaTunnel flink engine support application mode on yarn (#7762)
  • [Hotfix][Docs]Correct errors in the FAQ doc (#8048)
  • [Hotfix][E2E] Fix OracleCDCIT compile error (#8023)
  • [HotFix]Fix Dead Link In ObsFile.md (#8251)
  • [hotfix] fix exceptions caused by operator priority in connector-clickhouse when using sharding_key (#8162)
  • [Hotfix] Fix redis sink NPE (#8171)
  • [hotfix][gbase] Fix gbase driver link (#8110)
  • [Hotfix][Transform][Sql] function concat_ws handle array type， avoid write [Ljava.lang.String. (#8369)
  • [Hotfix][Transforms-v2] DynamicCompile Plugin compatibility fix (#8057)
  • [Hotfix][Zeta] Fix the dependency conflict between the guava in hadoop-aws and hive-exec (#7986)
  • [Hotfix][Zeta][Log] Fix zeta parallelStream log trace for job (#8456)

Docs

  • [Chore] delete chinese desc in code (#8306)
  • [Core][Flink] Resolve streaming source high CPU usage (#8354)
  • [doc][connector][hive] Add hive chinese doc (#8169)
  • [Doc][Format] Add protobuf doc (#7989)
  • [Doc][hive] Rename result_table_name to plugin_output in hive doc (#8203)
  • [Docs] [Elasticsearch] fix the doc about index name replacement (#8392)
  • [Doc][Transform-v2] Update doc for Array function (#8419)
  • [Fix][Doc] Correct hive-jdbc config useKerberos to use_kerberos (#7896)
  • [Fix][Doc] fix backup-count config (#8147)
  • [Fix][Doc] fix doc tip style and add document format specification (#8378)
  • [Fix][Doc] Fixed unreachable links (#8131)
  • [Fix][Doc] Fixing errors in the documentation and adding information (#8353)
  • [Fix][Doc] Fix jetty doc error (#7883)
  • [Fix][Doc] Fix key description error in redis zh doc (#7993)
  • [Fix][Doc] Fix klaviyo doc 404 link (#7969)
  • [Fix][Doc] Fix outdated plugin path in oracle documentation (#8403)
  • [Fix][Doc] Fix rest-api missing content (#8384)
  • [Fix][Doc] Fix wrong link in about/index.html (#8486)
  • [Fix][Doc] Fix zh doc build error (#7882)
  • [Fix][Doc] Modify error name SEATNUNNEL to SEATUNNEL (#8257)
  • [Fix][Doc] Modify the example of enable-dynamic-port in the documentation. (#8331)
  • [Fix][docs] fix wrong config in setup.md (#8483)
  • [Fix][Doc] Update Elasticsearch Sink and Oracle CDC Source Sample Configuration (#8425)
  • [Improve][doc] Add doc name check (#8140)
  • [Improve][Doc] Add enable_header_write parameter in File doc (#8397)
  • [Improve][Doc] Add file_filter_pattern example to doc (#7922)
  • [Improve][Doc] Add some connector icons (#7944)
  • [Improve][Doc] Add the way of configure jvm options in client (#8091)
  • [Improve][Doc] Correcting typo errors in logging (#7874)
  • [Improve][Doc] Correction to docker doc for get container ip (#7801)
  • [Improve][Doc] Fix chinese doc miss grafana dashborad config (#7955)
  • [Improve][Doc] Improve the connector-v2 develop doc (#8190)
  • [Improve][Doc] Move seatunnel engine deployment doc (#8239)
  • [Improve][Docs] Add driver reference to doris/starrocks docs (#8414)
  • [Improve][Docs] Edit the description about startup.mode for Opengauss-CDC (#7815)
  • [Improve][Doc] Update connector v2 contribute guide (#8375)
  • [Improve][Doc] Updated telemetry doc (#7827)

Feature

  • [Feature][API] Support timestamp with timezone offset (#8367)
  • [Feature][CDC] Add 'schema-changes.enabled' options (#8252)
  • [Feature][CDC] Add 'schema-changes.enabled' options (#8285)
  • [Feature]Check Chinese comments in the code (#8319)
  • [Feature][ClickhouseFile] Support add publicKey to identity (#8351)
  • [Feature][Clickhouse] Support sink savemode (#8086)
  • [Feature][connector-elasticsearch] elasticsearch support nested type (#8462)
  • [Feature] [connector-milvus] update milvus connector to support dynamic schema, failed retry, etc. (#7885)
  • [Feature] [Connector-Redis] Redis connector support delete data (#7994)
  • [Feature][Connectors] LocalFile Support reading gz (#8025)
  • [Feature][Connector-V2] Add prometheus source and sink (#7265)
  • [Feature][Connector-V2[Doris]Support sink ddl (#8250)
  • [Feature][Connector-V2]Ftp file source support multiple table (#7795)
  • [Feature][Connector-V2]Jdbc chunk split add snapshotSplitColumn config #7794 (#7840)
  • [Feature][Connector-V2] Jdbc DB2 support upsert SQL (#7879)
  • [Feature][Connector-V2] Piamon Sink supports changelog-procuder is lookup and full-compaction mode (#7834)
  • [Feature][Connector-V2]Sftp file source support multiple table (#7824)
  • [Feature][Connector-V2] Starrocks implements multi table sink (#8467)
  • [Feature][Connector-V2] StarRocks-sink support schema evolution (#8082)
  • [Feature][Connector-V2]Support Doris Fe Node HA (#8311)
  • [Feature][Connector-V2] Support MaxCompute save mode (#8277)
  • [Feature][connector-v2]Support opengauss jdbc connnector using opengauss driver. (#7622)
  • [Feature][Connector-v2] Support S3 filesystem of paimon connector (#8036)
  • [Feature][Connector-v2] Support schema evolution for Oracle connector (#7908)
  • [Feature][Connector-v2] Support schema evolution for paimon sink (#8211)
  • [Feature][Connector-V2] Support the jdbc connector for highgo db (#8282)
  • [Feature][Connector-V2] Support use EasyExcel as read excel engine (#8064)
  • [Feature][Connector-V2] Support write cdc changelog event into hudi sink (#7845)
  • [Feature][Core] Rename result_table_name/source_table_name to plugin_input/plugin_output (#8072)
  • [Feature][Core] Support cdc task ddl restore for zeta (#7463)
  • [Feature][Core] Support read arrow data (#8137)
  • [Feature][Doc]Paimon Souce changelog update (#8187)
  • [Feature][Doris] Support multi-table source read (#7895)
  • [Feature][E2E] Add E2E test case time analysis (#8028)
  • [Feature][E2E] Add hive3 ...
Read more
Loading

2.3.8 Release

14 Oct 01:56
@liunaijie liunaijie
2.3.8
8604631

Choose a tag to compare

View all tags
2.3.8 Release

2.3.8 Release Note

Bug fix

Core

  • [Hotfix][Core] Fix concurrency exceptions when MultiTableSink#PrepareCommit (#7686)
  • [hotfix][zeta] conf property is null, print log bug fix (#7487)
  • [Fix][Seatunnel-core]Fix syntax error in the execution script on Windows (#7423)

Connectors

  • [Fix][Connecotr-V2] Fix paimon dynamic bucket tale in primary key is not first (#7728)
  • [Fix][Connector-V2] Fix iceberg throw java: package sun.security.krb5 does not exist when use jdk 11 (#7734)
  • [Fix][Connector-V2] Release resources when task is closed for iceberg sinkwriter (#7729)
  • [Fix][Connector-V2] Release resources even the task is crashed for paimon sink (#7726)
  • [Fix][Connector-V2] Fix paimon e2e error (#7721)
  • [Fix][Connector-V2] Fix known directory create and delete ignore issues (#7700)
  • [Fix][Connector-V2] Fixed iceberg sink can not handle uppercase fields (#7660)
  • [Hotfix][CDC] Fix ddl duplicate execution error when config multi_table_sink_replica (#7634)
  • [Fix][Connector-V2] Fix some throwable error not be caught (#7657)
  • [Fix][Connector-V2] Fix jdbc test case failed (#7690)
  • [Fix][Connector-v2] Throw Exception in sql query for JdbcCatalog in table or db exists query (#7651)
  • [Fix][JDBC] Fix starrocks jdbc dialect catalog conflict with starrocks connector (#7578)
  • [bugfix] fix oracle query table length (#7627)
  • [Hotfix] Fix iceberg missing column comment when savemode create table (#7608)
  • [Hotfix][Seatunnel-common] Fix the CommonError msg for paimon sink (#7591)
  • [Hotfix][Connector-v2] Fix the ClassCastException for connector-mongodb (#7586)
  • [Hotfix][Connector-v2] Fix the NullPointerException for jdbc oracle which used the table_list (#7544)
  • [Bug][e2e][jdbc-gbase] The gbase driver address certificate expired (#7531)
  • [Hotfix][Connector-V2] Fixed lost data precision for decimal data types (#7527)
  • [Fix][Connector-V2] Fix jdbc query sql can not get table path (#7484)
  • [Hotfix][Connector-V2] Fix null not inserted in es (#7493)
  • [Fixbug] doris custom sql work (#7464)
  • [Fix] Fix oracle sample data from column error (#7340)
  • [Hotifx][Jdbc] Fix MySQL unsupport 'ZEROFILL' column type (#7407)
  • [Hotfix][CDC] Fix package name spelling mistake (#7415)
  • [Hotfix][Zeta] Fix hazelcast client should overwrite cluster address by system env (#7790)

Zeta(ST-Engine)

  • [Core][Zeta] If Zeta not a TCP discovery, it cannot find other members (#7757)
  • [Fix][Zeta] Fix resource isolation not working on multi node (#7471)

Transformer

  • [Bug][Transforms-V2] Fix LLM transform can not parse boolean value type (#7620)

CI

  • [Fix][CI] Fix CI loss document check when raise PR (#7749)
  • [Hotfix][ci] Fix github ci License header error (#7738)
  • [Fix][CI] Add doc sync to fix ci error (#7720)
  • [hotfix] fix FixSlotResourceTest unstable issue (#7577)
  • [Fix][e2e] remote loading driver ignores the certificate to avoid certificate address expiration (#7547)
  • [Fix] Fix document build error (#7546)
  • [Fix][doc] fix dead link (#7508)
  • [Fix] update paimon.apache.org deadlink (#7504)
  • [Hotfix][Metrics] fix sporadic multi-metrics ci (#7468)
  • [Fix] Fix dead link on seatunnel connectors list url (#7453)
  • [FIX][E2E]Modify the OceanBase test case to the latest imageChange image (#7452)

Improve

Core

  • [Improve][Spark] Convert array type to exact type (#7758)
  • [Improve][Zeta] Split the classloader of task group (#7580)
  • [Improve][Core] Config variables update doc and add test case (#7709)
  • [Improve][Zeta] Add log for tryTriggerPendingCheckpoint because the wrong time of server (#7717)
  • [Improve][EventService] improve event code and extract event code to EventService (#7153)
  • [Chore] Code specification adjustments (#7572)
  • [Chore] Update zeta example log4j2.properties (#7563)
  • [Improve] Update docker doc and build tag (#7486)
  • [Improve][Zeta] Handle user privacy when submitting a task print config logs (#7247)
  • [Improve][API] Add IGNORE savemode type (#7443)
  • [Improve][API] Move catalog open to SaveModeHandler (#7439)
  • [Improve] Skip downloading transitive dependency when install plugins (#7374)
  • [Improve] Flink support embedding transform (#7592)

Connector-V2

  • [Improve][Connector-v2] Remove useless code and add changelog doc for paimon sink (#7748)
  • [Improve][Connector-V2] Optimize sqlserver package structure (#7715)
  • [Improve][Connector-V2] Optimize milvus code (#7691)
  • [Improve][Redis]Redis scan command supports versions 5, 6, 7 (#7666)
  • [Improve][Connector-V2] Support read archive compress file (#7633)
  • [Improve][Jdbc] Jdbc truncate table should check table not database (#7654)
  • [Improve] [Connector-V2] Optimize milvus-connector config code (#7658)
  • [Improve][Connector-V2] Time supports default value (#7639)
  • [Improve][Iceberg] Add savemode create table primaryKey testcase (#7641)
  • [Improve][Kafka] kafka source refactored some reader read logic (#6408)
  • [Improve][Connector-V2][MongoDB] A BsonInt32 will be convert to a long type (#7567)
  • [Improve][Connector-v2] Improve the exception msg in case-sensitive case for paimon sink (#7549)
  • [Improve][Connector-v2] Support mysql 8.1/8.2/8.3 for jdbc (#7530)
  • [Improve][Connector-v2] Release resource in closeStatements even exception occurred in executeBatch (#7533)
  • [Improve][Connector-V2] Remove hard code iceberg table format version (#7500)
  • [Improve][Connector-V2] Fake supports column configuration (#7503)
  • [Improve][Connector-V2] update vectorType (#7446)
  • [Improve] Improve some connectors prepare check error message (#7465)
  • [Improve] Refactor S3FileCatalog and it's factory (#7457)
  • [Improve] Added OSSFileCatalog and it's factory (#7458)
  • [Improve][Connector-V2] Reuse connection in StarRocksCatalog (#7342)
  • [Improve][Connector-V2] Remove system table limit (#7391)
  • [Improve][Connector-V2]Support multi-table sink feature for email (#7368)
  • [Improve] Update pull request template and github action guide (#7376)
  • [Improve][Connector-V2] Close all ResultSet after used (#7389)
  • [Improvement] add starrocks jdbc dialect (#7294)

Transform

  • [Improve][Transform] Improve inner sql query for map field type (#7718)
  • [Improve][Transform] Support errorHandleWay on jsonpath transform (#7524)
  • [Improve][Transform-v2] Refactor a transformRow from FilterFieldTransform (#7598)
  • [Improve][Transform] Add LLM model provider microsoft #7778

CI

  • [Improve][CI] Move paimon into single task (#7719)
  • [Improve][Test][Connector-V2][MongoDB] Add few test cases for BsonToRowDataConverters (#7579)
  • [Improve][Test] Remove useless code of S3Utils. (#7515)
  • [Improve][E2E] update doris image to official version #7773

Feature

Core

  • [Feature][Flink] Support multiple tables read and write (#7713)
  • [Feature][Zeta][Core] Support output log file of job (#7712)
  • [Feature][REST-API] Add threaddump rest api (#7615)
  • [Feature][rest-api] Add whether master node identifier (#7603)
  • [Feature][Core] shell batch cancel task (#7612)
  • [Feature] Support config variable substitution with default value (#7562)
  • [Feature][zeta]Support exposing monitoring metrics by prometheus exporter protocol (#7564)
  • [Feature][Zeta] add rest api to update node tags (#7542)
  • [Feature][Zeta] Optimized llm doc && add DOUBAO LLM (#7584)
  • [Feature][Zeta] Support slf4j mdc tracing job id output into logs (#7491)
  • [Feature][Core] Added rest-api for batch start and stop (#7522)
  • [Feature][Core] Add event notify for all connector (#7501)
  • [Feature] add dockerfile (#7346)
  • [Feature][Zeta] Added other metrics info of multi-table (#7338)
  • [Feature][Spark] Support multiple tables read and write (#7283)

Connector-V2

  • [Feature][Connector-V2] Assert support multi-table check (#7687)
  • [Feature][Connector-Paimon] Support dynamic bucket splitting improves Paimon writing efficiency (#7335)
  • [Feature][Connector-v2] Support streaming read for paimon (#7681)
  • [Feature][Connector-V2] Optimize hudi sink (#7662)
  • [Feature][Connector-V2] jdbc saphana source tablepath support view and synonym (#7670)
  • [Feature][Connector-V2] Ftp file sink suport multiple table and save mode (#7665)
  • [Feature] Support tidb cdc connector source #7199 (#7477)
  • [Feature][kafka] Add arg poll.timeout for interval poll messages (#7606)
  • [Feature][Connector-V2][Hbase] implement hbase catalog (#7516)
  • [Feature][Elastic search] Support multi-table source feature (#7502)
  • [Feature][CONNECTORS-V2-Paimon] Paimon Sink supported truncate table (#7560)
  • [Feature][Connector-V2] Support Qdrant sink and source connector (#7299)
  • [Feature][Connector-V2] Support multi-table sink feature for HBase (#7169)
  • [Feature][Connector-V2] Support typesense connector (#7450)
  • [Feature][Rabbitmq] Allow configuration of queue durability and deletion policy (#7365)
  • [Feature][Connector-V2] Add decimal_type_narrowing option in jdbc (#7461)
  • [Feature][connector-v2]Add Kafka Protobuf Data Parsing Support (#7361)
  • [Feature][Connector-V2][Tablestore] Support Source connector for Tablestore #7448 (#7467)
  • [Feature][Connector-V2] Support opengauss-cdc (#7433)
  • [Feature][Connector-V2] Suport choose the start page in http paging (#7180)
  • [Feature][Connector-V2][OceanBase] Support vector types on OceanBase (#7375)
  • [Feature][Connector-V2] Fake Source support produce vector data (#7401)
  • [Feature][Connector-V2][Iceberg] Support Iceberg Kerberos (#7246)
  • [Feature][Connector-V2] SqlServer support user-defined type (#7706)
  • [Feature][Connector-V2] sftp file sink suport multiple table and save mode (#7668)

Transform

  • [Feature][Transforms-V2] LLM transforms Support custom field name (#7640)
  • [Feature][Transforms-V2] LLM transforms Support KimiAI (#7630)
  • [Future][Transforms-V2] llm trans support field projection (#7621)
  • [Feature][Transform] Add embedding transform (#7534)

Docs

  • [Docs] Spark use doc update (...
Read more
Loading

2.3.7 Release

19 Aug 07:40
@wuchunfu wuchunfu
2.3.7
8bdc6a2

Choose a tag to compare

View all tags
2.3.7 Release

Bug fix

Connector-V2

  • [Hotfix][MySQL-CDC] Fix ArrayIndexOutOfBoundsException in mysql binlog read (#7381)
  • [Fix][Doris] Fix doris primary key order and fields order are inconsistent (#7377)
  • [Bugfix][Doris] Fix Json serialization, null value causes data error problem (#7379)
  • [Hotfix][Jdbc] Fix jdbc compile error (#7359)
  • [Fix][OceanBase] Remove OceanBase catalog's dependency on mysql driver (#7311)
  • [Fix][Tdengine] Fix sql exception and concurrentmodifyexception when connect to taos and read data (#6088)
  • [Hotfix][Kafka] Fix kafka consumer log next startup offset (#7312)
  • [Fix][Doris] Fix the abnormality of deleting data in CDC scenario. (#7315)
  • [hotfix][Hbase]fix and optimize hbase source problem (#7148)
  • [Fix][Iceberg] Unable to create a source for identifier 'Iceberg'. #7182 (#7279)

Zeta(ST-Engine)

  • [Fix][Zeta] Fix task can not end cause by lock metrics failed (#7357)
  • [Hotfix][Zeta] Fix task cannot be stopped when system is busy (#7292)
  • [Hotfix][Zeta] Fix task cannot be stopped when system is busy (#7280)

E2E

  • [Fix][Http] Fix http e2e case (#7356)

Improve

Core

  • [Improve][Flink] optimize method name (#7372)
  • [Improve][API] Check catalog table fields name legal before send to downstream (#7358)
  • [Improve][Flink] refactor flink proxy source/sink (#7355)
  • [Improve][API] Make sure the table name in TablePath not be null (#7252)
  • [Improve][Core] Improve base on plugin name of lookup strategy (#7278)

Connector-V2

  • [Improve][multi-table] Add multi-table sink option check (#7360)
  • [Improve][Console] Update ConsoleSinkFactory.java (#7350)
  • [Improve][Jdbc] Skip all index when auto create table to improve performance of write (#7288)
  • [Improve][Doris] Improve doris error msg (#7343)
  • [Improve][Jdbc] Remove MysqlType references in JdbcDialect (#7333)
  • [Improve][Jdbc] Merge user config primary key when create table (#7313)
  • [Improve][Jdbc] Optimize the way of databases and tables are checked for existence (#7261)

Transforms-V2

  • [Improve][DynamicCompile] Improve DynamicCompile transform (#7319)
  • [Improve][SQL] Remove escape identifier from output fields (#7297)
  • [Improve][DynamicCompile] Improve DynamicCompile transform (#7264)

E2E

  • [Improve][Improve] Enable fakesource e2e of spark/flink (#7325)
  • [Improve][Improve] Enable JdbcPostgresIdentifierIT (#7326)
  • [Improve][Improve] Support windows for the e2e of paimon (#7329)

Feature

Connector-V2

  • [Feature][Aliyun SLS] add Aliyun SLS connector #3733 (#7348)
  • [Feature][Activemq] Added activemq sink (#7251)

Transforms-V2

  • [Feature] Split transform and move jar into connectors directory (#7218)
  • [Feature][LLM] Add LLM transform (#7303)
  • [Feature][SQL] Support cast to bytes function of sql (#7284)

Docs

  • [Docs] Change deprecated connector name in setup.md (#7366)
  • [Docs] Fix username parameter error in sftp sink document (#7334)
  • [Docs] fix document configuration is rectified when the oss is selected as the checkpoint base (#7332)
  • [Docs] Fix miss sink-options-placeholders.md in sidebars (#7310)
  • [Docs] Update Oracle-CDC.md (#7285)
  • [Docs] Fix hybrid cluster deployment document display error (#7306)
  • [Docs] translate event-listener doc into chinese (#7274)

Others

  • Bump org.apache.activemq:activemq-client (#7323)
  • [Improve] Remove unused code (#7324)
  • [Improve] Update snapshot version to 2.3.7 (#7305)
Loading

2.3.6 Release

02 Aug 10:19
@Hisoka-X Hisoka-X
2.3.6
1a60c39

Choose a tag to compare

View all tags
2.3.6 Release

2.3.6 Release Note

Bug fix

Core

  • [Fix][Flink]Hotfix flink checkpoint default value (#7040)
  • [Hotfix][Core] Fix the NullPointException for the json config of the job without pluginname (#6815)
  • [Fix][Dist] Remove aws jar dependency in release package (#7257)

Connectors

  • [Fix][Connector-V2] The isNullable attribute is true when the primary key field in the Paimon table converts the Column object. #7231 (#7242)
  • [Fix][Connector kafka]Fix Kafka consumer stop fetching after TM node restarted (#7233)
  • [Fix] Fix Hana type converter decimal scale is 0 convert to int error (#7167)
  • [BugFix][Connector-V2][Maxcompute]fix:Maxcompute sink can't map field(#7164) (#7168)
  • [Fix][Connector-V2] Fix kafka batch mode can not read all message (#7135)
  • [Fix][Connector-V2][Elasticsearch]Fix sink configuration for DROP_DATA (#7124)
  • [Fix][Connector-V2][CDC] SeaTunnelRowDebeziumDeserializationConverters NPE (#7119)
  • [Hotfix][Connector-V2] fix rabbit checkpoint exception in Flink mode (#7108)
  • [Fix][Connector-V2] Fix starrocks Content-Length header already present error (#7034)
  • [Hotfix][MySQL-CDC] Fix read gbk varchar chinese garbled characters (#7046)
  • [Hotfix][Hive Connector] Fix Hive hdfs-site.xml and hive-site.xml not be load error (#7069)
  • [Fix] hive load hive_site_path and hdfs_site_path too late (#7017)
  • [Fix] fix pgsql create table comment special string bug (#7022)
  • [Fix] Fix plugin_config (#7104)
  • [connector-jdbc][bugfix] fix sqlServer create table comment special string bug (#7024)
  • [connector-jdbc][bugfix] fix oracle create table comment special string bug (#7012)
  • [Hotfix][CDC] Fix split schema change stream (#7003)
  • [bugfix] fix mysql create table comment special string bug (#6998)
  • [Paimon]support projection for paimon source (#6343)
  • [bugfix][connector-mongodb] fix mongodb null value write (#6967)
  • [Hotfix][Connector-V2][kafka]Kafka consumer group automatically commits offset logic error fix (#6961)
  • [Bug] [connector-hive] Eanble login with kerberos for hive (#6893)
  • [Bug][Connector-Iceberg]fix create iceberg v2 table with pks (#6895)
  • [Fix] correct the typo of kudu kerberos config (#6905)
  • [Hotfix][Connector-V2] Close the tableWrite when task is close (#6897)
  • [Fix][Connector-V2] Field information lost during Paimon DataType and SeaTunnel Column conversion (#6767)
  • [Hotfix][Connector-V2] Fix the batch write with paimon (#6865)
  • [Hotfix][Jdbc] Fix oracle savemode create table (#6651)
  • [bugFix][Connector-V2][Doris] The multi-FE configuration is supported (#6341)
  • [Hotfix][Postgres-CDC/OpenGauss-CDC] Fix read data missing when restore (#6785)
  • [Fix] Fix HttpSource bug (#6824)
  • [Hotfix][Jdbc/CDC] Fix postgresql uuid type in jdbc read (#6684)
  • [Hotfix][Dist] Add oracle cdc (#6818)
  • [Fix] fix Debezium conf "key_convert_schemas.enable" set false lead to nullPointException (#6809)
  • [Fix][MySQL]: Fix MySqlTypeConverter could not be instantiated (#6781)
  • [Fix][Connector-V2] Remove Some Incorrect Comments and Properties in ElasticsearchCommitInfo
  • [Hotfix][Jdbc] Fix table/query columns order merge for jdbc catalog (#6771)
  • [Fix][KuduCatalogFactory]: Fix KuduCatalogFactory.optionRule() will throw an Exception (#6787)
  • [Bug Fix] Sink Doris error status(#6753) (#6755)
  • [Bug][Improve][Connector-v2][ElasticsearchSource] Fix behavior when source empty，Support SourceConfig.SOURCE field empty. (#6425)
  • [Fix] Fix Oracle type converter handle negative scale in number type (#6758)
  • [HiveSink]Fix the risk of resource leakage. (#6721)
  • [bigfix][S3 File]:Change the [SCHEMA] attribute of the [S3CONF class] to be non-static to avoid being reassigned after deserialization (#6717)
  • [Fix][Connector-v2] Fix the sql statement error of create table for doris and starrocks (#6679)
  • [Fix][connector-rocketmq] commit a correct offset to broker & reduce ThreadInterruptedException log (#6668)
  • [Fix][Connector-V2] Fix doris TRANSFER_ENCODING header error (#7267)

Transformer

  • [Fix][Transform] Fix sql transform lose source type and options (#6855)

Zeta(ST-Engine)

  • [Hotfix][Zeta] Fix taskgroup failed log lost (#7241)
  • [Fix][Zeta] Fix release slot resource twice (#7236)
  • [Fix][Zeta] Fix hybrid deployment can not get worker when init (#7235)
  • [HotFix] [Remote Debug] Description When remote debug is enabled, the Seatunel Server 5801 port is not listening properly (#7206)
  • [Fix][RestApi] Fix hazelcast/rest/maps/submit-job return a wrong jobId (#7154)
  • [Hotfix][Zeta] Fix that batch tasks cannot be stopped after retrying (#7083)
  • [Fix][Zeta] Fix env jars not working on zeta (#7035)
  • [Fix] revert IMAP cache data field type to compatible with old version (#7001)
  • [Hotfix][Zeta] Fix generate_client_protocol.sh (#6991)
  • [Hotfix][Zeta] Fix job crash when schema changing on multiple parallel readers (#6977)
  • [Fix] Fix Metrics lost data bug (#6976)
  • [Hotfix][Zeta] Fix okhttp connection leak in event reporter (#6945)
  • [Fix] Fix job will never cancel success when JobMaster init not complete (#6885)
  • [Hotfix][Zeta] Fix savepoint execute result (#6850)
  • [Fix][Zeta] Increase the log level when waitForJobComplete fails (#6827)
  • [Fix] Fix MultiTableWriterRunnable can not catch Throwable error (#6734)
  • [HotFix][zeta]: Fix loss job (#6759) (#6807)
  • [fix][zeta] fix can't release resource issue (#6763)
  • [Fix][Script] Fix lose jvm option when jvm_options file not end with \n (#6693)

E2E

  • [Fix][E2E] Fix classloader number (#7209)
  • [CI] Fix k8s engine it not runs when only test case changed (#7122)
  • [Fix] Fix iceberg e2e image tag (#7189)
  • [CI][Test] Fix engine-k8s-it failed (#7101)
  • [CI] connector-kafka-e2e , connector-rocketmq-e2e module runs repeatedly #7090 (#7091)
  • [E2E][HBase]Refactor hbase e2e (#6859)
  • [Fix] Fix ConnectorSpecificationCheckTest failed (#6828)
  • [CI] Fix FixSlotResourceTest testNotEnoughResource test error (#6820)

Improve

Core

  • [Improve][Core] Move MultiTableSink to seatunnel-api module (#7243)
  • [Improve] Bump org.xerial.snappy:snappy-java (#7144)
  • [Improve] delete log for protect user privacy (#6987)
  • [Improve][Log] Auto refresh log configuration (#6915)
  • [Improve] [shell] Set the env SEATUNNEL_HOME automatically (#6924)
  • [Improve] Optimize log display during startup command (#6816)

Connectors

  • [Improve][Doris Connector] Unified serialization method,Use RowToJsonConverter and TextSerializationSchema (#7229)
  • [Improve][Jdbc] Support write unicode text into sqlserver (#7159)
  • [Improve] Improve error message when can not parse datetime value (#7181)
  • [Improve][Hive] Close resources when exception occurs (#7205)
  • [Improve][Jdbc] Remove user info in catalog-table options (#7178)
  • [Improve][Connector-V2] Add support for MySQL 8.4 (#7151)
  • [Improve][hbase] The specified column is written to the specified column family (#5234)
  • [Improve] Change catalog table log to debug level (#7136)
  • [Improve][Connector-V2] Support schema evolution for mysql-cdc and mysql-jdbc (#6929)
  • [Improve][Redis] Redis reader use scan cammnd instead of keys, single mode reader/writer support batch (#7087)
  • [Improve][Connector-V2][MongoDB] Support to convert to double from any numeric type (#6997)
  • [Improve][[Jdbc]sink sql support custom field.(#6515) (#6525)
  • [Improve][Connector-V2][Iceberg] Add hadoop s3 catalog e2e testcase (#5745)
  • [Improve][Connector-V2] Clean key name in catalog table (#6942)
  • [Improve][File Connector]Improve xml read code & fix can not use true for a boolean option (#6930)
  • [Improve][Files] Support write fixed/timestamp as int96 of parquet (#6971)
  • [Improve][Paimon] Add check for the base type between source and sink before write. (#6953)
  • [Improve][Connector-V2] Improve the paimon source (#6887)
  • [Improve] Make ClickhouseFileSinker support tables containing materialized columns (#6956)
  • [Improve][Jdbc] Quotes the identifier for table path (#6951)
  • [Improve][CDC] Bump the version of debezium to 1.9.8.Final (#6740)
  • [Improve][Connector-V2] Support hive catalog for paimon sink (#6833)
  • [Improve][CDC] Close idle subtasks gorup(reader/writer) in increment phase (#6526)
  • [Improve][JDBC Source] Fix Split can not be cancel (#6825)
  • [Improve] Add conditional of start.mode with timestamp in mongo cdc option rule (#6770)
  • [Improve] Improve doris create table template default value (#6720)
  • [Improve] [Clickhouse] Remove check when set allow_experimental_lightweight_delete false(#6727) (#6728)
  • [Improve] Improve read table schema in cdc connector (#6702)
  • [Improve][mysql-cdc] Fallback to desc table when show create table failed (#6701)
  • [Improve][Connector-v2] The hive connector support multiple filesystem (#6648)
  • [Improve][Hive] udpate hive3 version (#6699)
  • [Improve][mysql-cdc] Support mysql 5.5 versions (#6710)
  • [Improve] Update aws-java-sdk-budle version to fix job can not run bug
  • [Improve] Improve doris stream load client side error message (#6688)
  • [Improve][Connector] Add some sqlserver IDENTITY type for catalog (#6822)
  • [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc (#7248)

Transformer

  • [Improve][Transform-V2] Remove SQL query validation on table name (#7020)

Zeta(ST-Engine)

  • [Improve][Restapi] Add ip and port to monitoring information (#7203)
  • [Improve][Zeta] Add check for submit duplicate job id (#7021)
  • [Improve][Zeta] Add retry when request slot on resource manager (#7049)
  • [Improve][Zeta] Fix JobMaster reset app classloader twice (#7063)
  • [Improve][Engine] Support custom job id for rest-api named submit-job (#7053)
  • [Improve][Zeta] Clean checkpoint file when job FINISHED/CANCELED (#6938)
  • [Improve][Zeta] Support close idle task for multiple sinks (#6864)
  • [Improve][Zeta] Move SaveMode behavior to master (#6843)
  • [Improve] Add custom job id arg in client (#6943)
  • [Improve][Zeta] when job finished...
Read more
Loading

2.3.5 Release

21 Apr 03:05
@liugddx liugddx
2.3.5
fd78af9

Choose a tag to compare

View all tags
2.3.5 Release

2.3.5 Release Note

Bug fix

Core

  • [fix] fix get seatunnel row size npe issue (#6681)
  • [Hotfix] Fix DEFAULT TABLE problem (#6352)
  • [Chore] Fix file spell errors (#6606)
  • [BugFix][Spark-translation] map type cast error (#6552)
  • [Hotfix] Fix spark example (#6486)
  • [Hotfix] Fix compile error (#6463)

Transformer

  • [Fix][SQLTransform] fix the scale loss for the sql transform (#6553)
  • [Bug] Fix minus constant error in SQLTransform (#6533)

Connectors

  • [Fix][Kafka-Sink] fix kafka sink factory option rule (#6657)
  • [Hotfix] fix http source can not read yyyy-MM-dd HH:mm:ss format bug & Improve DateTime Utils (#6601)
  • [Bug] Fix OrcWriteStrategy/ParquetWriteStrategy doesn't login with kerberos (#6472)
  • [Fix][Doc] Fix FTP sink config key username to user (#6627)
  • [E2E] Fix AmazondynamodbIT unstable (#6640)
  • [Fix][Connector-V2] Fix add hive partition error when partition already existed (#6577)
  • [Fix][Connector-V2] Fixed doris/starrocks create table sql parse error (#6580)
  • [Fix][Connector-V2] Fix doris sink can not be closed when stream load not read any data (#6570)
  • [Fix][Connector-V2] Fix connector support SPI but without no args constructor (#6551)
  • [Fix][Connector-V2] Fix doris source select fields loss primary key information (#6339)
  • [Fix][FakeSource] fix random from template not include the latest value issue (#6438)
  • [Fix][Connector-V2] Fix mongodb cdc start up mode option values not right (#6338)
  • [BugFix][Connector-file-sftp] Fix SFTPInputStream.close does not correctly trigger the closing of the file stream (#6323) (#6329)
  • [Fix] Fix doris stream load failed not reported error (#6315)
  • [fix][connector-rocketmq]Fix a NPE problem when checkpoint.interval is set too small(#6624)
  • [Bugfix][TDengine] Fix the issue of losing the driver due to multiple calls to the submit job REST API #6581 (#6596)
  • [Fix][StarRocks] Fix NPE when upstream catalogtable table path only have table name part (#6540)

Formats

  • [Bug] [formats] Fix fail to parse line when content contains the file delimiter (#6589)

Zeta(ST-Engine)

  • [Hotfix] fix http source can not read yyyy-MM-dd HH:mm:ss format bug & Improve DateTime Utils (#6601)
  • [Fix][Zeta] Fix the thread stuck problem caused by savepoint checking mechanism (#6568)
  • [Fix][Zeta] improve the local mode hazelcast connection (#6521)
  • [Fix][Zeta] Fix thread classloader be set to null when use cache mode (#6509)
  • [Bug] [zeta] Fix null pointer exception when submitting jobs (#6492)
  • [bugfix] [Zeta] Fix the problem of class loader not releasing when using REST API to submit jobs
  • [BUG][Zeta]job name Display error #6470
  • [Hotfix][Zeta] Fix job deadlock when schema change (#6389)

E2E

  • [E2E] Enable StarRocksCDCSinkIT (#6626)

Improve

  • [Doc][Improve] Add Support Chinese for seatunnel-engine (#6656)
  • [Doc][Improve]Add Support Chinese for start-v2/locally/quick-start-flink.md and start-v2/locally/quick-start-spark.md (#6412)
  • [Improve] add icon for idea (#6394)
  • [Improve] Add deprecated annotation for ReadonlyConfig::toConfig (#6353)

Core

  • [Improve][RestAPI] always return jobId when call getJobInfoById API (#6422)
  • [Improve][RestAPI] return finished job info when job is finished (#6576)
  • [Improve] Improve MultiTableSinkWriter prepare commit performance (#6495)
  • [Improve] Add SaveMode log of process detail (#6375)
  • [Improve][API] Unify type system api(data & type) (#5872)

Formats

  • [Improve] Improve read with parquet type convert error (#6683)

Connector-V2

  • [Improve][Connector-V2]Support multi-table sink feature for redis (#6314)
  • [Improve][Connector-V2] oracle cdc e2e optimization (#6232)
  • [Improve][Connector-V2]Support multi-table sink feature for httpsink (#6316)
  • [Improve][Connector-V2] Support INFINI Easysearch (#5933)
  • [Improve][Connector-V2] Support hadoop ha and kerberos for paimon sink (#6585)
  • [Improve][CDC-Connector]Fix CDC option rule. (#6454)
  • [Improve][CDC] Optimize memory allocation for snapshot split reading (#6281)
  • [Improve][Connector-V2] Support TableSourceFactory on StarRocks (#6498)
  • [Improve][Jdbc] Using varchar2 datatype store string in oracle (#6392)
  • [Improve] StarRocksSourceReader use the existing client (#6480)
  • [Improve][JDBC] Optimized code style for getting jdbc field types (#6583)
  • [Improve][Connector-V2] Add ElasticSearch type converter (#6546)
  • [Improve][Connector-V2] Support read orc with schema config to cast type (#6531)
  • [Improve][Jdbc] Support custom case-sensitive config for dameng (#6510)
  • [Improve][Jdbc] Increase tyepe converter when auto creating tables (#6617)
  • [Improve][CDC] Optimize split state memory allocation in increment phase (#6554)
  • [Improve][CDC] Improve read performance when record not contains schema field (#6571)
  • [Improve][Jdbc] Add quote identifier for sql (#6669)
  • [Improve] Add disable 2pc in SelectDB cloud sink (#6266)
  • [Doc][Improve] Add Support Kerberos Auth For Kafka Connector #6653

CI

  • [CI] Fix error repository name in ci config files (#4795)

Zeta(ST-Engine)

  • [Improve][Zeta] Add classloader cache mode to fix metaspace leak (#6355)
  • [Improve][Test] Fix test unstable on ResourceManger and EventReport module (#6620)
  • [Improve][Test] Run all test when code merged into dev branch (#6609)
  • [Improve][Test] Make classloader cache testing more stable (#6597)
  • [Improve][Zeta][storage] update hdfs configuration, support more parameters (#6547)
  • [Improve][Zeta]Optimize the logic of RestHttpGetCommandProcessor#getSeaTunnelServer() (#6666)

Transformer

  • [Improve][Transform] Sql transform support inner strucy query (#6484)
  • [Improve][Transform] Remove Fallback during parsing Transform process (#6644)
  • [Improve][Transform] Remove can't find field exception (#6691)

Feature

Core

  • [Feature][Tool] Add connector check script for issue 6199 (#6635)
  • [Feature][Core] Support listening for message delayed events in cdc source (#6634)
  • [Feature][Core] Support event listener for job (#6419)

Connector-V2

  • [Feature][connector-v2] add xugudb connector (#6561)
  • [Feature][Connector-V2] Support multi-table sink feature for paimon #5652 (#6449)
  • [Feature][Connectors-V2][File]support assign encoding for file source/sink (#6489)
  • [Feature][Connector]update pgsql-cdc publication for add table (#6309)
  • [Feature][Paimon] Support specify paimon table write properties, partition keys and primary keys (#6535)
  • [Feature][Feature] Support nanosecond in Doris DateTimeV2 type (#6358)
  • [Feature][Feature] Support nanosecond in SelectDB DateTimeV2 type (#6332)
  • [Feature][Feature] Supports iceberg sink #6198 (#6265)

Zeta(ST-Engine)

  • [Zeta] Support config job retry times in job config (#6690)

Docs

  • [Docs] fix kafka format typo (#6633)
  • [Fix][Doc] Fixed links in some documents (#6673)
  • [Fix][Doc] Fix some spell errors (#6628)
  • [Fix][Doc] Fixed typography error in starrocks sink document (#6579)
  • [Hotfix][Doc][Chinese] Fix invalid link about configure logging related parameters (#6442)
  • [Fix][Doc]Seatunnel Engine/checkpoint-storage.md doc error(#6369)
Loading

2.3.4 Release

20 Feb 03:01
@EricJoy2048 EricJoy2048
2.3.4
b96bf8a

Choose a tag to compare

View all tags
2.3.4 Release

2.3.4 Release Note

Bug Fix

Core

  • [Core] [API] Fixed generic class loss for lists (#4421)
  • [Starter] Fix the problem of "," being divided in [] (#5401)
  • [Core] [API] Fix ReadonlyConfig lose key error (#5565)
  • [Core] [API] Fix get bytes from LinkHashMap (#5622)
  • [Core] [API] Fix log error when multi-table sink close (#5683)
  • [Core] [API] Fix MultiTableSink return committer but sink do not support (#5710)
  • [Core] [API] Fix the error msg when parse schema with unsupported type (#5790)
  • [Core] [API] Fix flaky test OptionUtilTest.test (#5894)
  • [Core] [API] Fix SaveModeHandler not be closed (#5843)
  • [Core] [API] Fix MultiTableSinkWriter thread index always 1 (#5832)
  • [Core] [API] Fix SeaTunnelRow::getBytesSize not support map interface (#5990)
  • [Core] [Common] Fix FileUtils::createNewFile not create new file (#5943)
  • [Core] [API] Fix Debezium format cannot parse date/time/timestamp (#5887)
  • [Starter] When inside double quotes,',' are treated as normal characters instead of delimiters (#6042
  • [Core] [Common] Replace CommonErrorCodeDeprecated.JSON_OPERATION_FAILED (#5978)
  • [Core] [API] Fix Object.class option value can not return normal value (#6247)

Transformer-V2

  • [All] Fix PrimaryKey in transform (#5704)
  • [All] Fix cast to timestamp, date, time bug (#5812)

Formats

  • [Text] Allow the entry in the map to be null and allow the key in the entry to be null (#5277)

Connector-V2

  • [Connector-V2] [Clickhouse] Fix clickhouse old version compatibility (#5326)
  • [Connector-V2] [Clickhouse] Fix http header cover (#5446)
  • [Connector-V2] [StarRocks] Fix starrocks template sql parser (#5332)
  • [Connector-V2] [Hive] Fix the bug that hive-site.xml can not be injected in HiveConf (#5261)
  • [Connector-V2] [Clickhouse] Fix clickhouse sink flush bug (#5448)
  • [Connector-V2] [Hive] Fix An error occurred reading an empty directory (#5427)
  • [Connector-V2] [Hive] Fix An error occurred reading an empty directory (#5427)" (#5487)
  • [Connector-V2] [Oss jindo] Fix the problem of jindo driver download failure. (#5511)
  • [Connector-V2] [Oss jindo] Remove useless code (#5540)
  • [Connector-V2] [File] Fix WriteStrategy parallel writing thread unsafe issue (#5546)
  • [Connector-V2] [CDC] Fix the cdc bug about NPE when the original table deletes a field (#5579)
  • [Connector-V2] [Jdbc] oracle catalog create table repeat and oracle pg null point (#5517)
  • [Connector-V2] [CDC] Fix thread-unsafe collection container in cdc enumerator (#5614)
  • [Connector-V2] [Mongodb] Fixed unsupported exception caused by bsonNull (#5659)
  • [Connector-V2] [File] Fix file sink isPartitionFieldWriteInFile occurred exception when no columns are given (#5508)
  • [Connector-V2] [Doris] Fix RestService report NullPointerException (#5319)
  • [Connector-V2] [MaxCompute] Fix MaxCompute use not exist SCHEMA option (#5708)
  • [Connector-V2] [Doris] Using try-with-resources to simplify the code. (#4995)
  • [Connector-V2] [Clickhouse] Fixed an out-of-order BUG with output data fields of clickhouse-sink (#5346)
  • [Connector-V2] [Jdbc] support postgresql xml type (#5724)
  • [Connector-V2] [Jdbc] Nullable Column source have null data could be unexpected results. (#5560)
  • [Connector-V2] [Iceberg] Iceberg source lost data with parallelism option (#5732)
  • [Connector-V2] [Jdbc] Fix PG will not create index when using auto create table #5721
  • [Connector-V2] [Jdbc] Fix database identifier (#5756)
  • [Connector-V2] [CDC] Fix MultiTableSink restore failed when add new table (#5746)
  • [Connector-V2] [Postgres CDC] Fix Postgres create table test case failed (#5778)
  • [Connector-V2] [CDC] Clean unused code (#5785)
  • [Connector-V2] [CDC] Fix state recovery error when switching a single table to multiple tables (#5784)
  • [Connector-V2] [ElasticSearch] Fixed conversion exception of elasticsearch array format (#5825)
  • [Connector-V2] [Jdbc] Fix read from Oracle Date type value lose time (#5814)
  • [Connector-V2] [Pulsar] Fix: update IDENTIFIER = Pulsar for pulsar-datasource on project:seatunnel-web (#5852)
  • [Connector-V2] [Jdbc] Fix Hive-Jdbc use krb5 overwrite kerberosKeytabPath (#5891)
  • [Connector-V2] [InfluxDB] Resolve invalid SQL in initColumnsIndex method caused by direct QUERY_LIMIT appendage with 'tz' function. (#4829)
  • [Connector-V2] [Jdbc] Fix cdc updates were not filtering same primary key (#5923)
  • [Connector-V2] [File] Parquet reader parsing array type exception. (#4457)
  • [Connector-V2] [Http] Fix bug http config no schema option and improve e2e test add case (#5939)
  • [Connector-V2] [Doris] Fix DorisCatalog not implement name method (#5988)
  • [Connector-V2] [TDengine] Fix the degree of multiple parallelism affects driver loading (#6020)
  • [Connector-V2] [Jdbc] Fix jdbc setFetchSize error (#6005)
  • [Connector-V2] [CDC] Fix CDC job cannot consume incremental data After restore run (#625) (#6094)
  • [Connector-V2] [File] Fix the Issue of Abnormal Data Reading from Excel Files (#5932)
  • [Connector-V2] [CDC] Fix NPE caused by adding a table for restore job (#6145)
  • [Connector-V2] [Jdbc] Fix dameng catalog query table sql (#6141)
  • [Connector-V2] [Jdbc] update pgsql catalog for save mode (#6080)
  • [Connector-V2] [Jdbc] Fix Spliter Error in Case of Extensive Duplicate Data (#6026)
  • [Connector-V2] [CDC] Fix added columns cannot be parsed after job restore (#6118)
  • [Connector-V2] [CDC] Fix negative values in CDCRecordEmitDelay metric (#6259)
  • [Connector-V2] [Oracle CDC] Fix invalid split key when no primary key (#6251)

Zeta(ST-Engine)

  • [Zeta] Fix NotifyTaskRestoreOperation npe (#5362)
  • [Zeta] Fix Zeta will close task twice error (#5422)
  • [Zeta] Disable CheckpointTimeOutTest (#5438)
  • [Zeta] Fix CDC task restore throw NPE (#5507)
  • [Zeta] Multiple sink actions of the same type have the same name (#5499)
  • [Zeta] Checkpoint exception status messages exclude state data (#5547)
  • [Zeta] Fix memory leak issues related to checkpoints (#5539)
  • [Zeta] Fix the checkpoint be blocked with long time (#5695)
  • [Zeta] Fix the problem of unstable job status (#5450)
  • [Zeta] Fix submit job api (#5702)
  • [Zeta] Set default DeployMode to DeployMode.CLIENT (#5783)
  • [Zeta] rest api submit a job with chinese name return Garbled code name (#5870)
  • [Zeta] Fix CheckpointCoordinator report NPE when ack not existed pending checkpoint (#5909)
  • [Zeta] Fix submit job has the same job name error. (#6041)
  • [Zeta] Fixed the problem that the return list is empty due to no status parameters (#6040)
  • [Zeta] Fix zeta scheduler bug (#6050)
  • [Zeta] Fix job can not restore when last checkpoint failed (#6193)
  • [Zeta] [Rest-API] Submit or stop job from an inactive master node (#6217)

E2E

  • [E2E] [Common] Update test container version of seatunnel engine (#5323)
  • [E2E] [Jdbc] Fix not remove docker image after test finish on jdbc suite (#5586)
  • [E2E] [ClickHouse] Enhance ClickHouse E2E testing to trigger multiple checkpoints (#5476)
  • [E2E] Fix not remove docker image after test finish on jdbc suite (#5586)
  • [E2E] Fix ConnectorPackageServiceContainer miss implement getSavePointCommand/getRestoreCommand (#5780)
  • [E2E] Fix build failed cause by JdbcHiveIT and SparkSinkTest (#5798)
  • [E2E] Fix submit job case error (#6059)
  • [E2E] Fixed action related err (#6264)
  • [E2E] Lock mysql container version to 8.0 (#6263)

CI

  • [CI] Fix jindo oss connector name (#5385)
  • [Build] Fix error msg when fork repository not up to date. (#5497)
  • [CI] Fix file change not be check when CI run in fork repository (#5515)
  • [CI] remove jindo dependencies (#5528)
  • [CI] Fix phoenix ci error (#5530)
  • [Build] Update build version to 2.3.4-SNAPSHOT (#5619)
  • [Build] Ensure install-plugin.sh compatibility with sh on Debian #5630 (#5631)
  • [CI] [Chore] Remove useless sonar check script (#5665
  • [Chore] Remove DISCLAIMER file (#5673)
  • [CI] Fix CI unstable problem (#5896)
  • [Build] Fix empty line in config/plugin_config causes BUILD FAILURE (#5921)
  • [CI] Fix CI not run Kudu/AmazonSQS IT when not change api (#5955)
  • [CI] Split doris e2e into separate modules (#5999)
  • [CI] Fix Dead Links checker failure (#6016)
  • [CI] Fix e2e error (#6018)
  • [Build] Updated pom.xml (#6113)
  • [Build] Solve the problem of example running failure (#6173)
  • [Build] Fix build error (#6196)
  • [CI] Fix engine client not close  (#6241)

Examples

  • [Examples] modify the transform URL link (#5298)

Improve

  • [Improve][CheckStyle] Remove useless 'SuppressWarnings' annotation of checkstyle. (#5260)
  • [Improve][CheckStyle] Adjust the phase of spotless plugin for release plugin. (#5607)

Core

  • [Core] [API] Remove CatalogTable field in CatalogTableUtil (#5521)
  • [Core] [API] Move get schema logic from Config to ReadonlyConfig (#5534)
  • [Starter] Throw IllegalArgumentException when find multiple connector jar for one pluginIdentifier (#5551)
  • [Core] [API] Refactor CatalogTable and add SeaTunnelSource::getProducedCatalogTables (#5562)
  • [Core] [API] Support config column/primaryKey/constraintKey in schema (#5564)
  • [Core] [API] Remove useless ReadonlyConfig flatten feature (#5612)
  • [Core] [Flink & Spark] Refactor Spark/Flink execution processor (#5595)
  • [Core] [API] Mark SeaTunnelPluginLifeCycle as deprecated (#5625
  • [Core] [API] Support config tableIdentifier for schema (#5628)
  • [Core] [Pom] Add junit4 to the root pom (#5611)
  • [Core] [API] Remove catalog tag for config file (#5645)
  • [Core] [API] Remove useless transform code come from setTypeInfo (#5647)
  • [Core] [API] Make sure CatalogTable options and partitionKeys are mutable (#5681)
  • [Core] [API] Add default implement for SeaTunnelSource::getProducedType (#5670)
  • [Core] [API] Add default implement for SeaTunnelSink::setTypeInfo (#5682)
  • [Core] [API] Add warning for use fall back keys (#5753)
  • [Core] [API] Adjust the sleep mode of flink and spark e...
Read more
Loading