StreamX 1.3.0 roadmap

[wolfboys]

At present, StreamX has completed the hosting of flink tasks. This part of the work is very important and difficult. Thanks to all the developers for their hard work, but this is only the initial stage, and we will focus on streaming-warehouse and cloud native, the following is the roadmap of the next stage of StremaX:

mind link: https://docs.qq.com/mind/DRUF0d1ZiTkhIaENv

Roadmap for 11/2021 ~ 07/2022:

• Documentation

  • Chinese/English User Doc #603
  • Chinese/English API & Developer Doc #604

• Streaming Warehouse

  • Flink Workbench, a new streaming data warehouse development workbench (draft, debug, preview, release, lock, version management...) #605 [Enhancement] StreamX Data Studio Feature #563
  • Planning a unified resource center (JAR tasks, UDF, Connector, etc. management) #606
  • SQL parsing based on syntax tree, syntax verification, SQL intelligent completion #608
  • Added DataSource module #609
  • Added Cluster cluster management module #610
  • Other ecological integration, integration support with hudi, hive, etc. #611

• StremaX Console

  • Open task operation API, support restapi mode to operate tasks, and facilitate the integration of other platforms and frameworks #612
  • StreamX-Console HA support #613
  • [Feat] Convergence thread definition, unified thread pool use entry #639
  • [Feat] The log information output is improved to make the error information clearer and clearer #638
  • [Feat] Add more task operations (task replication, view real-time deployment logs, etc.) #637
  • [Feat] The front-end Vue framework is upgraded to Vue 3, the structure is reorganized, and the modules are divided #636
  • [Feat] Improve the management of current task dependencies (maven cannot be specified at present) #635
  • [Feat] Improved task configuration management, divided into common configuration, resource configuration, advanced configuration, etc., front-end collocation display #634
  • Standalone mode support
  • [Feat]Flink Session module management #633
  • Support more alarm methods such as DingTalk and WeChat streamx console integrated Dingding group robot alarm function #579

• Cloud Native

  • StremaX Docker image is provided, which supports running on k8s, further reducing user usage costs #631

• Core Framework

  • [Feat] More flink-shims corresponding to flink are provided, the module is provided as a plug-in and a third-party dependency, and users can download and use it as needed #641
  • [Feat]Datastream connector reorganizes the module and puts it in a new module #642

[baisui1981]

Awesome ,Let's work together

[wolfboys]

Awesome ,Let's work together

cool, looking forward to our cooperation👌