DataFibers has more than 40+ changes tasks applied in this release as follows. Now, DataFibers is able seamless submit stream, batch connects and transformations.
- New Web admin UI released using ReactJs based AOR. More powerful and more beautiful.
- Improved Connect Import completeness
- Completed basic demo by using df to build real-time data pipeline for the dashboard in 10 min.
- Certified and tested Hive/JDBC/Stock API connectors
- Added topic data preview especially for data in DataFibers queue
- Added more task/job operation, such as pause and restart, in service and web ui
- Added feature to run batch SQL using Spark and Livy
- Added feature to stream back batch result to Queue
- Default value is provided in the UI for better user experience
- Confluent is upgraded to v3.3.2. Vertx is updated to v3.5.2. Flink is updated to v1.3.2
- Changed Flink job submission from java API to rest API to achieve non-blocking
- Couple of improvement on dfops command as well as sandbox update command