Skip to content

Latest commit

 

History

History
20 lines (15 loc) · 1.25 KB

roadmap.adoc

File metadata and controls

20 lines (15 loc) · 1.25 KB
Raw
title
Roadmap

The Apache Hop team just released version 0.99. It offers our users the chance to test critical functionality before version 1.0 is released.

After that our community wants to graduate as a top level project.

Here are a few directions that we want to explore for the future of our software:

  • Set up a software marketplace where 3rd party plugins can be found

  • Pluggable field expressions in transforms and actions

  • Integration with Apache Airflow both in Airflow and as a new Workflow engine plugin

  • Modularisation of the Apache Beam plugins

  • Further unification of Beam plugins, for example make the Beam BigQuery Input plugin work in non-Beam engines as well

  • Finish conversion of all plugins to generic XML serialization to allow for JSON/YAML/…​ metadata serialization of pipelines and workflows

  • Create a new GUI for executing, previewing and debugging pipelines and workflows with care for long-running and streaming workloads

  • Create a monitoring and logging network service capable of accepting operational metadata from local and remote Hop executions, even on clusters (Beam)

  • Convert the Neo4j logging perspective to a generic logging perspective with room for plugins exposing the underlying strength of the logging sink.