Polyglot Flow based programming framework with 0mq
Python C
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Failed to load latest commit information.
flowp
test
.gitignore
LogReceiver.py
README.md
TODO.md
pnode.c
topology.json
topology.xml

README.md

flowp

Pronounced 'Flop' (flɒp) as in 'This movie was a complete flop'.

Polyglot Flow based programming framework with 0mq.

Roadmap:

  1. Python Core
  2. Python Helpers
  3. Python Topology manager
  4. Small-Scale testing and optimisation (10000s events/100s processors)
  5. Creation of common modules
    • Ventilators
    • Aggregators
    • Filters (JSON, regex, etc...)
    • Multiplexers
    • Demultiplexers
  6. C Core
  7. C Helpers
  8. Processing guarantees, rollbacks and disaster recovery
  9. Extension of the topology manager across multiple machines.
    • Daemonise topology manager
    • Allow master/slave relation in topologies.
  10. Release of topology management Daemon/Master (productisation, documentation, promo)
  11. Mid-Scale testing (1000000s events/10s machines)
  12. Maintenance and scope increase
    • Adding languages
    • Adding dynamic management and load balancing at the process level
    • Adding dynamic management and load balancing at the machine level
  13. Large-Scale testing (1 000 000 000 events/100s machines)