NekoQ

0. Introduction

NekoQ is a message queue providing modern features for building flexible scaled distributed services.

The target of NekoQ is to become the general central dispatcher, coordinator with features including and beyond MQ.

Also keep as simple as possible to reduce the running and operation cost.

General: graceful startup and shutdown handling
- Organize service dependencies/service dependency graph
- Lifecycle of services
- Cleanup resources
General: graceful service deregister
General: error handling and detailed error information
General: logging/profiling/debugging support
- Including: management portal for viewing data in the process
General: configurations
- Additional: All services can be turned off
General: service registration
- Cluster mode: self if api -> registration
- LocalSwitch mode: NIC IP -> registration
  - By default, all services are always available in LocalSwitch
General: tuning for critical usecase - high TPS/large data set/broadcast/network bandwidth/etc
- Speed
- Space/Resource consumption
General: change magic number to configuration
General: Security - AuthZ/AuthN for APIs
General: reorganize package structure
General: more testing/fuzz
General: better organized documents including key parameter configurations
General: Simple configuration for usecases and flexible scale-out with shared nothing/minimum
General: (Any improvements and suggestions)

Note: These are the general items to be implemented. For more details, refer to the document of each service.