Skip to content
/ orbix Public

Orbix: A WebAssembly-Powered Log Aggregator for Kubernetes (Just Getting Started!)

Notifications You must be signed in to change notification settings

ddukbg/orbix

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 

Repository files navigation

Orbix - A WebAssembly-Powered Log Aggregator for Kubernetes

πŸš€ Status: Early Stage (Work in Progress)

Orbix is a WebAssembly (WASM)-powered, dynamic log aggregation system for Kubernetes (EKS, GKE, on-prem). It provides real-time log processing, filtering, transformation, and routing using dynamically loaded WASM modules.

Traditional log processing pipelines are often static, difficult to update, and prone to system-wide failures when plugins crash. Orbix addresses these challenges by leveraging sandboxed WASM execution, dynamic module updates, and seamless Kubernetes integration to offer a more flexible, efficient, and resilient logging system.


Key Features

βœ… WASM-powered log processing – Run custom filtering, parsing, and transformation logic securely in a sandboxed environment.
βœ… Dynamic module updates – No need to restart your logging pipeline; update processing rules on the fly.
βœ… Kubernetes-native – Easily integrates with Fluent Bit, Filebeat, Vector, and other log forwarders.
βœ… Secure and isolated execution – WASM runtime ensures plugin safety and prevents system-wide failures.
βœ… Scalable and lightweight – Designed for large-scale cloud environments with minimal resource usage.


Planned Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚              Kubernetes Cluster             β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
        β”‚             β”‚               β”‚
        β–Ό             β–Ό               β–Ό
  [App Pod]      [App Pod]       [App Pod]
        β”‚             β”‚               β”‚
        β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”˜
               β–Ό             β–Ό
   β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
   β”‚  Log Forwarder DaemonSet    β”‚
   β”‚ (Fluent Bit / Vector / etc) β”‚
   β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
               β”‚
               β–Ό
   β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
   β”‚  Orbix Aggregator (WASM)    β”‚
   β”‚  (Dynamic log processing)   β”‚
   β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
               β”‚
               β–Ό
   β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
   β”‚  Storage & Monitoring       β”‚
   β”‚ (Elasticsearch, CloudWatch) β”‚
   β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Getting Started (WIP 🚧)

Note: Orbix is in early development. More detailed setup instructions will be available soon!

Prerequisites

  • Kubernetes cluster (EKS, GKE, Minikube, etc.)
  • Fluent Bit, Filebeat, or Vector for log forwarding
  • Helm & kubectl installed

Installation

kubectl apply -f https://raw.githubusercontent.com/your-org/orbix/main/deploy.yaml

Roadmap

πŸ“Œ Phase 1: Core Implementation

  • Implement WASM-based log processing
  • Integrate Fluent Bit & Vector support
  • Kubernetes deployment setup

πŸ“Œ Phase 2: Dynamic Module Management

  • WASM plugin hot-reloading
  • Versioned module registry

πŸ“Œ Phase 3: Scaling & Optimization

  • Performance benchmarking
  • Enhanced monitoring and alerting

Contributing

We welcome contributions! Feel free to submit issues, suggest features, or contribute code to make Orbix better.


License

Orbix is released under the MIT License.


This README provides a concise introduction to the project while keeping it flexible for future updates. As development progresses, you can expand it with more detailed installation and usage guides. πŸš€

About

Orbix: A WebAssembly-Powered Log Aggregator for Kubernetes (Just Getting Started!)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published