Skip to content

Roadmap

Krishanth edited this page Oct 15, 2026 · 1 revision

Roadmap

EveryO — Development Milestones, Technical Direction & Future Priorities

Build · Validate · Improve · Scale · Evolve

Roadmap Version Python License

A transparent record of EveryO's implemented capabilities, verification boundaries, and proposed next-stage engineering priorities.

Home · Framework Architecture · Contributing · Project Governance


Project Maintainer: @krishanth7

Authoritative Roadmap: README.md — Roadmap

Important

Roadmap Status

EveryO's original 10-item roadmap is marked complete in the repository README.

10 of 10 objectives have shipped.

This does not mean every implementation has been validated in every environment. In particular, CUDA execution on real GPU hardware and distributed training across multiple physical machines have documented verification gaps.

All additional priorities proposed in this Wiki are recommendations, not approved commitments.


Table of Contents

  1. Overview
  2. Project Vision
  3. Current Development Status
  4. Original Roadmap Completion
  5. Milestone 1 — Tensor and Autograd Foundation
  6. Milestone 2 — Neural Network Capabilities
  7. Milestone 3 — Training and Optimization
  8. Milestone 4 — Interoperability
  9. Milestone 5 — Performance and Scaling
  10. Milestone 6 — CUDA Acceleration
  11. Milestone 7 — Distributed Computing
  12. Milestone 8 — Quantization and Profiling
  13. Milestone 9 — ONNX Tracing
  14. Implementation Versus Verification
  15. Known Technical Limitations
  16. Proposed Next-Stage Priorities
  17. Proposed Hardware Validation Program
  18. Proposed Performance Engineering
  19. Proposed Distributed Systems Validation
  20. Proposed Reliability and Compatibility Work
  21. Proposed Developer Experience Improvements
  22. Research and Experimental Directions
  23. Milestone Acceptance Criteria
  24. Contribution Opportunities
  25. Roadmap Governance
  26. Progress Reporting
  27. Official References
  28. Next Steps

1. Overview

EveryO is an open-source neural computing framework built around a NumPy-based tensor engine and reverse-mode automatic differentiation.

Its goal is to make neural computing understandable, reproducible, and technically verifiable.

EveryO is designed for:

  • Learning.
  • Research.
  • Experimentation.
  • Numerical analysis.
  • Teaching.
  • Framework development.

The original roadmap focused on extending a foundational neural network framework with modern model architectures, interoperability, and scaling capabilities.

Those original objectives are now implemented.

The next stage should focus on strengthening verification, performance, reliability, and practical usability.


2. Project Vision

2.1 Mission

Make neural computing accessible through readable implementations, transparent mathematics, and reproducible experiments.

2.2 Technical Principles

EveryO emphasizes:

  1. Understandable implementations.
  2. Correct automatic differentiation.
  3. Minimal core dependencies.
  4. CPU-first functionality.
  5. Optional acceleration.
  6. Reproducible experiments.
  7. Explicit performance measurement.
  8. Honest reporting of limitations.

2.3 Design Philosophy

BUILD
  |
  v
TRAIN
  |
  v
MEASURE
  |
  v
UNDERSTAND
  |
  v
ACCELERATE

2.4 Project Positioning

EveryO is not currently presented as a production-scale replacement for established deep learning runtimes.

Its primary strength is a readable and verifiable implementation of neural computing concepts.


3. Current Development Status

3.1 Declared Package Version

EveryO 0.2.0

Source:

pyproject.toml

3.2 Original Roadmap

Original Roadmap Completion

████████████████████ 100%

Implemented: 10
Total:       10
Outstanding: 0

This completion percentage describes the original feature roadmap, not overall software maturity.

3.3 Development Classification

The package metadata classifies EveryO as alpha software.

3.4 Current Status Summary

Area Status
Tensor engine Implemented
Automatic differentiation Implemented
Neural network layers Implemented
Recurrent architectures Implemented
Attention and transformers Implemented
Training and optimization Implemented
ONNX interoperability Implemented
Mixed precision Implemented
Quantization Implemented
Profiling Implemented
CUDA extension Implemented; hardware validation limited
Distributed training Implemented; cross-machine validation limited

4. Original Roadmap Completion

The repository README identifies the following ten completed objectives.

# Original Objective Repository Status
1 Convolution and pooling layers Complete
2 Batch and layer normalization Complete
3 Recurrent layers, attention, transformers Complete
4 Mixed-precision training Complete
5 ONNX interoperability Complete
6 Distributed training Complete
7 GPU-resident tensors Complete
8 Multi-node distributed training Complete
9 Model quantization and profiling Complete
10 Tracing ONNX exporter Complete

4.1 Completion Interpretation

Complete means that the feature has been implemented according to the repository's documented roadmap.

It does not necessarily mean:

  • Production readiness.
  • Extensive hardware validation.
  • Cross-platform performance parity.
  • Support for every model architecture.
  • Exhaustive real-world testing.

4.2 Source of Truth

The official README is the authoritative record of original roadmap completion.


5. Milestone 1 — Tensor and Autograd Foundation

Status: Implemented

The tensor engine is the foundation of EveryO.

5.1 Implemented Capabilities

  • Tensor creation.
  • Dtypes.
  • Shape handling.
  • Broadcasting.
  • Indexing.
  • Reductions.
  • Matrix multiplication.
  • Device abstraction.
  • NumPy interoperability.

5.2 Automatic Differentiation

The framework implements reverse-mode automatic differentiation.

import everyo as eo

x = eo.tensor(
    [2.0],
    requires_grad=True,
)

y = x * x

y.backward()

print(x.grad)

Expected gradient:

[4.]

5.3 Verification

The project uses finite-difference gradient checks and TensorFlow comparisons where applicable.

5.4 Future Maintenance Focus

  • Numerical edge cases.
  • Gradient stability.
  • Error diagnostics.
  • Performance regressions.
  • Additional tests.

These are ongoing engineering concerns, not unfinished original roadmap items.


6. Milestone 2 — Neural Network Capabilities

Status: Implemented

EveryO supports multiple neural network architecture families.

6.1 Feedforward Networks

Implemented:

  • Linear
  • Sequential
  • ReLU
  • Dropout

6.2 Convolutional Networks

Implemented:

  • Conv2D
  • MaxPool2D
  • AvgPool2D

6.3 Normalization

Implemented:

  • BatchNorm1D
  • BatchNorm2D
  • LayerNorm

6.4 Recurrent Networks

Implemented:

  • RNN
  • LSTM
  • GRU

6.5 Attention

Implemented:

  • MultiHeadAttention
  • PositionalEncoding
  • TransformerEncoderBlock
  • TransformerEncoder

6.6 Example Architecture

import everyo as eo

model = eo.Sequential(
    eo.Linear(64, 128),
    eo.ReLU(),
    eo.Dropout(0.2),
    eo.Linear(128, 10),
)

6.7 Next-Stage Focus

Recommended future work:

  • Broader architecture testing.
  • Improved error messages.
  • Better performance diagnostics.
  • More educational examples.

7. Milestone 3 — Training and Optimization

Status: Implemented

EveryO includes a training system and optimization utilities.

7.1 Implemented Features

  • Training loops.
  • Validation.
  • Metrics.
  • Early stopping.
  • Checkpointing.
  • Learning-rate scheduling.
  • Gradient clipping.

7.2 Optimizers

Implemented optimizers include:

  • SGD.
  • Momentum.
  • Nesterov momentum.
  • Adam.
  • AMSGrad.

7.3 Mixed Precision

EveryO provides:

eo.autocast
eo.GradScaler

The implementation uses selective float16 computation while preserving float32 master parameters.

7.4 Limitations

The documented CPU mixed-precision path is not a guaranteed speed improvement.

NumPy may perform float16 arithmetic through wider intermediate representations.

7.5 Proposed Improvements

  • Expanded training diagnostics.
  • Better reproducibility reports.
  • More extensive mixed-precision tests.
  • Performance characterization.

8. Milestone 4 — Interoperability

Status: Implemented

EveryO supports optional interoperability with external machine learning tools.

8.1 TensorFlow

TensorFlow is used for reference comparisons and optional backend functionality.

It is not required for core EveryO operation.

8.2 ONNX

EveryO provides:

eo.export_onnx
eo.run_onnx
eo.onnx_available

8.3 Supported Model Categories

The layer-based exporter supports documented feedforward, convolutional, pooling, normalization, and activation operations.

The tracing exporter supports additional recurrent and attention architectures by recording executed primitive operations.

8.4 Verification

The repository documents ONNX Runtime comparisons rather than treating successful file creation as sufficient validation.

8.5 Future Opportunities

  • Broader operator coverage.
  • Improved shape diagnostics.
  • Expanded compatibility tests.
  • More export examples.

9. Milestone 5 — Performance and Scaling

Status: Implemented

EveryO includes performance-related features such as:

  • Mixed precision.
  • Profiling.
  • Quantization.
  • Distributed training.
  • Optional CUDA acceleration.

9.1 Engineering Principle

Performance claims must be supported by reproducible measurements.

9.2 Benchmarking

The CLI supports benchmark execution:

everyo benchmark --sizes 128 256 512 1024

9.3 Training Benchmarks

python benchmarks/benchmark_training.py --epochs 10

9.4 Future Focus

Improve measurement quality before making broad performance claims.


10. Milestone 6 — CUDA Acceleration

Status: Implemented, hardware verification incomplete

EveryO includes an optional CUDA extension.

10.1 Implemented Kernels

The README documents five CUDA kernels:

  1. Vector addition.
  2. Element-wise multiplication.
  3. ReLU.
  4. Tiled matrix multiplication.
  5. Reduction sum.

10.2 GPU-Resident Tensors

EveryO provides:

eo.cuda.to_device

The GPU-residency design reduces repeated host/device transfers during chained operations.

10.3 Verified Behavior

The repository documents a transfer-counting test using a stand-in for the native extension.

For a ten-operation chain:

With per-operation transfers: 30 crossings
With resident tensor design:   3 crossings

These are documented test results for transfer-counting behavior, not GPU performance measurements.

10.4 Unverified Behavior

The README states that CUDA kernel correctness has not been exercised in its GPU-less CI environment.

10.5 Next Priority

Real NVIDIA GPU hardware validation is a high-value recommended next step.


11. Milestone 7 — Distributed Computing

Status: Implemented, physical multi-machine validation incomplete

EveryO supports data-parallel training.

11.1 Single-Machine Parallelism

The framework uses multiple processes and gradient aggregation.

11.2 TCP Process Groups

The repository also implements TCP-based process-group functionality.

11.3 Verified Behavior

The README documents all-reduce testing across separate operating-system processes communicating over TCP.

11.4 Unverified Behavior

The repository does not claim completed validation across two physically separate machines.

11.5 Security Limitation

The documented TCP protocol assumes a trusted network and does not provide transport encryption.

11.6 Recommended Next Work

  • Test across separate hosts.
  • Characterize network failure behavior.
  • Measure synchronization overhead.
  • Document trusted-network deployment requirements.

12. Milestone 8 — Quantization and Profiling

Status: Implemented

12.1 Quantization

EveryO provides:

compact = eo.quantize_dynamic(model)

The documented implementation uses int8 weights with per-output-channel scaling.

12.2 Important Limitation

Quantization is a size and numerical-fidelity trade-off in the current implementation.

It should not be advertised as a guaranteed inference-speed improvement.

12.3 Profiling

EveryO provides:

with eo.profile() as run:
    model(batch)

run.summary()

12.4 Trace Export

run.export_chrome_trace("trace.json")

12.5 Future Focus

  • More detailed performance reports.
  • Memory profiling.
  • Performance regression tracking.
  • Benchmark reproducibility.

13. Milestone 9 — ONNX Tracing

Status: Implemented

The tracing ONNX exporter completed the original roadmap.

13.1 Purpose

A tracing exporter records the primitive operations executed during a model's forward pass.

This enables export of architectures that are difficult to represent through a simple layer-by-layer mapping.

13.2 Public API

eo.export_onnx_traced
eo.trace_operations
eo.TRACEABLE_OPERATIONS

13.3 Documented Validation

The repository reports ONNX Runtime comparisons for:

  • RNN.
  • LSTM.
  • GRU.
  • MultiHeadAttention.
  • TransformerEncoderBlock.
  • TransformerEncoder.

13.4 Tracing Limitations

A traced graph represents the execution path used during tracing.

Loop lengths and certain shapes may be fixed by the example input.

13.5 Dynamic Batch Behavior

EveryO checks proposed dynamic-batch behavior against another batch size and falls back to fixed-batch export when necessary.

13.6 Future Focus

  • Expanded operator support.
  • Better dynamic-shape diagnostics.
  • Additional runtime comparisons.
  • More explicit unsupported-case reporting.

14. Implementation Versus Verification

Feature implementation and feature verification are separate dimensions.

14.1 Status Definitions

Status Meaning
Implemented Feature exists in source
Unit-tested Relevant tests exist and have been run
Integration-tested Interoperability or subsystem behavior has been tested
Hardware-validated Tested on required physical hardware
Production-validated Evaluated in representative production workloads

14.2 Verification Matrix

Capability Implemented Documented Verification Boundary
Autograd Yes Finite differences
Convolution Yes Numerical and TensorFlow comparisons
Recurrent models Yes Functional and numerical tests
ONNX tracing Yes ONNX Runtime comparisons
Quantization Yes Numerical fidelity and weight tests
Profiling Yes Timing and trace tests
GPU residency Yes Transfer-counting stand-in
CUDA kernels Yes Real GPU validation not established in CI
TCP distributed training Yes Separate processes on one host
Cross-host distributed training Implemented path Two-machine validation not established

14.3 Reporting Rule

Never convert an implementation claim into an unsupported validation claim.


15. Known Technical Limitations

The README explicitly documents several boundaries.

15.1 Production Readiness

EveryO is not currently positioned as a production training runtime.

15.2 CUDA

GPU hardware is required to validate native CUDA execution.

15.3 Multi-Node Training

TCP process-group behavior has been tested across processes but not across separate physical machines in the documented CI environment.

15.4 ONNX Tracing

Tracing may specialize execution paths and shapes.

15.5 Quantization

The existing int8 implementation does not provide a dedicated faster inference kernel.

15.6 Mixed Precision

CPU execution may be slower despite reduced storage precision.

15.7 Performance Comparisons

EveryO should not claim superiority over optimized frameworks without representative benchmarks.


16. Proposed Next-Stage Priorities

The original roadmap is complete.

The following priorities are proposals for a new roadmap, not existing approved commitments.

16.1 Recommended Priority Matrix

Priority Proposed Work Expected Value
P0 Real CUDA hardware validation Establish kernel correctness
P0 Cross-host distributed tests Validate multi-machine behavior
P1 Numerical regression expansion Strengthen reliability
P1 Cross-platform compatibility Improve usability
P1 Performance regression tracking Detect slowdowns
P2 Expanded ONNX coverage Improve interoperability
P2 Memory and allocation profiling Improve diagnostics
P2 Documentation and examples Improve onboarding
Research Optimized quantized inference Explore performance opportunities

Priority labels express a recommended ordering only.


17. Proposed Hardware Validation Program

Status: Proposed

17.1 Objective

Validate EveryO's CUDA extension on real NVIDIA hardware.

17.2 Test Categories

  • Kernel correctness.
  • Device-memory safety.
  • Boundary dimensions.
  • Repeated execution.
  • Host/device transfers.
  • Numerical tolerance.
  • CPU fallback.

17.3 Suggested Hardware Matrix

Test representative NVIDIA GPU generations where hardware is available.

Record:

  • GPU model.
  • Driver version.
  • CUDA toolkit version.
  • Operating system.
  • Python version.
  • NumPy version.
  • EveryO commit.

17.4 Acceptance Criteria

A hardware validation milestone should not be marked complete until:

  • Relevant kernels execute on real hardware.
  • Results are compared against trusted CPU references.
  • Boundary cases are tested.
  • Memory errors are investigated.
  • Test evidence is recorded.

18. Proposed Performance Engineering

Status: Proposed

18.1 Objectives

  • Identify bottlenecks.
  • Improve benchmark consistency.
  • Track regressions.
  • Reduce avoidable allocations.

18.2 Benchmark Categories

Category Suggested Measurement
Tensor operations Latency and throughput
Matrix multiplication Size-dependent performance
Convolution Forward and backward time
Training Epoch time
Serialization Save/load time
ONNX export Export time and correctness
Distributed training Scaling efficiency
CUDA Transfer and kernel timings

18.3 Benchmark Requirements

Record:

  • Hardware.
  • Software versions.
  • Input sizes.
  • Dtypes.
  • Warm-up iterations.
  • Repetitions.
  • Summary statistics.
  • Correctness comparison.

18.4 Avoid Unsupported Claims

Benchmarks should not be presented as universal performance guarantees.


19. Proposed Distributed Systems Validation

Status: Proposed

19.1 Primary Goal

Validate distributed training across at least two physically separate machines.

19.2 Test Scenarios

  • Normal all-reduce.
  • Different network latencies.
  • Rank disconnection.
  • Timeout handling.
  • Incorrect world size.
  • Partial worker failure.
  • Repeated initialization.
  • Numerical agreement.

19.3 Security Considerations

The current TCP transport assumes a trusted network.

A future deployment design should assess whether authentication or transport security is required.

19.4 Acceptance Criteria

Document:

  • Hardware.
  • Network topology.
  • Process count.
  • Test results.
  • Failure behavior.
  • Known limitations.

20. Proposed Reliability and Compatibility Work

Status: Proposed

20.1 Reliability

Recommended work:

  • More edge-case tests.
  • Gradient regression tests.
  • Serialization robustness.
  • Error-message consistency.
  • Deterministic test fixtures.

20.2 Compatibility

Test supported Python versions and relevant operating systems.

20.3 Optional Backends

Ensure optional dependencies remain optional.

20.4 Release Validation

Validate:

  • Wheel installation.
  • Source distribution.
  • CLI execution.
  • Core imports.
  • Examples.
  • Optional extras.

20.5 Security

Continue reviewing:

  • Dependencies.
  • Model archive loading.
  • Configuration parsing.
  • Native memory handling.

21. Proposed Developer Experience Improvements

Status: Proposed

21.1 Documentation

  • Expand API examples.
  • Improve architecture explanations.
  • Add troubleshooting guides.
  • Maintain runnable tutorials.
  • Explain limitations clearly.

21.2 CLI

Potential improvements:

  • More informative diagnostics.
  • Better environment reporting.
  • Clearer optional-backend errors.
  • Reproducibility summaries.

21.3 Contributor Experience

  • Focused starter issues.
  • Better test documentation.
  • Clear review expectations.
  • Consistent issue descriptions.

21.4 Educational Resources

Potential tutorials:

  • Building an autograd operation.
  • Implementing a neural network layer.
  • Understanding gradient flow.
  • Comparing CPU and CUDA execution.
  • Exporting models to ONNX.

22. Research and Experimental Directions

Status: Exploratory — Not Committed

Future research could investigate:

  • Additional neural network architectures.
  • New differentiable operations.
  • Optimized inference paths.
  • Improved mixed-precision execution.
  • Memory-efficient training techniques.
  • Expanded model interoperability.
  • More efficient distributed synchronization.

22.1 Research Proposal Requirements

A research proposal should identify:

  1. Problem statement.
  2. Expected benefit.
  3. Technical feasibility.
  4. Alternatives.
  5. Dependencies.
  6. Testing methodology.
  7. Compatibility impact.
  8. Maintenance cost.

22.2 Experimental Features

Experimental work should be clearly labeled and should not be presented as stable functionality.

22.3 Approval

Research proposals require normal technical review and maintainer approval before becoming committed roadmap items.


23. Milestone Acceptance Criteria

A roadmap milestone should have measurable completion criteria.

23.1 Recommended Template

# Milestone: Title

## Status

Proposed

## Objective

What will be achieved?

## Scope

What is included?

## Deliverables

- Deliverable 1
- Deliverable 2

## Verification

- Required tests
- Benchmark evidence
- Documentation evidence

## Dependencies

List prerequisites.

## Limitations

Describe exclusions.

## Acceptance Criteria

- [ ] Implementation complete
- [ ] Tests complete
- [ ] Documentation complete
- [ ] Maintainer review complete

## Decision

Pending

23.2 Completion Requirements

A milestone should be marked complete only when its approved acceptance criteria have been met.

23.3 Verification Evidence

Link:

  • Pull requests.
  • Tests.
  • Benchmarks.
  • Documentation.
  • Review decisions.

24. Contribution Opportunities

The original roadmap is complete, so contributors should use the current issue tracker to find active work.

24.1 Contribution Categories

  • Bug fixes.
  • Numerical testing.
  • Documentation.
  • Performance benchmarks.
  • CUDA validation.
  • Distributed systems testing.
  • ONNX compatibility.
  • Developer tooling.

24.2 Getting Started

git clone https://github.com/krishanth7/EveryO.git

cd EveryO

python -m venv .venv

python -m pip install -e ".[dev]"

Activate the virtual environment before installing dependencies.

24.3 Run Tests

python -m pytest -q

24.4 Check Code Quality

ruff check .

ruff format --check .

24.5 Submit a Contribution

Follow:

CONTRIBUTING.md


25. Roadmap Governance

EveryO is a maintainer-led project.

25.1 Who Decides?

The project maintainer sets technical direction and makes final decisions when consensus cannot be reached.

25.2 How to Propose Work

  • Open an issue for bounded improvements.
  • Use a discussion or design issue for architecture changes.
  • Describe trade-offs.
  • Identify compatibility impacts.
  • Provide verification criteria.

25.3 Roadmap Changes

Roadmap changes should be reviewed and documented.

25.4 Release Dates

A roadmap item does not guarantee a release date.

25.5 Authoritative Policy

GOVERNANCE.md


26. Progress Reporting

Progress should be measured against defined scope.

26.1 Original Roadmap

Original Feature Roadmap

Completed:   10
Total:       10
Completion: 100%

26.2 Proposed Next Stage

Next-Stage Engineering Program

Status: Not approved as a formal roadmap

Priorities:
- Hardware validation
- Cross-host testing
- Reliability
- Performance
- Compatibility
- Documentation

No completion percentage is assigned to the proposed program because its scope and milestones have not been approved.

26.3 Reporting Guidelines

Each progress update should distinguish:

  • Implemented.
  • Tested.
  • Verified on required hardware.
  • Under review.
  • Proposed.
  • Deferred.

26.4 Evidence

Use links to actual source changes and test results.

Do not fabricate completion dates, benchmarks, or validation results.


27. Official References

Resource Link
EveryO Repository GitHub
Original Roadmap README.md
Changelog CHANGELOG.md
Project Configuration pyproject.toml
Architecture docs/architecture.md
Autograd docs/autograd.md
CUDA docs/cuda.md
Scaling docs/scaling.md
API Reference docs/api-reference.md
Examples examples
Tests tests
Issues GitHub Issues
Pull Requests GitHub Pull Requests
Governance GOVERNANCE.md
Contributing CONTRIBUTING.md
Security SECURITY.md

28. Next Steps

Continue with EveryO's community and support documentation.

Wiki Page Focus
Support and Troubleshooting Getting help and resolving common issues
Frequently Asked Questions Common technical questions
Project Governance Decision-making and project leadership
Contributing Contributor onboarding
Release Process Release validation and publishing

Wiki links become active after the corresponding pages are created.


Roadmap — Documentation Prepared

Original Roadmap: 10 / 10 Implemented

Next Recommended Page: Support and Troubleshooting →

Home · Framework Architecture · Project Governance


EveryO — Open Machine Learning. Built for Developers.

Project Maintainer: @krishanth7

Open Source · MIT Licensed · Community Driven

© 2026 EveryO Contributors

Clone this wiki locally