Migrate the monorepo to Node.js

[taras]

Motivation

Complete the Node.js migration for the effectionx repository, enabling all packages to run in Node.js environments. This also consolidates CI workflows for better maintainability and fixes Windows-specific process handling issues.

Approach

Effection Compatibility Testing

Added a compatibility test runner that tests packages against the minimum and maximum Effection versions declared by each package's peerDependencies.

┌─────────────────────────────────────────────────────────────────────────────┐
│                     Effection Compatibility Test Runner                     │
└─────────────────────────────────────────────────────────────────────────────┘
                                      │
                                      ▼
┌─────────────────────────────────────────────────────────────────────────────┐
│  1. RESOLVE VERSION GROUPS                                                  │
│  ┌────────────────────────────────────────────────────────────────────────┐ │
│  │  Read pnpm-workspace.yaml                                              │ │
│  │       │                                                                │ │
│  │       ▼                                                                │ │
│  │  For each package:                                                     │ │
│  │    • Read package.json → peerDependencies.effection                    │ │
│  │    • Fetch all effection versions from npm                             │ │
│  │    • Resolve min (semver.minVersion) and max (semver.maxSatisfying)    │ │
│  │       │                                                                │ │
│  │       ▼                                                                │ │
│  │  Group packages by version:                                            │ │
│  │    version 3.0.0 → [pkg-a, pkg-b, pkg-c, ...]                          │ │
│  │    version 4.0.0 → [pkg-a, pkg-b, pkg-c, ...]                          │ │
│  └────────────────────────────────────────────────────────────────────────┘ │
└─────────────────────────────────────────────────────────────────────────────┘
                                      │
                                      ▼
┌─────────────────────────────────────────────────────────────────────────────┐
│  2. FOR EACH VERSION GROUP                                                  │
│  ┌────────────────────────────────────────────────────────────────────────┐ │
│  │                         ┌──────────────────┐                           │ │
│  │                         │ Version: 3.0.0   │                           │ │
│  │                         │ Packages: [...]  │                           │ │
│  │                         └────────┬─────────┘                           │ │
│  │                                  │                                     │ │
│  │    ┌─────────────────────────────┼─────────────────────────────┐       │ │
│  │    │                             ▼                             │       │ │
│  │    │  [1/3] Set pnpm override                                  │       │ │
│  │    │        pnpm config set pnpm.overrides.effection=3.0.0     │       │ │
│  │    │                             │                             │       │ │
│  │    │                             ▼                             │       │ │
│  │    │  [2/3] Install dependencies                               │       │ │
│  │    │        pnpm install --no-frozen-lockfile                  │       │ │
│  │    │                             │                             │       │ │
│  │    │                             ▼                             │       │ │
│  │    │  [3/3] Run tests with TAP output                          │       │ │
│  │    │        node --test packages/**/test/*.test.ts             │       │ │
│  │    └─────────────────────────────┬─────────────────────────────┘       │ │
│  │                                  │                                     │ │
│  │                                  ▼                                     │ │
│  │                         ┌──────────────────┐                           │ │
│  │                         │ Version: 4.0.0   │                           │ │
│  │                         │ Packages: [...]  │                           │ │
│  │                         └────────┬─────────┘                           │ │
│  │                                  │                                     │ │
│  │                            (repeat...)                                 │ │
│  └────────────────────────────────────────────────────────────────────────┘ │
└─────────────────────────────────────────────────────────────────────────────┘
                                      │
                                      ▼
┌─────────────────────────────────────────────────────────────────────────────┐
│  3. CLEANUP                                                                 │
│  ┌────────────────────────────────────────────────────────────────────────┐ │
│  │  • Remove .npmrc (created by pnpm config set)                          │ │
│  │  • Reinstall with original lockfile                                    │ │
│  └────────────────────────────────────────────────────────────────────────┘ │
└─────────────────────────────────────────────────────────────────────────────┘

New Packages

• @effectionx/stream-yaml - Streaming YAML document parser for parsing multi-document YAML streams from string chunks
• @effectionx/fs - File and directory operations based on node:fs
• @effectionx/node - Node specific operations like fromReadable and on/once event emitter
• @effectionx/converge - Imported convergence library from BigTest 1.0 to use when convergence in tests.

Stream Helpers: fromReadable()

Added fromReadable() to @effectionx/stream-helpers for converting Node.js Readable streams to Effection Streams. This enables easy integration with Node.js file streams, HTTP responses, and other Readable streams.

import fs from "node:fs";
import { fromReadable } from "@effectionx/stream-helpers";
import { each } from "effection";

function* example() {
  const fileStream = fs.createReadStream("./data.txt");

  for (const chunk of yield* each(fromReadable(fileStream))) {
    console.log(new TextDecoder().decode(chunk));
    yield* each.next();
  }
}

Key features

• Added TAP parser (.internal/tap-parser.ts) for real-time test failure reporting
• Shows failures as they happen with detailed error info (stack traces, expected vs actual)
• Tests against both Effection 3.x and 4.x versions
• Summary table at end with pass/fail counts per version

CI Workflow Consolidation

• Consolidated verify-posix.yaml, verify-windows.yaml, and effection-compat.yaml into single test.yaml
• All jobs (lint, test-posix, test-windows) now run in parallel
• Windows tests use CMD shell instead of bash (fixes graceful process shutdown issues)

test.yaml
├── lint          (ubuntu) - fmt, lint, typecheck, tsrefs
├── test-posix    (ubuntu, macos) - build, test, test:effection
└── test-windows  (windows/cmd) - build, test, test:effection

Windows Process Handling Fixes

• Fixed EPIPE errors when killing processes on Windows
• Added error handler on stdin to suppress EPIPE during cleanup
• Added error handler on stdout/stderr readable streams

Internal Tooling

• Moved build scripts from tasks/ to .internal/
• Added sync-tsrefs.ts for managing TypeScript project references
• Improved publish workflow with matrix generation

Testing

• All 153+ tests pass on Ubuntu, macOS, and Windows
• Effection compatibility tests pass for both 3.x and 4.x

[cowboyd]

Looks good. My only question is if we should extends the packages to be compatible with e4

[pkg-pr-new]

Open in StackBlitz

@effectionx/bdd

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/bdd@104

@effectionx/chain

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/chain@104

@effectionx/context-api

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/context-api@104

@effectionx/converge

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/converge@104

@effectionx/fs

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/fs@104

@effectionx/fx

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/fx@104

@effectionx/jsonl-store

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/jsonl-store@104

@effectionx/node

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/node@104

@effectionx/process

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/process@104

@effectionx/raf

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/raf@104

@effectionx/signals

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/signals@104

@effectionx/stream-helpers

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/stream-helpers@104

@effectionx/stream-yaml

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/stream-yaml@104

@effectionx/task-buffer

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/task-buffer@104

@effectionx/test-adapter

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/test-adapter@104

@effectionx/timebox

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/timebox@104

@effectionx/tinyexec

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/tinyexec@104

@effectionx/watch

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/watch@104

@effectionx/websocket

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/websocket@104

@effectionx/worker

npm i https://pkg.pr.new/thefrontside/effectionx/@effectionx/worker@104

commit: 475da13