Skip to content

Formalize io exec node contracts #687

@changhiskhan

Description

@changhiskhan

Currently there's no formal contract for the input/output of an exec node. This causes mismatches between node.schema and the schema of the record batches from the schema (because node.schema is not guaranteed to match output or the input).

An example of brittleness and hacks that we have to build in is in #686

We should make it so that:

  1. Each exec node declares it's output schema formally
  2. Add unit tests to make sure the output schema is enforced
  3. Add integration tests to make sure the possible IO plans are valid

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions