Skip to content

Conversation

@aymkhalil
Copy link
Contributor

@aymkhalil aymkhalil commented Feb 25, 2023

This patch is setup the first backfill e2e test. What's remaining:

  1. [Done] Restore the CI test matrix
  2. [Done] Run tests against C3/DSE
  3. [Future PR]Add PK + Clustering column tests
  4. [Future PR] Enable java17 tests

@aymkhalil aymkhalil changed the base branch from master to cvs-to-cql February 25, 2023 00:55
// given
Config connectorConfig = createConnectorConfigs("sample-001.csv");
connector.configure(connectorConfig, true, true);
connector.init();
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why are we removing this ?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

in DSBulk, the init() is responsible for calculating the directory/file structure of the exported table so the init should happen lazily. I moved it to when the actual import is called - will add unit tests for it. Alternatively I can keep it here and just inject a factory class into the importer.

@aymkhalil aymkhalil force-pushed the e2e-tests branch 2 times, most recently from d9eb832 to 67349b4 Compare February 28, 2023 21:55
@aymkhalil aymkhalil changed the title [WIP] Bootstrap CDC backfill CLI e2e tests Bootstrap CDC backfill CLI e2e tests Mar 1, 2023
@aymkhalil aymkhalil changed the base branch from cvs-to-cql to master March 1, 2023 01:21
@aymkhalil aymkhalil marked this pull request as ready for review March 1, 2023 01:42
@aymkhalil aymkhalil merged commit c2172ca into master Mar 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants