Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CASSANDRA-19048 - Audit table properties passed through Analytics CqlUtils #21

Closed

Conversation

JeetKunDoug
Copy link
Contributor

The following properties have an effect on the files generated by the bulk writer, and therefore need to be retained when cleaning the table schema:

bloom_filter_fp_chance
cdc
compression
default_time_to_live
min_index_interval
max_index_interval

Additionally, this commit adds tests to make sure all available TTL paths, including table default TTLs and constant/per-row options, work as designed.

…Utils

The following properties have an effect on the files generated by the
bulk writer, and therefore need to be retained when cleaning the table
schema:

bloom_filter_fp_chance
cdc
compression
default_time_to_live
min_index_interval
max_index_interval

Additionally, this commit adds tests to make sure all available TTL
paths, including table default TTLs and constant/per-row options, work
as designed.
Copy link
Contributor

@frankgh frankgh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, there are a couple of places where it looks like there's some minor cleaning up to do

String actualCreateStmt = CqlUtils.extractTableSchema(schemaStr, "keyspace", "table");
assert expectedCreateStmt.equals(actualCreateStmt);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what! 👍

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This comment in isolation got me totally confused - thought I literally just removed an assert, and you gave it a 👍 😃

.withTable(table)
.withSidecarPort(server.actualPort())
.withExtraWriterOptions(Collections.emptyMap())
// .withPostWriteDfMods(writeToReadDfFunc(addTTLColumn, addTimestampColumn))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cleanup?

.withTable(table)
.withSidecarPort(server.actualPort())
.withExtraWriterOptions(writerOptions)
// .withPostWriteDatasetModifier(writeToReadDfFunc(addTTLColumn, addTimestampColumn))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cleanup?

@JeetKunDoug
Copy link
Contributor Author

Committed in c73c764

@JeetKunDoug JeetKunDoug deleted the add_new_allowlisted_table_props branch November 30, 2023 15:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants