You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Schema changes are detected, need to cache previous log state in memory for a few seconds on ingestion nodes (inconsistency is ok as long as data type is the same because they will be compacted and deduplicated if same column name)
Track schema on ingest
If take not of schema changes
Cache current schema in memory
Have background process for refreshing known in-memory schema from log (set interval, 0 is off)
The text was updated successfully, but these errors were encountered:
danthegoodman1
changed the title
Track schema (and changes) in log file, can cache state locally on ingestors but should refresh from log because of concurrent ingestors
Track schema (and changes) in log file
Aug 2, 2023
Schema changes are detected, need to cache previous log state in memory for a few seconds on ingestion nodes (inconsistency is ok as long as data type is the same because they will be compacted and deduplicated if same column name)
The text was updated successfully, but these errors were encountered: