Files

.github
DEVELOPMENT
add_column_BQ_ds
add_column_kafka_data_source
- datasources
- scripts
- .tinyenv
- README.md
- requirements.txt
add_column_snowflake_ds
add_column_to_s3_ds
add_new_column_to_a_materialized_view
add_new_column_with_values
add_nullable_column_to_landing_data_source
alter_column_to_nullable
alter_default_value_in_column
change_column_type_landing_and_recover_quarantine_data
change_column_type_materialized_view
change_copy_pipe_time_granularity
change_data_source_ttl
change_sorting_key_kafka_data_source
change_sorting_key_landing_data_source
create_a_materialized_view_batch_ingest
create_pipe_sink
create_s3_datasource
delete_column_snowflake_ds
delete_simple_resource
drop_column
iterating_api_endpoint
recover_data_from_quarantine
remove_column_landing_data_source
use_new_columns_from_shared_datasource
utils
.gitignore
README.md
requirements.txt

add_column_kafka_data_source

Update CLI to cli_5.0.0.dev0

Jun 11, 2024

006c944 · Jun 11, 2024

This branch is 1 commit ahead of, 27 commits behind main.

Name		Name	Last commit message	Last commit date
parent directory ..
datasources		datasources	add column to kafka data source	May 24, 2024
scripts		scripts	update	May 24, 2024
.tinyenv		.tinyenv	Init add column to kafka example	Jan 15, 2024
README.md		README.md	Update readme	May 24, 2024
requirements.txt		requirements.txt	Update CLI to cli_5.0.0.dev0	Jun 11, 2024

README.md

Add a new column to a Kafka Data Source

1st Create a Kafka Data Source

Pull Request #1

Create a new branch
Create a new Kafka Data Source (instructions)
Commit and wait for CI. You can check in the temporary CI branch that everything works as expected.
Merge and wait for CD.

2nd Kafka Data Source with the new column

Pull Request #2

Create another branch
Add the new column meta_image_v3 to the schema
[Optionally] Update fixtures
Commit and wait for CI. You can check in the temporary CI branch that everything works as expected.
Merge and wait for CD.

Internal workspace