2023-02-12 12:22:05 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/112895/0/logs.log 2023-02-12 12:22:05 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.14 2023-02-12 12:22:05 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-12 12:22:05 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2023-02-12 12:22:05 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-12 12:22:05 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-facebook-marketing:0.2.83 exists... 2023-02-12 12:22:05 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-facebook-marketing:0.2.83 was found locally. 2023-02-12 12:22:05 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-facebook-marketing-check-112895-0-suhwt with resources io.airbyte.config.ResourceRequirements@6a807cb2[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-02-12 12:22:05 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/112895/0 --log-driver none --name source-facebook-marketing-check-112895-0-suhwt --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-facebook-marketing:0.2.83 -e AIRBYTE_VERSION=0.40.14 -e WORKER_JOB_ID=112895 airbyte/source-facebook-marketing:0.2.83 check --config source_config.json 2023-02-12 12:22:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - Select account { "account_id":"**********", "id": "act_2206907162749451" } 2023-02-12 12:22:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - Check succeeded 2023-02-12 12:22:06 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2023-02-12 12:22:06 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-12 12:22:06 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2023-02-12 12:22:06 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-12 12:22:06 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/112895/0/logs.log 2023-02-12 12:22:06 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.14 2023-02-12 12:22:06 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-12 12:22:06 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2023-02-12 12:22:06 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-12 12:22:06 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-redshift:0.3.50 exists... 2023-02-12 12:22:06 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-redshift:0.3.50 was found locally. 2023-02-12 12:22:06 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-redshift-check-112895-0-isysp with resources io.airbyte.config.ResourceRequirements@6a807cb2[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-02-12 12:22:06 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/112895/0 --log-driver none --name destination-redshift-check-112895-0-isysp --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-redshift:0.3.50 -e AIRBYTE_VERSION=0.40.14 -e WORKER_JOB_ID=112895 airbyte/destination-redshift:0.3.50 check --config source_config.json 2023-02-12 12:22:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2023-02-12 12:22:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - integration args: {check=null, config=source_config.json} 2023-02-12 12:22:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2023-02-12 12:22:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - Command: CHECK 2023-02-12 12:22:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-02-12 12:22:08 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):106 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-02-12 12:22:08 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):106 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-02-12 12:22:08 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):106 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-02-12 12:22:08 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):106 - The "standard" upload mode is not performant, and is not recommended for production. Please use the Amazon S3 upload mode if you are syncing a large amount of data. 2023-02-12 12:22:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - Using destination type: STANDARD 2023-02-12 12:22:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - HikariPool-1 - Starting... 2023-02-12 12:22:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - HikariPool-1 - Start completed. 2023-02-12 12:22:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.) 2023-02-12 12:22:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - HikariPool-1 - Shutdown initiated... 2023-02-12 12:22:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - HikariPool-1 - Shutdown completed. 2023-02-12 12:22:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2023-02-12 12:22:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):109 - completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2023-02-12 12:22:10 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2023-02-12 12:22:10 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-12 12:22:10 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2023-02-12 12:22:10 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-12 12:22:10 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/112895/0/logs.log 2023-02-12 12:22:10 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.14 2023-02-12 12:22:10 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):50 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2023-02-12 12:22:10 INFO i.a.c.EnvConfigs(getEnvOrDefault):1091 - Using default value for environment variable METRIC_CLIENT: '' 2023-02-12 12:22:10 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-02-12 12:22:11 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):50 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2023-02-12 12:22:11 INFO i.a.w.g.DefaultReplicationWorker(run):122 - start sync worker. job id: 112895 attempt id: 0 2023-02-12 12:22:11 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-12 12:22:11 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2023-02-12 12:22:11 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-12 12:22:11 INFO i.a.w.g.DefaultReplicationWorker(run):135 - configured sync modes: {null.ads_insights_platform_and_device=incremental - append, null.ads_insights=incremental - append, null.ads_insights_region=incremental - append, null.ads_insights_country=incremental - append} 2023-02-12 12:22:11 INFO i.a.w.i.DefaultAirbyteDestination(start):65 - Running destination... 2023-02-12 12:22:11 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-redshift:0.3.50 exists... 2023-02-12 12:22:11 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-redshift:0.3.50 was found locally. 2023-02-12 12:22:11 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-redshift-write-112895-0-ezivq with resources io.airbyte.config.ResourceRequirements@1ae36d57[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-02-12 12:22:11 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/112895/0 --log-driver none --name destination-redshift-write-112895-0-ezivq --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-redshift:0.3.50 -e AIRBYTE_VERSION=0.40.14 -e WORKER_JOB_ID=112895 airbyte/destination-redshift:0.3.50 write --config destination_config.json --catalog destination_catalog.json 2023-02-12 12:22:11 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-facebook-marketing:0.2.83 exists... 2023-02-12 12:22:11 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-facebook-marketing:0.2.83 was found locally. 2023-02-12 12:22:11 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-facebook-marketing-read-112895-0-jaeyv with resources io.airbyte.config.ResourceRequirements@4cd92f28[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-02-12 12:22:11 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/112895/0 --log-driver none --name source-facebook-marketing-read-112895-0-jaeyv --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-facebook-marketing:0.2.83 -e AIRBYTE_VERSION=0.40.14 -e WORKER_JOB_ID=112895 airbyte/source-facebook-marketing:0.2.83 read --config source_config.json --catalog source_catalog.json --state input_state.json 2023-02-12 12:22:11 INFO i.a.w.g.DefaultReplicationWorker(run):177 - Waiting for source and destination threads to complete. 2023-02-12 12:22:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):435 - Destination output thread started. 2023-02-12 12:22:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):322 - Replication thread started. 2023-02-12 12:22:12 source > Starting syncing SourceFacebookMarketing 2023-02-12 12:22:12 source > Syncing stream: ads_insights 2023-02-12 12:22:12 source > The cursor value within refresh period (4 days), start sync from 2023-02-08 instead. 2023-02-12 12:22:12 source > Setting state of ads_insights stream to {'time_increment': 1, 'date_start': '2023-02-12', 'slices': []} 2023-02-12 12:22:12 source > The cursor value within refresh period (4 days), start sync from 2023-02-08 instead. 2023-02-12 12:22:12 source > The cursor value within refresh period (4 days), start sync from 2023-02-08 instead. 2023-02-12 12:22:12 destination > starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2023-02-12 12:22:13 destination > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-02-12 12:22:13 destination > Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2023-02-12 12:22:13 destination > Command: WRITE 2023-02-12 12:22:13 destination > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-02-12 12:22:13 destination > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-02-12 12:22:13 destination > Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-02-12 12:22:13 destination > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-02-12 12:22:13 destination > The "standard" upload mode is not performant, and is not recommended for production. Please use the Amazon S3 upload mode if you are syncing a large amount of data. 2023-02-12 12:22:13 destination > Using destination type: STANDARD 2023-02-12 12:22:13 destination > HikariPool-1 - Starting... 2023-02-12 12:22:13 destination > HikariPool-1 - Start completed. 2023-02-12 12:22:13 destination > Write config: WriteConfig{streamName=fbadsmain-ads_insights, namespace=null, outputSchemaName=raw_data, tmpTableName=_airbyte_tmp_qud_fbadsmain_ads_insights, outputTableName=_airbyte_raw_fbadsmain_ads_insights, syncMode=append} 2023-02-12 12:22:13 destination > Write config: WriteConfig{streamName=fbadsmain-ads_insights_country, namespace=null, outputSchemaName=raw_data, tmpTableName=_airbyte_tmp_ywd_fbadsmain_ads_insights_country, outputTableName=_airbyte_raw_fbadsmain_ads_insights_country, syncMode=append} 2023-02-12 12:22:13 destination > Write config: WriteConfig{streamName=fbadsmain-ads_insights_platform_and_device, namespace=null, outputSchemaName=raw_data, tmpTableName=_airbyte_tmp_ufy_fbadsmain_ads_insights_platform_and_device, outputTableName=_airbyte_raw_fbadsmain_ads_insights_platform_and_device, syncMode=append} 2023-02-12 12:22:13 destination > Write config: WriteConfig{streamName=fbadsmain-ads_insights_region, namespace=null, outputSchemaName=raw_data, tmpTableName=_airbyte_tmp_owq_fbadsmain_ads_insights_region, outputTableName=_airbyte_raw_fbadsmain_ads_insights_region, syncMode=append} 2023-02-12 12:22:13 destination > class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-02-12 12:22:13 destination > Preparing tmp tables in destination started for 4 streams 2023-02-12 12:22:13 destination > Preparing tmp table in destination started for stream fbadsmain-ads_insights. schema: raw_data, tmp table name: _airbyte_tmp_qud_fbadsmain_ads_insights 2023-02-12 12:22:13 source > InsightAsyncJob(id=480194247472612, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-08]>, breakdowns=[]): created AdReportRun 2023-02-12 12:22:14 destination > HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.) 2023-02-12 12:22:14 source > InsightAsyncJob(id=877339860152512, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-09]>, breakdowns=[]): created AdReportRun 2023-02-12 12:22:14 destination > Preparing tmp table in destination started for stream fbadsmain-ads_insights_country. schema: raw_data, tmp table name: _airbyte_tmp_ywd_fbadsmain_ads_insights_country 2023-02-12 12:22:15 destination > Preparing tmp table in destination started for stream fbadsmain-ads_insights_platform_and_device. schema: raw_data, tmp table name: _airbyte_tmp_ufy_fbadsmain_ads_insights_platform_and_device 2023-02-12 12:22:15 destination > Preparing tmp table in destination started for stream fbadsmain-ads_insights_region. schema: raw_data, tmp table name: _airbyte_tmp_owq_fbadsmain_ads_insights_region 2023-02-12 12:22:15 source > InsightAsyncJob(id=493007046362746, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-10]>, breakdowns=[]): created AdReportRun 2023-02-12 12:22:15 destination > Preparing tables in destination completed. 2023-02-12 12:22:16 source > InsightAsyncJob(id=588403066089971, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-11]>, breakdowns=[]): created AdReportRun 2023-02-12 12:22:17 source > InsightAsyncJob(id=623240036233660, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-12]>, breakdowns=[]): created AdReportRun 2023-02-12 12:22:17 source > Added: 5 jobs. Current throttle limit is MyFacebookAdsApi.Throttle(per_application=0.08, per_account=17.67), 5/100 job(s) in queue 2023-02-12 12:22:17 source > InsightAsyncJob(id=480194247472612, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-08]>, breakdowns=[]): is 0 complete (Job Started) 2023-02-12 12:22:17 source > InsightAsyncJob(id=877339860152512, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-09]>, breakdowns=[]): is 0 complete (Job Not Started) 2023-02-12 12:22:17 source > InsightAsyncJob(id=493007046362746, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-10]>, breakdowns=[]): is 0 complete (Job Started) 2023-02-12 12:22:17 source > InsightAsyncJob(id=588403066089971, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-11]>, breakdowns=[]): is 0 complete (Job Started) 2023-02-12 12:22:17 source > InsightAsyncJob(id=623240036233660, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-12]>, breakdowns=[]): is 0 complete (Job Not Started) 2023-02-12 12:22:17 source > Completed jobs: 0, Failed jobs: 0, Running jobs: 5 2023-02-12 12:22:17 source > No jobs ready to be consumed, wait for 30 seconds 2023-02-12 12:22:47 source > InsightAsyncJob(id=480194247472612, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-08]>, breakdowns=[]): is 96 complete (Job Running) 2023-02-12 12:22:47 source > InsightAsyncJob(id=877339860152512, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-09]>, breakdowns=[]): is 0 complete (Job Running) 2023-02-12 12:22:47 source > InsightAsyncJob(id=493007046362746, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-10]>, breakdowns=[]): is 96 complete (Job Running) 2023-02-12 12:22:47 source > InsightAsyncJob(id=588403066089971, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-11]>, breakdowns=[]): is 92 complete (Job Running) 2023-02-12 12:22:47 source > InsightAsyncJob(id=623240036233660, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-12]>, breakdowns=[]): is 100 complete (Job Running) 2023-02-12 12:22:47 source > Completed jobs: 0, Failed jobs: 0, Running jobs: 5 2023-02-12 12:22:47 source > No jobs ready to be consumed, wait for 30 seconds 2023-02-12 12:23:18 source > InsightAsyncJob(id=480194247472612, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-08]>, breakdowns=[]): is 100 complete (Job Completed) 2023-02-12 12:23:18 source > InsightAsyncJob(id=877339860152512, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-09]>, breakdowns=[]): is 100 complete (Job Completed) 2023-02-12 12:23:18 source > InsightAsyncJob(id=493007046362746, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-10]>, breakdowns=[]): is 100 complete (Job Completed) 2023-02-12 12:23:18 source > InsightAsyncJob(id=588403066089971, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-11]>, breakdowns=[]): is 100 complete (Job Completed) 2023-02-12 12:23:18 source > InsightAsyncJob(id=623240036233660, { "account_id":"**********", "id": "act_2206907162749451" }, time_range= 2023-02-12]>, breakdowns=[]): is 100 complete (Job Completed) 2023-02-12 12:23:18 source > Completed jobs: 5, Failed jobs: 0, Running jobs: 0 2023-02-12 12:23:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 1000 (2 MB) 2023-02-12 12:24:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 2000 (2 MB) 2023-02-12 12:24:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 3000 (5 MB) 2023-02-12 12:24:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 4000 (5 MB) 2023-02-12 12:25:05 destination > Flushing fbadsmain-ads_insights: 4491 records (24 MB) 2023-02-12 12:25:05 destination > actual size of batch: 4491 2023-02-12 12:25:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 5000 (6 MB) 2023-02-12 12:25:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 6000 (8 MB) 2023-02-12 12:26:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 7000 (9 MB) 2023-02-12 12:26:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 8000 (10 MB) 2023-02-12 12:26:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 9000 (12 MB) 2023-02-12 12:27:01 destination > Flushing fbadsmain-ads_insights: 5114 records (24 MB) 2023-02-12 12:27:01 destination > actual size of batch: 5114 2023-02-12 12:27:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 10000 (13 MB) 2023-02-12 12:27:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 11000 (14 MB) 2023-02-12 12:27:43 source > Utilization is too high (93)%, pausing for 1 minute 2023-02-12 12:28:45 source > Utilization is too high (94)%, pausing for 1 minute 2023-02-12 12:29:47 source > Utilization is too high (95)%, pausing for 5 minutes 2023-02-12 12:34:49 source > Utilization is too high (95)%, pausing for 5 minutes 2023-02-12 12:39:52 source > Utilization is too high (96)%, pausing for 5 minutes 2023-02-12 12:44:55 source > Utilization is too high (98)%, pausing for 5 minutes 2023-02-12 12:49:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 12000 (15 MB) 2023-02-12 12:50:02 source > Utilization is too high (98)%, pausing for 5 minutes 2023-02-12 12:55:05 source > Backing off call(...) for 5.0s (facebook_business.exceptions.FacebookRequestError: Message: Call was not successful Method: GET Path: https://graph.facebook.com/v15.0/623240036233660/insights?access_token=****&limit=100&after=MTE5OQZDZD Params: {} Status: 400 Response: { "error": { "message": "(#80000) There have been too many calls from this ad-account. Wait a bit and try again. For more info, please refer to https://developers.facebook.com/docs/graph-api/overview/rate-limiting.", "type": "OAuthException", "code": 80000, "error_subcode": 2446079, "fbtrace_id": "AKCipaUzf3ONG6Cm5CbIQt2" } }) 2023-02-12 12:55:05 source > Message: Call was not successful Method: GET Path: https://graph.facebook.com/v15.0/623240036233660/insights?access_token=****&limit=100&after=MTE5OQZDZD Params: {} Status: 400 Response: { "error": { "message": "(#80000) There have been too many calls from this ad-account. Wait a bit and try again. For more info, please refer to https://developers.facebook.com/docs/graph-api/overview/rate-limiting.", "type": "OAuthException", "code": 80000, "error_subcode": 2446079, "fbtrace_id": "AKCipaUzf3ONG6Cm5CbIQt2" } } 2023-02-12 12:55:05 source > Caught retryable error after 1 tries. Waiting 5 more seconds then retrying... 2023-02-12 12:55:12 source > Backing off call(...) for 10.0s (facebook_business.exceptions.FacebookRequestError: Message: Call was not successful Method: GET Path: https://graph.facebook.com/v15.0/623240036233660/insights?access_token=****&limit=100&after=MTE5OQZDZD Params: {} Status: 400 Response: { "error": { "message": "(#80000) There have been too many calls from this ad-account. Wait a bit and try again. For more info, please refer to https://developers.facebook.com/docs/graph-api/overview/rate-limiting.", "type": "OAuthException", "code": 80000, "error_subcode": 2446079, "fbtrace_id": "Ap3OY6clSFDW4Tm9iHo_RqC" } }) 2023-02-12 12:55:12 source > Message: Call was not successful Method: GET Path: https://graph.facebook.com/v15.0/623240036233660/insights?access_token=****&limit=100&after=MTE5OQZDZD Params: {} Status: 400 Response: { "error": { "message": "(#80000) There have been too many calls from this ad-account. Wait a bit and try again. For more info, please refer to https://developers.facebook.com/docs/graph-api/overview/rate-limiting.", "type": "OAuthException", "code": 80000, "error_subcode": 2446079, "fbtrace_id": "Ap3OY6clSFDW4Tm9iHo_RqC" } } 2023-02-12 12:55:12 source > Caught retryable error after 2 tries. Waiting 10 more seconds then retrying... 2023-02-12 12:55:23 source > Backing off call(...) for 20.0s (facebook_business.exceptions.FacebookRequestError: Message: Call was not successful Method: GET Path: https://graph.facebook.com/v15.0/623240036233660/insights?access_token=****&limit=100&after=MTE5OQZDZD Params: {} Status: 400 Response: { "error": { "message": "(#80000) There have been too many calls from this ad-account. Wait a bit and try again. For more info, please refer to https://developers.facebook.com/docs/graph-api/overview/rate-limiting.", "type": "OAuthException", "code": 80000, "error_subcode": 2446079, "fbtrace_id": "AC-YKN-6xWOTjENr803Swvd" } }) 2023-02-12 12:55:23 source > Message: Call was not successful Method: GET Path: https://graph.facebook.com/v15.0/623240036233660/insights?access_token=****&limit=100&after=MTE5OQZDZD Params: {} Status: 400 Response: { "error": { "message": "(#80000) There have been too many calls from this ad-account. Wait a bit and try again. For more info, please refer to https://developers.facebook.com/docs/graph-api/overview/rate-limiting.", "type": "OAuthException", "code": 80000, "error_subcode": 2446079, "fbtrace_id": "AC-YKN-6xWOTjENr803Swvd" } } 2023-02-12 12:55:23 source > Caught retryable error after 3 tries. Waiting 20 more seconds then retrying... 2023-02-12 12:55:31 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):197 - Running sync worker cancellation... 2023-02-12 12:55:31 INFO i.a.w.g.DefaultReplicationWorker(cancel):473 - Cancelling replication worker... 2023-02-12 12:55:41 INFO i.a.w.g.DefaultReplicationWorker(cancel):481 - Cancelling destination... 2023-02-12 12:55:41 INFO i.a.w.i.DefaultAirbyteDestination(cancel):121 - Attempting to cancel destination process... 2023-02-12 12:55:41 INFO i.a.w.i.DefaultAirbyteDestination(cancel):126 - Destination process exists, cancelling... 2023-02-12 12:55:41 INFO i.a.w.g.DefaultReplicationWorker(run):182 - One of source or destination thread complete. Waiting on the other. 2023-02-12 12:55:41 WARN i.a.c.i.LineGobbler(voidCall):119 - airbyte-destination gobbler IOException: Stream closed. Typically happens when cancelling a job. 2023-02-12 12:55:41 INFO i.a.w.i.DefaultAirbyteDestination(cancel):128 - Cancelled destination process! 2023-02-12 12:55:41 INFO i.a.w.g.DefaultReplicationWorker(cancel):488 - Cancelling source... 2023-02-12 12:55:41 INFO i.a.w.i.DefaultAirbyteSource(cancel):141 - Attempting to cancel source process... 2023-02-12 12:55:41 INFO i.a.w.i.DefaultAirbyteSource(cancel):146 - Source process exists, cancelling... 2023-02-12 12:55:41 INFO i.a.w.g.DefaultReplicationWorker(run):184 - Source and destination threads complete. 2023-02-12 12:55:41 INFO i.a.w.i.DefaultAirbyteSource(cancel):148 - Cancelled source process! 2023-02-12 12:55:41 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):201 - Interrupting worker thread... 2023-02-12 12:55:41 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):204 - Cancelling completable future... 2023-02-12 12:55:41 ERROR i.a.w.g.DefaultReplicationWorker(run):188 - Sync worker failed. io.airbyte.workers.exception.WorkerException: Source process exit with code 143. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:135) ~[io.airbyte-airbyte-workers-0.40.14.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:186) ~[io.airbyte-airbyte-workers-0.40.14.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:68) ~[io.airbyte-airbyte-workers-0.40.14.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.40.14.jar:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] Suppressed: java.io.IOException: Stream closed at java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:445) ~[?:?] at java.io.OutputStream.write(OutputStream.java:162) ~[?:?] at java.io.BufferedOutputStream.write(BufferedOutputStream.java:123) ~[?:?] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:234) ~[?:?] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:304) ~[?:?] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282) ~[?:?] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:132) ~[?:?] at java.io.OutputStreamWriter.write(OutputStreamWriter.java:205) ~[?:?] at java.io.BufferedWriter.flushBuffer(BufferedWriter.java:120) ~[?:?] at java.io.BufferedWriter.flush(BufferedWriter.java:256) ~[?:?] at io.airbyte.workers.internal.DefaultAirbyteDestination.notifyEndOfInput(DefaultAirbyteDestination.java:94) ~[io.airbyte-airbyte-workers-0.40.14.jar:?] at io.airbyte.workers.internal.DefaultAirbyteDestination.close(DefaultAirbyteDestination.java:107) ~[io.airbyte-airbyte-workers-0.40.14.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:145) ~[io.airbyte-airbyte-workers-0.40.14.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:68) ~[io.airbyte-airbyte-workers-0.40.14.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.40.14.jar:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] 2023-02-12 12:55:41 WARN i.a.c.t.CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):53 - Job either timed out or was cancelled. 2023-02-12 12:55:41 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2023-02-12 12:55:41 WARN i.a.c.t.CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):53 - Job either timed out or was cancelled. 2023-02-12 12:55:41 INFO i.a.w.g.DefaultReplicationWorker(run):279 - Source output at least one state message 2023-02-12 12:55:41 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):280 - Stopping temporal heartbeating... 2023-02-12 12:55:41 WARN i.a.w.g.DefaultReplicationWorker(run):289 - State capture: No new state, falling back on input state: io.airbyte.config.State@37f73b41[state=[{"type":"STREAM","stream":{"stream_state":{"slices":[],"date_start":"2023-02-12","time_increment":1},"stream_descriptor":{"name":"ads_insights"}}},{"type":"STREAM","stream":{"stream_state":{"slices":[],"date_start":"2023-02-12","time_increment":1},"stream_descriptor":{"name":"ads_insights_country"}}},{"type":"STREAM","stream":{"stream_state":{"slices":[],"date_start":"2023-02-12","time_increment":1},"stream_descriptor":{"name":"ads_insights_platform_and_device"}}},{"type":"STREAM","stream":{"stream_state":{"slices":[],"date_start":"2023-02-12","time_increment":1},"stream_descriptor":{"name":"ads_insights_region"}}}]] 2023-02-12 12:55:41 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=d5c79c93-4fac-3b45-9cd4-5e4363020bea, activityType=Replicate, attempt=1 java.lang.RuntimeException: java.util.concurrent.CancellationException at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:278) ~[io.airbyte-airbyte-commons-temporal-0.40.14.jar:?] at io.airbyte.workers.temporal.sync.ReplicationActivityImpl.replicate(ReplicationActivityImpl.java:110) ~[io.airbyte-airbyte-workers-0.40.14.jar:?] at jdk.internal.reflect.GeneratedMethodAccessor440.invoke(Unknown Source) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] Caused by: java.util.concurrent.CancellationException at java.util.concurrent.CompletableFuture.cancel(CompletableFuture.java:2478) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getCancellationChecker$3(TemporalAttemptExecution.java:207) ~[io.airbyte-airbyte-workers-0.40.14.jar:?] at io.airbyte.commons.temporal.CancellationHandler$TemporalCancellationHandler.checkAndHandleCancellation(CancellationHandler.java:52) ~[io.airbyte-airbyte-commons-temporal-0.40.14.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getCancellationChecker$4(TemporalAttemptExecution.java:210) ~[io.airbyte-airbyte-workers-0.40.14.jar:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) ~[?:?] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) ~[?:?] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) ~[?:?] ... 3 more 2023-02-12 12:55:41 INFO i.a.w.g.DefaultReplicationWorker(run):300 - sync summary: { "status" : "cancelled", "recordsSynced" : 12106, "bytesSynced" : 16637241, "startTime" : 1676204531019, "endTime" : 1676206541175, "totalStats" : { "recordsEmitted" : 12106, "bytesEmitted" : 16637241, "sourceStateMessagesEmitted" : 4, "destinationStateMessagesEmitted" : 0, "recordsCommitted" : 0, "meanSecondsBeforeSourceStateMessageEmitted" : 61, "maxSecondsBeforeSourceStateMessageEmitted" : 65, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0 }, "streamStats" : [ { "streamName" : "fbadsmain-ads_insights", "stats" : { "recordsEmitted" : 12106, "bytesEmitted" : 16637241 } } ] } 2023-02-12 12:55:41 INFO i.a.w.g.DefaultReplicationWorker(run):301 - failures: [ ] 2023-02-12 12:55:41 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-12 12:55:41 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2023-02-12 12:55:41 INFO i.a.c.i.LineGobbler(voidCall):114 -