Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Source Notion: When syncing, all streams are empty except Users #16987

Closed
philippeboyd opened this issue Sep 21, 2022 · 14 comments
Closed

Source Notion: When syncing, all streams are empty except Users #16987

philippeboyd opened this issue Sep 21, 2022 · 14 comments

Comments

@philippeboyd
Copy link
Contributor

philippeboyd commented Sep 21, 2022

Environment

  • Airbyte version: 0.40.7
  • OS Version / Instance: GCP
  • Deployment: Docker
  • Source Connector and version: Notion 0.1.8
  • Destination Connector and version: Snowflake 0.4.36
  • Step where error happened: Sync job

Current Behavior

Streams blocks, databases, and pages are not syncing

image

image

The 20 records synced correspond to the 20 users that we have on Notion

Expected Behavior

Synced Streams blocks, databases, and pages should not be empty

Logs

Logs
...
2022-09-21 01:56:25 �[32mINFO�[m i.a.w.g.DefaultReplicationWorker(run):135 - configured sync modes: {null.pages=full_refresh - overwrite, null.databases=full_refresh - overwrite, null.users=full_refresh - overwrite, null.blocks=full_refresh - overwrite}
2022-09-21 01:56:25 �[32mINFO�[m i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination...
2022-09-21 01:56:25 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-snowflake:0.4.36 exists...
2022-09-21 01:56:25 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-snowflake:0.4.36 was found locally.
2022-09-21 01:56:25 �[32mINFO�[m i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-snowflake-write-7626-0-fccvq with resources io.airbyte.config.ResourceRequirements@27ca2340[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=]
2022-09-21 01:56:25 �[32mINFO�[m i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/7626/0 --log-driver none --name destination-snowflake-write-7626-0-fccvq --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-snowflake:0.4.36 -e AIRBYTE_VERSION=0.40.7 -e WORKER_JOB_ID=7626 airbyte/destination-snowflake:0.4.36 write --config destination_config.json --catalog destination_catalog.json
2022-09-21 01:56:25 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-notion:0.1.8 exists...
2022-09-21 01:56:26 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-notion:0.1.8 was found locally.
2022-09-21 01:56:26 �[32mINFO�[m i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-notion-read-7626-0-cqiic with resources io.airbyte.config.ResourceRequirements@70f0c2a0[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=]
2022-09-21 01:56:26 �[32mINFO�[m i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/7626/0 --log-driver none --name source-notion-read-7626-0-cqiic --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-notion:0.1.8 -e AIRBYTE_VERSION=0.40.7 -e WORKER_JOB_ID=7626 airbyte/source-notion:0.1.8 read --config source_config.json --catalog source_catalog.json
2022-09-21 01:56:26 �[32mINFO�[m i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):435 - Destination output thread started.
2022-09-21 01:56:26 �[32mINFO�[m i.a.w.g.DefaultReplicationWorker(run):177 - Waiting for source and destination threads to complete.
2022-09-21 01:56:26 �[32mINFO�[m i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):322 - Replication thread started.
2022-09-21 01:56:28 �[43mdestination�[0m > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2022-09-21 01:56:28 �[43mdestination�[0m > Running integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination
2022-09-21 01:56:28 �[43mdestination�[0m > Command: WRITE
2022-09-21 01:56:28 �[43mdestination�[0m > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2022-09-21 01:56:28 �[44msource�[0m > Starting syncing SourceNotion
2022-09-21 01:56:28 �[44msource�[0m > Using start_date: 2022-01-01T00:00:00.000Z
2022-09-21 01:56:28 �[44msource�[0m > Syncing stream: blocks 
2022-09-21 01:56:28 �[43mdestination�[0m > Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-09-21 01:56:28 �[43mdestination�[0m > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-09-21 01:56:28 �[43mdestination�[0m > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-09-21 01:56:28 �[43mdestination�[0m > Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-09-21 01:56:28 �[43mdestination�[0m > Using destination type: INTERNAL_STAGING
2022-09-21 01:56:28 �[44msource�[0m > Read 0 records from blocks stream
2022-09-21 01:56:28 �[44msource�[0m > Finished syncing blocks
2022-09-21 01:56:28 �[44msource�[0m > SourceNotion runtimes:
Syncing stream blocks 0:00:00.279629
2022-09-21 01:56:28 �[44msource�[0m > Syncing stream: databases 
2022-09-21 01:56:29 �[43mdestination�[0m > Write config: WriteConfig{streamName=notion_blocks, namespace=null, outputSchemaName=RAW, tmpTableName=_airbyte_tmp_ctb_notion_blocks, outputTableName=_airbyte_raw_notion_blocks, syncMode=overwrite}
2022-09-21 01:56:29 �[43mdestination�[0m > Write config: WriteConfig{streamName=notion_databases, namespace=null, outputSchemaName=RAW, tmpTableName=_airbyte_tmp_veo_notion_databases, outputTableName=_airbyte_raw_notion_databases, syncMode=overwrite}
2022-09-21 01:56:29 �[43mdestination�[0m > Write config: WriteConfig{streamName=notion_pages, namespace=null, outputSchemaName=RAW, tmpTableName=_airbyte_tmp_ugr_notion_pages, outputTableName=_airbyte_raw_notion_pages, syncMode=overwrite}
2022-09-21 01:56:29 �[43mdestination�[0m > Write config: WriteConfig{streamName=notion_users, namespace=null, outputSchemaName=RAW, tmpTableName=_airbyte_tmp_vup_notion_users, outputTableName=_airbyte_raw_notion_users, syncMode=overwrite}
2022-09-21 01:56:29 �[43mdestination�[0m > class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2022-09-21 01:56:29 �[43mdestination�[0m > Preparing tmp tables in destination started for 4 streams
2022-09-21 01:56:29 �[43mdestination�[0m > Preparing staging area in destination started for schema RAW stream notion_blocks: tmp table: _airbyte_tmp_ctb_notion_blocks, stage: 2022/09/21/01/30B10FF0-8F2C-44CE-A531-0137AB8F5CF1/
2022-09-21 01:56:29 �[43mdestination�[0m > HikariPool-1 - Starting...
2022-09-21 01:56:29 �[44msource�[0m > Read 0 records from databases stream
2022-09-21 01:56:29 �[44msource�[0m > Finished syncing databases
2022-09-21 01:56:29 �[44msource�[0m > SourceNotion runtimes:
Syncing stream blocks 0:00:00.279629
Syncing stream databases 0:00:00.545167
2022-09-21 01:56:29 �[44msource�[0m > Syncing stream: pages 
2022-09-21 01:56:29 �[44msource�[0m > Read 0 records from pages stream
2022-09-21 01:56:29 �[44msource�[0m > Finished syncing pages
2022-09-21 01:56:29 �[44msource�[0m > SourceNotion runtimes:
Syncing stream blocks 0:00:00.279629
Syncing stream databases 0:00:00.545167
Syncing stream pages 0:00:00.166113
2022-09-21 01:56:29 �[44msource�[0m > Syncing stream: users 
2022-09-21 01:56:30 �[43mdestination�[0m > HikariPool-1 - Added connection net.snowflake.client.jdbc.SnowflakeConnectionV1@56b859a6
2022-09-21 01:56:30 �[43mdestination�[0m > HikariPool-1 - Start completed.
2022-09-21 01:56:30 �[43mdestination�[0m > closing connection
2022-09-21 01:56:31 �[44msource�[0m > Read 20 records from users stream
2022-09-21 01:56:31 �[44msource�[0m > Finished syncing users
2022-09-21 01:56:31 �[44msource�[0m > SourceNotion runtimes:
Syncing stream blocks 0:00:00.279629
Syncing stream databases 0:00:00.545167
Syncing stream pages 0:00:00.166113
Syncing stream users 0:00:01.430015
2022-09-21 01:56:31 �[44msource�[0m > Finished syncing SourceNotion
2022-09-21 01:56:31 �[32mINFO�[m i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):363 - Total records read: 20 (4 KB)
2022-09-21 01:56:31 �[32mINFO�[m i.a.w.g.DefaultReplicationWorker(run):182 - One of source or destination thread complete. Waiting on the other.
2022-09-21 01:56:31 �[43mdestination�[0m > Preparing staging area in destination completed for schema RAW stream notion_blocks
2022-09-21 01:56:31 �[43mdestination�[0m > Preparing staging area in destination started for schema RAW stream notion_databases: tmp table: _airbyte_tmp_veo_notion_databases, stage: 2022/09/21/01/30B10FF0-8F2C-44CE-A531-0137AB8F5CF1/
2022-09-21 01:56:31 �[43mdestination�[0m > closing connection
2022-09-21 01:56:31 �[43mdestination�[0m > Preparing staging area in destination completed for schema RAW stream notion_databases
2022-09-21 01:56:31 �[43mdestination�[0m > Preparing staging area in destination started for schema RAW stream notion_pages: tmp table: _airbyte_tmp_ugr_notion_pages, stage: 2022/09/21/01/30B10FF0-8F2C-44CE-A531-0137AB8F5CF1/
2022-09-21 01:56:31 �[43mdestination�[0m > closing connection
2022-09-21 01:56:32 �[43mdestination�[0m > Preparing staging area in destination completed for schema RAW stream notion_pages
2022-09-21 01:56:32 �[43mdestination�[0m > Preparing staging area in destination started for schema RAW stream notion_users: tmp table: _airbyte_tmp_vup_notion_users, stage: 2022/09/21/01/30B10FF0-8F2C-44CE-A531-0137AB8F5CF1/
2022-09-21 01:56:32 �[43mdestination�[0m > closing connection
2022-09-21 01:56:32 �[43mdestination�[0m > Preparing staging area in destination completed for schema RAW stream notion_users
2022-09-21 01:56:32 �[43mdestination�[0m > Preparing tmp tables in destination completed.
2022-09-21 01:56:32 �[43mdestination�[0m > Starting a new buffer for stream notion_users (current state: 0 bytes in 0 buffers)
2022-09-21 01:56:32 �[43mdestination�[0m > The main thread is exiting while children non-daemon threads from a connector are still active.
Ideally, this situation should not happen...
Please check with maintainers if the connector or library code should safely clean up its threads before quitting instead.
The main thread is: main (RUNNABLE)
 Thread stacktrace: java.base/java.lang.Thread.getStackTrace(Thread.java:1610)
        at io.airbyte.integrations.base.IntegrationRunner.dumpThread(IntegrationRunner.java:271)
        at io.airbyte.integrations.base.IntegrationRunner.watchForOrphanThreads(IntegrationRunner.java:219)
        at io.airbyte.integrations.base.IntegrationRunner.runConsumer(IntegrationRunner.java:177)
        at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:146)
        at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:97)
        at io.airbyte.integrations.destination.snowflake.SnowflakeDestination.main(SnowflakeDestination.java:30)
2022-09-21 01:56:32 �[43mdestination�[0m > Active non-daemon thread: pool-4-thread-1 (TIMED_WAITING)
 Thread stacktrace: java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252)
        at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1672)
        at java.base@17.0.1/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:460)
        at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
        at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122)
        at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@17.0.1/java.lang.Thread.run(Thread.java:833)
2022-09-21 01:56:32 �[43mdestination�[0m > Airbyte message consumer: succeeded.
2022-09-21 01:56:32 �[43mdestination�[0m > executing on success close procedure.
2022-09-21 01:56:32 �[43mdestination�[0m > Flushing all 1 current buffers (0 bytes in total)
2022-09-21 01:56:32 �[43mdestination�[0m > Flushing buffer of stream notion_users (10 bytes)
2022-09-21 01:56:32 �[43mdestination�[0m > Flushing buffer for stream notion_users (10 bytes) to staging
2022-09-21 01:56:32 �[43mdestination�[0m > Wrapping up compression and write GZIP trailer data.
2022-09-21 01:56:32 �[43mdestination�[0m > Finished writing data to 64ea5032-3091-4044-9e1c-3924360611f47453577430044996749.csv.gz (2 KB)
2022-09-21 01:56:33 �[43mdestination�[0m > closing connection
2022-09-21 01:56:33 �[43mdestination�[0m > Deleting tempFile data 64ea5032-3091-4044-9e1c-3924360611f47453577430044996749.csv.gz
2022-09-21 01:56:33 �[43mdestination�[0m > Closing buffer for stream notion_users
2022-09-21 01:56:33 �[43mdestination�[0m > Copying into tables in destination started for 4 streams
2022-09-21 01:56:33 �[43mdestination�[0m > Copying stream notion_blocks of schema RAW into tmp table _airbyte_tmp_ctb_notion_blocks to final table _airbyte_raw_notion_blocks from stage path 2022/09/21/01/30B10FF0-8F2C-44CE-A531-0137AB8F5CF1/ with 0 file(s) []
2022-09-21 01:56:35 �[43mdestination�[0m > Copying stream notion_databases of schema RAW into tmp table _airbyte_tmp_veo_notion_databases to final table _airbyte_raw_notion_databases from stage path 2022/09/21/01/30B10FF0-8F2C-44CE-A531-0137AB8F5CF1/ with 0 file(s) []
2022-09-21 01:56:35 �[43mdestination�[0m > Copying stream notion_pages of schema RAW into tmp table _airbyte_tmp_ugr_notion_pages to final table _airbyte_raw_notion_pages from stage path 2022/09/21/01/30B10FF0-8F2C-44CE-A531-0137AB8F5CF1/ with 0 file(s) []
2022-09-21 01:56:36 �[43mdestination�[0m > Copying stream notion_users of schema RAW into tmp table _airbyte_tmp_vup_notion_users to final table _airbyte_raw_notion_users from stage path 2022/09/21/01/30B10FF0-8F2C-44CE-A531-0137AB8F5CF1/ with 1 file(s) [64ea5032-3091-4044-9e1c-3924360611f47453577430044996749.csv.gz]
2022-09-21 01:56:38 �[43mdestination�[0m > No onDestinationCloseOperations required for this destination.
2022-09-21 01:56:38 �[43mdestination�[0m > Executing finalization of tables.
2022-09-21 01:56:40 �[43mdestination�[0m > Finalizing tables in destination completed.
2022-09-21 01:56:40 �[43mdestination�[0m > Cleaning up destination started for 4 streams
2022-09-21 01:56:40 �[43mdestination�[0m > Cleaning tmp table in destination started for stream notion_blocks. schema RAW, tmp table name: _airbyte_tmp_ctb_notion_blocks
2022-09-21 01:56:40 �[43mdestination�[0m > Cleaning stage in destination started for stream notion_blocks. schema RAW, stage: RAW_NOTION_BLOCKS
2022-09-21 01:56:40 �[43mdestination�[0m > Cleaning tmp table in destination started for stream notion_databases. schema RAW, tmp table name: _airbyte_tmp_veo_notion_databases
2022-09-21 01:56:40 �[43mdestination�[0m > Cleaning stage in destination started for stream notion_databases. schema RAW, stage: RAW_NOTION_DATABASES
2022-09-21 01:56:40 �[43mdestination�[0m > Cleaning tmp table in destination started for stream notion_pages. schema RAW, tmp table name: _airbyte_tmp_ugr_notion_pages
2022-09-21 01:56:40 �[43mdestination�[0m > Cleaning stage in destination started for stream notion_pages. schema RAW, stage: RAW_NOTION_PAGES
2022-09-21 01:56:40 �[43mdestination�[0m > Cleaning tmp table in destination started for stream notion_users. schema RAW, tmp table name: _airbyte_tmp_vup_notion_users
2022-09-21 01:56:40 �[43mdestination�[0m > Cleaning stage in destination started for stream notion_users. schema RAW, stage: RAW_NOTION_USERS
2022-09-21 01:56:41 �[43mdestination�[0m > Cleaning up destination completed.
2022-09-21 01:56:41 �[43mdestination�[0m > Completed integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination
2022-09-21 01:56:42 �[32mINFO�[m i.a.w.g.DefaultReplicationWorker(run):184 - Source and destination threads complete.
2022-09-21 01:56:42 �[32mINFO�[m i.a.w.g.DefaultReplicationWorker(run):281 - Source did not output any state messages
2022-09-21 01:56:42 �[33mWARN�[m i.a.w.g.DefaultReplicationWorker(run):292 - State capture: No state retained.
2022-09-21 01:56:42 �[32mINFO�[m i.a.w.g.DefaultReplicationWorker(run):300 - sync summary: {
  "status" : "completed",
  "recordsSynced" : 20,
  "bytesSynced" : 4234,
  "startTime" : 1663725385903,
  "endTime" : 1663725402562,
  "totalStats" : {
    "recordsEmitted" : 20,
    "bytesEmitted" : 4234,
    "sourceStateMessagesEmitted" : 0,
    "destinationStateMessagesEmitted" : 0,
    "recordsCommitted" : 20,
    "meanSecondsBeforeSourceStateMessageEmitted" : 0,
    "maxSecondsBeforeSourceStateMessageEmitted" : 0,
    "maxSecondsBetweenStateMessageEmittedandCommitted" : 0,
    "meanSecondsBetweenStateMessageEmittedandCommitted" : 0
  },
  "streamStats" : [ {
    "streamName" : "notion_users",
    "stats" : {
      "recordsEmitted" : 20,
      "bytesEmitted" : 4234,
      "recordsCommitted" : 20
    }
  } ]
}
2022-09-21 01:56:42 �[32mINFO�[m i.a.w.g.DefaultReplicationWorker(run):301 - failures: [ ]
2022-09-21 01:56:42 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):114 - 
2022-09-21 01:56:42 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling...
2022-09-21 01:56:42 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION -----
2022-09-21 01:56:42 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):114 - 
2022-09-21 01:56:42 �[32mINFO�[m i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):149 - sync summary: io.airbyte.config.StandardSyncOutput@50e96aa4[standardSyncSummary=io.airbyte.config.StandardSyncSummary@768dcf8f[status=completed,recordsSynced=20,bytesSynced=4234,startTime=1663725385903,endTime=1663725402562,totalStats=io.airbyte.config.SyncStats@5cd98b9a[recordsEmitted=20,bytesEmitted=4234,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=20,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@16b575f9[streamName=notion_users,stats=io.airbyte.config.SyncStats@d9291c1[recordsEmitted=20,bytesEmitted=4234,sourceStateMessagesEmitted=<null>,destinationStateMessagesEmitted=<null>,recordsCommitted=20,meanSecondsBeforeSourceStateMessageEmitted=<null>,maxSecondsBeforeSourceStateMessageEmitted=<null>,maxSecondsBetweenStateMessageEmittedandCommitted=<null>,meanSecondsBetweenStateMessageEmittedandCommitted=<null>,additionalProperties={}]]]],normalizationSummary=<null>,state=<null>,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@15fbd64b[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@5ee1a35[stream=io.airbyte.protocol.models.AirbyteStream@38c9bdcc[name=notion_blocks,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"pdf":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"file":{"type":["null","object"],"properties":{"url":{"type":"string"},"expiry_time":{"type":"string"}},"additionalProperties":true},"type":{"enum":["file","external"]},"caption":{"type":["null","array"],"items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"external":{"type":["null","object"],"properties":{"url":{"type":"string"}},"additionalProperties":true}},"additionalProperties":true},"code":{"type":"object","properties":{"text":{"type":"array","items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"color":{"type":"string"},"language":{"enum":["abap","arduino","bash","basic","c","clojure","coffeescript","c++","c#","css","dart","diff","docker","elixir","elm","erlang","flow","fortran","f#","gherkin","glsl","go","graphql","groovy","haskell","html","java","javascript","json","julia","kotlin","latex","less","lisp","livescript","lua","makefile","markdown","markup","matlab","mermaid","nix","objective-c","ocaml","pascal","perl","php","plain text","powershell","prolog","protobuf","python","r","reason","ruby","rust","sass","scala","scheme","scss","shell","sql","swift","typescript","vb.net","verilog","vhdl","visual basic","webassembly","xml","yaml","java/c/c++/c#"]}}},"file":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"file":{"type":["null","object"],"properties":{"url":{"type":"string"},"expiry_time":{"type":"string"}},"additionalProperties":true},"type":{"enum":["file","external"]},"caption":{"type":["null","array"],"items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"external":{"type":["null","object"],"properties":{"url":{"type":"string"}},"additionalProperties":true}},"additionalProperties":true},"type":{"enum":["paragraph","heading_1","heading_2","heading_3","callout","bulleted_list_item","numbered_list_item","to_do","toggle","code","child_page","child_database","embed","image","video","file","pdf","bookmark","equation","unsupported"]},"embed":{"type":"object","properties":{"url":{"type":"string"}}},"image":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"file":{"type":["null","object"],"properties":{"url":{"type":"string"},"expiry_time":{"type":"string"}},"additionalProperties":true},"type":{"enum":["file","external"]},"caption":{"type":["null","array"],"items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"external":{"type":["null","object"],"properties":{"url":{"type":"string"}},"additionalProperties":true}},"additionalProperties":true},"quote":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"text":{"type":"array","items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"color":{"type":"string"},"children":{"type":"array","items":{"type":"object"}}},"additionalProperties":true},"to_do":{"type":"object","properties":{"text":{"type":"array","items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"checked":{"type":["null","boolean"]},"children":{"type":"array","items":{"type":"object"}}}},"vidoe":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"file":{"type":["null","object"],"properties":{"url":{"type":"string"},"expiry_time":{"type":"string"}},"additionalProperties":true},"type":{"enum":["file","external"]},"caption":{"type":["null","array"],"items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"external":{"type":["null","object"],"properties":{"url":{"type":"string"}},"additionalProperties":true}},"additionalProperties":true},"object":{"enum":["block"]},"toggle":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"text":{"type":"array","items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"color":{"type":"string"},"children":{"type":"array","items":{"type":"object"}}},"additionalProperties":true},"callout":{"type":"object","properties":{"icon":{"anyOf":[{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"file":{"type":["null","object"],"properties":{"url":{"type":"string"},"expiry_time":{"type":"string"}},"additionalProperties":true},"type":{"enum":["file","external"]},"caption":{"type":["null","array"],"items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"external":{"type":["null","object"],"properties":{"url":{"type":"string"}},"additionalProperties":true}},"additionalProperties":true},{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"type":{"type":"string"},"emoji":{"type":"string"}},"additionalProperties":true}],"$schema":"http://json-schema.org/draft-07/schema#"},"text":{"type":"array","items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"color":{"type":"string"},"children":{"type":"array","items":{"type":"object"}}}},"archived":{"type":"boolean"},"bookmark":{"type":"object","properties":{"url":{"type":"string"},"caption":{"type":"array","items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}}}},"equation":{"type":"object","properties":{"expression":{"type":"string"}}},"heading_1":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"text":{"type":"array","items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"color":{"type":"string"}},"additionalProperties":true},"heading_2":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"text":{"type":"array","items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"color":{"type":"string"}},"additionalProperties":true},"heading_3":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"text":{"type":"array","items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"color":{"type":"string"}},"additionalProperties":true},"paragraph":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"text":{"type":"array","items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"color":{"type":"string"},"children":{"type":"array","items":{"type":"object"}}},"additionalProperties":true},"child_page":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"title":{"type":"string"}},"additionalProperties":true},"created_time":{"type":"string"},"has_children":{"type":["null","boolean"]},"child_database":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"title":{"type":"string"}},"additionalProperties":true},"last_edited_time":{"type":"string"},"bulleted_list_item":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"text":{"type":"array","items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"color":{"type":"string"},"children":{"type":"array","items":{"type":"object"}}},"additionalProperties":true},"numbered_list_item":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"text":{"type":"array","items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"color":{"type":"string"},"children":{"type":"array","items":{"type":"object"}}},"additionalProperties":true}},"additionalProperties":true},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[last_edited_time],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[last_edited_time],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@214c3f8d[stream=io.airbyte.protocol.models.AirbyteStream@6a4eec61[name=notion_databases,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"url":{"type":"string"},"icon":{"anyOf":[{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"file":{"type":["null","object"],"properties":{"url":{"type":"string"},"expiry_time":{"type":"string"}},"additionalProperties":true},"type":{"enum":["file","external"]},"caption":{"type":["null","array"],"items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"external":{"type":["null","object"],"properties":{"url":{"type":"string"}},"additionalProperties":true}},"additionalProperties":true},{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"type":{"type":"string"},"emoji":{"type":"string"}},"additionalProperties":true}],"$schema":"http://json-schema.org/draft-07/schema#"},"cover":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"file":{"type":["null","object"],"properties":{"url":{"type":"string"},"expiry_time":{"type":"string"}},"additionalProperties":true},"type":{"enum":["file","external"]},"caption":{"type":["null","array"],"items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"external":{"type":["null","object"],"properties":{"url":{"type":"string"}},"additionalProperties":true}},"additionalProperties":true},"title":{"type":"array","items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"object":{"enum":["database"]},"parent":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"type":{"enum":["database_id","page_id","workspace"]},"page_id":{"type":"string"},"workspace":{"type":"boolean"},"database_id":{"type":"string"}},"additionalProperties":true},"archived":{"type":"boolean"},"is_inline":{"type":["null","boolean"]},"created_by":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"bot":{"type":["null","object"],"properties":{"owner":{"type":"object","properties":{"type":{"type":"string"},"workspace":{"type":["null","boolean"]}}}},"additionalProperties":true},"name":{"type":"string"},"type":{"enum":["person","bot"]},"object":{"enum":["user"]},"person":{"type":["null","object"],"properties":{"email":{"type":"string"}},"additionalProperties":true},"avatar_url":{"type":["null","string"]}},"additionalProperties":true},"properties":{"type":"array","items":{"type":["null","object"],"properties":{"name":{"type":["null","string"]},"value":{"type":"object","oneOf":[{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"enum":["title","rich_text","date","people","files","checkbox","url","email","phone_number","created_time","created_by","last_edited_time","last_edited_by"]}},"additionalProperties":true},{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"enum":["number"]},"format":{"enum":["number","number_with_commas","percent","dollar","canadian_dollar","euro","pound","yen","ruble","rupee","won","yuan","real","lira","rupiah","franc","hong_kong_dollar","new_zealand_dollar","krona","norwegian_krone","mexican_peso","rand","new_taiwan_dollar","danish_krone","zloty","baht","forint","koruna","shekel","chilean_peso","philippine_peso","dirham","colombian_peso","riyal","ringgit","leu"]}}},{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"enum":["select","multi_select"]},"options":{"type":"array","items":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"name":{"type":"string"},"color":{"enum":["default","gray","brown","orange","yellow","green","blue","purple","pink","red"]}},"additionalProperties":true}}}},{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"enum":["formula"]},"expression":{"type":"string"}}},{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"enum":["relation"]},"database_id":{"type":"string"},"synced_property_id":{"type":["null","string"]},"synced_property_name":{"type":["null","string"]}}},{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"enum":["rollup"]},"function":{"enum":["count_all","count_values","count_unique_values","count_empty","count_not_empty","percent_empty","percent_not_empty","sum","average","median","min","max","range","show_original"]},"rollup_property_id":{"type":"string"},"relation_property_id":{"type":"string"},"rollup_property_name":{"type":"string"},"relation_property_name":{"type":"string"}}}],"additionalProperties":true}},"additionalProperties":true}},"created_time":{"type":"string"},"last_edited_by":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"bot":{"type":["null","object"],"properties":{"owner":{"type":"object","properties":{"type":{"type":"string"},"workspace":{"type":["null","boolean"]}}}},"additionalProperties":true},"name":{"type":"string"},"type":{"enum":["person","bot"]},"object":{"enum":["user"]},"person":{"type":["null","object"],"properties":{"email":{"type":"string"}},"additionalProperties":true},"avatar_url":{"type":["null","string"]}},"additionalProperties":true},"last_edited_time":{"type":"string"}},"additionalProperties":true},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[last_edited_time],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[last_edited_time],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@1f047caf[stream=io.airbyte.protocol.models.AirbyteStream@6a56955e[name=notion_pages,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"url":{"type":"string"},"cover":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"file":{"type":["null","object"],"properties":{"url":{"type":"string"},"expiry_time":{"type":"string"}},"additionalProperties":true},"type":{"enum":["file","external"]},"caption":{"type":["null","array"],"items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"external":{"type":["null","object"],"properties":{"url":{"type":"string"}},"additionalProperties":true}},"additionalProperties":true},"object":{"enum":["page"]},"parent":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"type":{"enum":["database_id","page_id","workspace"]},"page_id":{"type":"string"},"workspace":{"type":"boolean"},"database_id":{"type":"string"}},"additionalProperties":true},"archived":{"type":"boolean"},"properties":{"type":"array","items":{"type":"object","properties":{"name":{"type":["null","string"]},"value":{"type":"object","oneOf":[{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["title"]},"title":{"properties":{"text":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}}},"type":{"type":["null","string"]},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}},"additionalProperties":true}},"type":{"type":["null","string"]}}}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["rich_text"]},"rich_text":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["select"]},"select":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"name":{"type":"string"},"color":{"enum":["default","gray","brown","orange","yellow","green","blue","purple","pink","red"]}},"additionalProperties":true}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["multi_select"]},"multi_select":{"type":["null","array"],"items":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"name":{"type":"string"},"color":{"enum":["default","gray","brown","orange","yellow","green","blue","purple","pink","red"]}},"additionalProperties":true}}}},{"type":"object","properties":{"id":{"type":"string"},"date":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"end":{"type":["null","string"]},"start":{"type":["null","string"]},"time_zone":{"type":["null","string"]}},"additionalProperties":true},"type":{"enum":["date"]}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["formula"]},"formula":{"type":["null","object"],"properties":{"date":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"end":{"type":["null","string"]},"start":{"type":["null","string"]},"time_zone":{"type":["null","string"]}},"additionalProperties":true},"type":{"enum":["string","number","boolean","date"]},"number":{"type":["null","number"]},"string":{"type":["null","string"]},"boolean":{"type":["null","boolean"]}}}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["relation"]},"relation":{"type":["null","array"],"items":{"type":"object","properties":{"id":{"type":"string"}}}}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["rollup"]},"rollup":{"type":["null","object"],"properties":{"date":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"end":{"type":["null","string"]},"start":{"type":["null","string"]},"time_zone":{"type":["null","string"]}},"additionalProperties":true},"type":{"enum":["number","date","array"]},"array":{"type":["null","array"],"items":{"type":"object","properties":{"type":{"type":"string"}}}},"number":{"type":["null","number"]}}}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["people"]},"people":{"type":["null","array"],"items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"bot":{"type":["null","object"],"properties":{"owner":{"type":"object","properties":{"type":{"type":"string"},"workspace":{"type":["null","boolean"]}}}},"additionalProperties":true},"name":{"type":"string"},"type":{"enum":["person","bot"]},"object":{"enum":["user"]},"person":{"type":["null","object"],"properties":{"email":{"type":"string"}},"additionalProperties":true},"avatar_url":{"type":["null","string"]}},"additionalProperties":true}}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["files"]},"files":{"type":["null","array"],"items":{"type":"object","properties":{"url":{"type":"string"},"name":{"type":"string"},"type":{"enum":["external","file"]},"expiry_time":{"type":["null","string"]}}}}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["checkbox"]},"checkout":{"type":["null","boolean"]}}},{"type":"object","properties":{"id":{"type":"string"},"url":{"type":"string"},"type":{"enum":["url"]}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["email"]},"email":{"type":"string"}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["phone_number"]},"phone_number":{"type":"string"}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["created_time"]},"created_time":{"type":"string"}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["created_by"]},"created_by":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"bot":{"type":["null","object"],"properties":{"owner":{"type":"object","properties":{"type":{"type":"string"},"workspace":{"type":["null","boolean"]}}}},"additionalProperties":true},"name":{"type":"string"},"type":{"enum":["person","bot"]},"object":{"enum":["user"]},"person":{"type":["null","object"],"properties":{"email":{"type":"string"}},"additionalProperties":true},"avatar_url":{"type":["null","string"]}},"additionalProperties":true}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["last_edited_time"]},"last_edited_time":{"type":"string"}}},{"type":"object","properties":{"id":{"type":"string"},"type":{"enum":["last_edited_by"]},"last_edited_by":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"bot":{"type":["null","object"],"properties":{"owner":{"type":"object","properties":{"type":{"type":"string"},"workspace":{"type":["null","boolean"]}}}},"additionalProperties":true},"name":{"type":"string"},"type":{"enum":["person","bot"]},"object":{"enum":["user"]},"person":{"type":["null","object"],"properties":{"email":{"type":"string"}},"additionalProperties":true},"avatar_url":{"type":["null","string"]}},"additionalProperties":true}}}],"additionalProperties":true}},"additionalProperties":true}},"created_time":{"type":"string"},"last_edited_time":{"type":"string"}},"additionalProperties":true},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[last_edited_time],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[last_edited_time],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@2a266fce[stream=io.airbyte.protocol.models.AirbyteStream@3796a30f[name=notion_users,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"bot":{"type":["null","object"],"properties":{"owner":{"type":"object","properties":{"type":{"type":"string"},"workspace":{"type":["null","boolean"]}}}},"additionalProperties":true},"name":{"type":"string"},"type":{"enum":["person","bot"]},"object":{"enum":["user"]},"person":{"type":["null","object"],"properties":{"email":{"type":"string"}},"additionalProperties":true},"avatar_url":{"type":["null","string"]}},"additionalProperties":true},supportedSyncModes=[full_refresh],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]]
2022-09-21 01:56:42 �[32mINFO�[m i.a.w.t.TemporalUtils(withBackgroundHeartbeat):279 - Stopping temporal heartbeating...
2022-09-21 01:56:42 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):106 - Docker volume job log path: /tmp/workspace/7626/0/logs.log
2022-09-21 01:56:42 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.7
2022-09-21 01:56:42 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):114 - 
2022-09-21 01:56:42 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):114 - ----- START DEFAULT NORMALIZATION -----
2022-09-21 01:56:42 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):114 - 
2022-09-21 01:56:42 �[32mINFO�[m i.a.w.n.DefaultNormalizationRunner(runProcess):138 - Running with normalization version: airbyte/normalization-snowflake:0.2.22
2022-09-21 01:56:42 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/normalization-snowflake:0.2.22 exists...
2022-09-21 01:56:42 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):114 - airbyte/normalization-snowflake:0.2.22 was found locally.
2022-09-21 01:56:42 �[32mINFO�[m i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = normalization-snowflake-normalize-7626-0-ciion with resources io.airbyte.config.ResourceRequirements@2c1c38dc[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=]
2022-09-21 01:56:42 �[32mINFO�[m i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/7626/0/normalize --log-driver none --name normalization-snowflake-normalize-7626-0-ciion --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.40.7 airbyte/normalization-snowflake:0.2.22 run --integration-type snowflake --config destination_config.json --catalog destination_catalog.json
...

Steps to Reproduce

  1. Setup Notion with a couple of pages, databases, users, etc
  2. Setup airbyte Notion Source and Destination
  3. Sync...
@philippeboyd philippeboyd added needs-triage type/bug Something isn't working labels Sep 21, 2022
@philippeboyd philippeboyd changed the title [Source Notion] - All streams are empty except Users [Source Notion] - When syncing, all streams are empty except Users Sep 21, 2022
@onepiecewyz
Copy link

same bug , wait for fix

@natalyjazzviolin natalyjazzviolin changed the title [Source Notion] - When syncing, all streams are empty except Users Source Notion: When syncing, all streams are empty except Users Nov 21, 2022
@lucienfregosibodyguard
Copy link
Contributor

Same issue here, any workaround ?

@philippeboyd
Copy link
Contributor Author

philippeboyd commented Jan 11, 2023

@davydov-d I'm wondering how did you test your PR #20639
Concerning this issue, I updated to 1.0.0 but still facing the same issue; only Stream users is being synced.

FWIW: Authentication for the connector is done with an admin Access Token.

@davydov-d
Copy link
Collaborator

@philippeboyd did you reset your schema?

@philippeboyd
Copy link
Contributor Author

@philippeboyd did you reset your schema?

I did, yes

@clharman
Copy link

Experiencing the same thing. Tried resetting and changing the sync modes, no luck. Using a token.

@davydov-d
Copy link
Collaborator

@philippeboyd @clharman
I'm not sure if this is okay for OSS but I just managed to run a successful sync like follows:

  • delete the source connector
  • Go to Settings -> Sources -> Available Source Connectors and change the version to 1.0.0, press Change

image

  • Re-create the source connector, run the sync again

Please let me know if this works for you. If yes, the problem is in upgrading the connector so I will ask the platform team to take a look

@philippeboyd
Copy link
Contributor Author

@davydov-d, sorry but that didn't work.

When you have your successful sync, do you have records returned for streams blocks,databases, and pages?
Also, which authentication method are you using? Token or OAuth?

@clharman
Copy link

@davydov-d tried the 1.0.0 change, no luck here either :/

@potatozerg
Copy link

+1 Same error

@cmarfaingmay
Copy link

+1 I get the same error when testing locally

@tybernstein
Copy link
Contributor

Have you all checked to see if your Notion Integration has been added to all of the pages you want to sync with? It must be explicitly added for the connector to sync it. We encountered this issue with an Airbyte Cloud user and after investigating this solved their problem.
image

@potatozerg
Copy link

Have you all checked to see if your Notion Integration has been added to all of the pages you want to sync with? It must be explicitly added for the connector to sync it. We encountered this issue with an Airbyte Cloud user and after investigating this solved their problem. image

It worked!

@tybernstein tybernstein self-assigned this Apr 13, 2023
@tybernstein
Copy link
Contributor

That is great, thank you for confirming! Closing as permissions error.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

10 participants